<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Development of informative neighborhood selection technology for modeling texture images</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>E. Biryukova</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>R. Paringer</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>A. Kupriyanov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Image Processing Systems Institute - Branch of the Federal Scientific Research Centre “Crystallography and Photonics” of Russian Academy of Sciences</institution>
          ,
          <addr-line>151 Molodogvardeyskaya st., 443001, Samara</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Samara National Research University</institution>
          ,
          <addr-line>34 Moskovskoe Shosse, 443086, Samara</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <fpage>32</fpage>
      <lpage>36</lpage>
      <abstract>
        <p>The paper proposes a method for constructing an informative neighborhood for modeling texture images. To describe the characteristic features of textures used assumptions underlying model representation texture images described by using a Markov random field. The results of the conducted experimental researches confirm that application of the developed approach allows to reduce the dimensionality of the features space while preserving the reliability of the classification. Texture analysis widespread in the processing of various types of images. However, despite the fact that even in 1979 Haralick noted that the methods of distinguishing textures are developed individually for each specific case [1], there is no clear definition of texture or a particular concept in solving problems analysis of texture images. Haindl wrote that the texture is a surface property, which is the spatial information contained in the object's surface [2]. The literature describes three approaches to texture analysis [1, 3, and 4]:  A statistical approach, wherein the set of features used to provide texture image characteristics.  Structural modeling allows us to consider texture as two-dimensional images composed of many primitives or subpatterns that are arranged accordance with a certain rule.  Stochastic modeling suggests that the texture is the realization of a stochastic process that is characterized by certain parameters. This approach allows you to get good results for the generation of realistic natural texture images using Markov random fields [5]. To classification texture images, we will apply the model image as a realization of a random Markov field, that is, a stochastic approach to texture analysis. Great contribution to the development of this model has made by Haralick, who introduced the statistical and structural approaches to the description of texture [6] and suggested using of features based on the matrix of mutual probability distribution. The proposed is the gray level co-occurrence matrix [1]. It describes the spatial relationships of brightness pairs of texture elements.</p>
      </abstract>
      <kwd-group>
        <kwd>Markov random field</kwd>
        <kwd>Gaussian Markov field</kwd>
        <kwd>texture image classification</kwd>
        <kwd>co-occurrence matrix</kwd>
        <kwd>causal neighborhood</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1. Introduction</p>
      <p>
        Introduction of stochastic models and random fields models have led to the development of image reconstruction algorithms,
segmentation, modeling and texture classification. In particular, Markov random fields is very useful for modeling spatial
relationships, as well as for the study of stochastic interaction between the observed values, including the analysis of medical
images and interpretation of remote sensing images [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        The theory of Markov random field (MRF) provides a convenient and consistent method for modeling communication
between dependent entities, such as image pixels and correlated features. Convenience is achieved due to the characteristic
mutual influence among such objects, when using conditional distribution of MRF. The practical use of the model Markov
random field obtained thanks to the theorem of equivalence between MRF and the Gibbs distribution, which was introduced by
Hammersley and Clifford in 1971 [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. This is because the joint distribution required for most applications, but the conclusion of
the joint distribution of the conditional is very difficult for MRF. Equivalence theorem of Markov random fields and Gibbs
points out that the joint distribution of MRF is the simplest form of the Gibbs distribution.
      </p>
      <p>
        We will consider the model of a Gaussian Markov random field (GMRF), which is a particular case of MRF, where the value
of the pixel in the position (i, j) is statistically independent of neighboring pixels. This means that the model takes into account
the spatial interaction between the various components within each color component, and interaction of [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Image is represented
on a rectangular lattice S = M * N with  number of bands.
      </p>
      <p>Let  ( ,  ) = [ 1( ,  ) 2( ,  ) …   ( ,  )] is a vector in a texture region R. It is assumed that the vector at a position (i, j)
represents the linear combination of the color components of neighboring pixels and additive Gaussian noise. Let  1,  2 …  
denote the mean color intensity, and  1,  2 …   the spatial interaction of pixels and   be the expected value of     . x, y
takes on the values from 1 to р. Let   the associated parameters of the model and ∑ the co-occurrence matrix.</p>
      <p>Spatial interaction of color pixels is defined as:
Similarly it is defined for  2( ,  ),  3( ,  ) …   ( ,  ). The generalized form is given by:
( , )∈ 12
−</p>
      <p>∑
( , )∈ 1
( , )∈  2
−</p>
      <p>∑
( , )∈</p>
      <p>∑
( , )∈ 11</p>
      <p>∑
( , )∈  1
 1( ,  ) = ( 1( ,  ) −  1) −</p>
      <p>11( ,  )( 1( +  ,  +  ) −  1)
−
∑
 12( ,  )( 2( +  ,  +  ) −  2) − ⋯</p>
      <p>1 ( ,  )(  ( +  ,  +  ) −   ).
  ( ,  ) = (  ( ,  ) −   ) −</p>
      <p>1( ,  )( 1( +  ,  +  ) −  1)
−
∑</p>
      <p>2( ,  )( 2( +  ,  +  ) −  2) − ⋯
  ( ,  )(  ( +  ,  +  ) −   ) ,  = ̅1̅̅,̅̅,
where Nxy denote neighboring pixels. If х=у, then the neighboring pixels will correspond to the same color component.
Otherwise, the neighboring pixels are of the other components.</p>
      <p>The co-occurrence matrix is defined as follows:
∑ = (
 11
 21</p>
      <p>⋮
  1   2
 12
 22
 1
 2
⋯
⋱
⋯ 

⋮ ) .
  =  [    ] =
∑   ( ,  )</p>
      <p>( ,  ).
1
  ( , )∈
The expected value   is represented as:
Having described all the terms, the probability density function of X(i,j) is found to be:
 ( ( ,  )| ) =</p>
      <p>1
((2 ) |Ʃ|)2
1 exp{
−1
2</p>
      <p>
        ( 1( ,  ) 2( ,  ) …   ( ,  )) ∑( 1( ,  ) 2( ,  ) …   ( ,  )) }.
neighborhood:
images on the textural classes.
criterion [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
3. Choice of informative neighborhood
      </p>
      <p>
        Winkler in "Image Analysis, Random Fields and Dynamic Monte Carlo Methods" [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] writes the restoration images and
modeling textures with random fields, in detail the finite random fields, including MRF applies Monte Carlo methods for
Markov chains. Chohen for example textile fabrics control automation task [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] solves the problem of detection and localization
of various kinds of defects, which uses Gaussian Markov random field and the non-causal neighborhood. Kovtun in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
proposes a model image, a feature of which is that the segmentation and each texture are set independent random fields. His
work is an attempt to highlight the problem of texture segmentation of the general class of problems of generation and modeling
of Markov random fields.
      </p>
      <p>
        Thus, in [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref3 ref5 ref7 ref8 ref9">3, 5, 7-12</xref>
        ] is said about using the Markov random field model to describe and generate texture images. One of the
,
To distinguish the classes of texture images, we used statistical features calculated by the formula:
where  is the image intensity function,  is the number of image pixels. In the following research we used the features λ,
calculated at Δx, Δy = 0, ±1, ±2, n = 1, 2, 3. Because the features are symmetrical used causal neighborhood.
      </p>
      <p>Individual criteria of separability for each feature were calculated (Figure 3).</p>
      <p>For a sample consisting of n elements, divided into classes g and comprising a p features separability criterion is calculated
a)</p>
      <p>a)
 f  x, y   f  x  x,  y  y  n</p>
      <p>N
 =  (( )−1 ),</p>
      <p>= ∑ =1   ( 
−   )(</p>
      <p>−   ),  ,  = 1,  ,
 
=
∑ =1 ∑  =1( 

−   )( 
−   ),  ,  = 1,  ,
using the following formulas:
where  =</p>
      <p>+  .

 
feature of  class,   = 1⁄</p>
      <p>elements in  class.</p>
      <p>– is the intergroup dispersion matrix. The elements of this matrix are calculated according to the formula:
− is the intragroup dispersion matrix. The elements of the matrix are calculated according to the formula:
– is the value of the  ˗ ℎ feature for the  ˗ ℎ element of  class,  
= 1
⁄
 
∑ 

=1  
– is the mean value of the  ˗ ℎ
∑ =1     – is the mean value of the  ˗ ℎ feature in all the classes, and   is the number of
0.74
0.58
0.58
0.53
0.77
0.74
0.61
0.82
0.85
0.77
0.61</p>
      <p>0.55</p>
      <p>Image Processing, Geoinformation Technology and Information Security / E. Biryukova, R. Paringer, A. Kupriyanov
The higher the value of the criterion is, the more the separability of the classes grows.</p>
      <p>After calculating the individual criteria for separability, features with a low value criterion were excluded. Analysis of the
feature space, led to the conclusion that some of the neighboring pixels carry information about the features of the texture (pixel
information are highlighted in Figure 3). It was excluded from the neighborhood of the pixels corresponding to non -informative
features (calculated at (Δx = 2, Δy = 2), (Δx = -2, Δy = 1), (Δx = 1, Δy = 1), (Δx = -2, Δy = 0), (Δx = -1, Δy = 0), (Δx = -2, Δy =
1)). Thus, we resins are informative neighborhood new form. Modified neighborhood for the test classes is shown in Figure 4.</p>
      <p>
        To study the effectiveness of the technology was evaluated the quality of the selected neighborhood. The evaluation was
conducted by calculating the clustering error on the based of k-means algorithm, where the centers of the starting classes used as
initial conditions [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Under the error of clustering is understood the proportion of images that were not attributed to their class.
Clustering error in the case of using features calculated by causal neighborhood was 0.21, the modified 0.19, which confirms the
information content of the modified neighborhood.
      </p>
      <p>Table 1 shows the values of the clustering error in the case of features, calculated using the causal neighborhood and
modified to distinguish other classes of images from the selected base textures.</p>
      <p>As Table 1 shows that clustering error value using the modified neighborhood does not exceed the error value using a causal
neighborhood, which indicates the information content received surroundings, and hence the effectiveness of the proposed
technology.</p>
      <p>Figure 5 shows the mean values of separability criteria for the cases considered in Table 1, the modified neighborhoods are
highlighted in color.</p>
      <p>0.82
0.77
0.71
0.78
0.84
0.82
0.61
4. Conclusion
0.78
0.64
0.65
0.65
0.79
0.77
0.66
0.65
0.74
0.75
0.61
0.59
0.74
0.54
0.77
0.66
0.79
0.16
0.08
0.08
0.05
0.08
0.15
0.16
0.15
0.22
0.05
0.08
0.04
blanket1 and canvas1
scarf1 and scarf2
linseeds and sesameseeds</p>
      <p>The paper presents the technology of choice informative neighborhood, which has shown to be effective for the considered
classes of texture images. The features space and the clustering error were reduced by reducing the number of neighboring
pixels. The proposed technique can be used to modeling texture images, wherein for the calculation of the model parameters
using a Markov random field neighborhood.</p>
      <p>Image Processing, Geoinformation Technology and Information Security / E. Biryukova, R. Paringer, A. Kupriyanov
Acknowledgements</p>
      <p>This work was partially supported by the Ministry of education and science of the Russian Federation in the framework of the
implementation of the Program of increasing the competitiveness of SSAU among the world’s leading scientific and educational
centers for 2013-2020 years; by the Russian Foundation for Basic Research grants (# 15-29-03823, # 15-29-07077, #
16-41630761, # 17-01-00972); by the ONIT RAS program # 6 “Bioinformatics, modern information technologies and mathematical
methods in medicine” 2017.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Haralick</surname>
            <given-names>RM</given-names>
          </string-name>
          .
          <article-title>Statistical and structural approaches to texture</article-title>
          .
          <source>Proceedings of the IEEE</source>
          <year>1979</year>
          ;
          <volume>67</volume>
          (
          <issue>5</issue>
          ):
          <fpage>786</fpage>
          -
          <lpage>804</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Haindl</surname>
            <given-names>M.</given-names>
          </string-name>
          <article-title>Texture synthesis</article-title>
          .
          <source>CWI Quarterly</source>
          <year>1991</year>
          ;
          <volume>4</volume>
          :
          <fpage>305</fpage>
          -
          <lpage>331</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Dubes</surname>
            <given-names>RC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jain</surname>
            <given-names>AK</given-names>
          </string-name>
          .
          <article-title>Random field models in image analysis</article-title>
          .
          <source>Journal of Applied Statistics</source>
          <year>1989</year>
          ;
          <volume>16</volume>
          (
          <issue>2</issue>
          ):
          <fpage>131</fpage>
          -
          <lpage>164</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Ahuja</surname>
            <given-names>N</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosenfeld</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Mosaic models for textures</article-title>
          .
          <source>IEEE Transactions on Pattern Analysis and Machine Intelligence</source>
          <year>1981</year>
          ; PA MI 3:
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Plastinin</surname>
            <given-names>AI.</given-names>
          </string-name>
          <article-title>The method of forming features texture images based on Markov models</article-title>
          .
          <source>Dis. kan. those. Sciences, Samara</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Haralick</surname>
            <given-names>RM</given-names>
          </string-name>
          .
          <article-title>Statistical and structural approaches to the description of textures</article-title>
          .
          <source>TIIRE</source>
          <year>1979</year>
          ;
          <volume>5</volume>
          :
          <fpage>98</fpage>
          -
          <lpage>118</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Li</given-names>
            <surname>SZ</surname>
          </string-name>
          .
          <article-title>Markov Random Field in Image Analysis</article-title>
          . Springer-Verlag,
          <year>2009</year>
          ; 362 p.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Hammersley</surname>
            <given-names>JM</given-names>
          </string-name>
          , Clifford P.
          <article-title>Markov field on finite graphs and lattices</article-title>
          , unpublished,
          <year>1971</year>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Mridula</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Feature</surname>
          </string-name>
          <article-title>Based Segmentation of Colour Textured Images using Markov Random Field Model</article-title>
          . Master of Technology, Odisha, India,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Winkler</surname>
            <given-names>G. Image</given-names>
          </string-name>
          <string-name>
            <surname>Analysis</surname>
          </string-name>
          ,
          <source>Random Fields and Dynamic Carlo Methods Monte. Novosibirsk: Branch "Geo" Publishing RAS</source>
          ,
          <year>2002</year>
          ; 343 p.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Cohen</surname>
            <given-names>FS</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fan</surname>
            <given-names>Z</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Attali</surname>
            <given-names>S</given-names>
          </string-name>
          .
          <source>Automated Inspection of Textile Fabrics Using Textural Models. IEEE Transactions on Pattern Analysis and Machine Intelligence</source>
          <year>1991</year>
          ;
          <volume>8</volume>
          (
          <issue>13</issue>
          ):
          <fpage>803</fpage>
          -
          <lpage>808</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Kovtun</surname>
            <given-names>IV</given-names>
          </string-name>
          .
          <article-title>Texture image segmentation based on Markov random fields</article-title>
          .
          <source>Control systems and machines</source>
          <year>2003</year>
          ;
          <volume>4</volume>
          :
          <fpage>46</fpage>
          -
          <lpage>55</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Fukunaga</surname>
            <given-names>K.</given-names>
          </string-name>
          <article-title>Introduction to statistical pattern recognition theory</article-title>
          . Moscow: Nauka,
          <year>1979</year>
          ; 270 p.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Biryukova</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paringer</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kupriyanov</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Development of the effective set of features construction technology for texture image classes discrimination</article-title>
          .
          <source>CEUR Workshop Proceedings</source>
          <year>2016</year>
          ;
          <volume>1638</volume>
          :
          <fpage>263</fpage>
          -
          <lpage>269</lpage>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>1613</fpage>
          -0073-2016-1638-357-363.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Kylberg</surname>
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Kylberg Texture</surname>
          </string-name>
          Dataset v.
          <volume>1</volume>
          .
          <issue>0</issue>
          ,
          <year>2014</year>
          . URL: http://www.cb.uu.se/~gustaf/texture.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Mandel</surname>
            <given-names>ID</given-names>
          </string-name>
          .
          <article-title>Cluster analysis</article-title>
          .
          <source>Moscow: Finance and Statistics</source>
          ,
          <year>1988</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>