<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Non-Linear Filtering of Images on the Basis of Generalized Method of Least Absolute Values</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alexander N. Tyrsin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vladimir A. Surin</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Science and Engineering Center “Reliability and Resource of Large Systems and Machines”, Ural Branch of the Russian Academy of Sciences</institution>
          ,
          <addr-line>Yekaterinburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>South-Ural State University</institution>
          ,
          <addr-line>Chelyabinsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>41</fpage>
      <lpage>47</lpage>
      <abstract>
        <p>In article consider the possibility of usage of generalized method of least absolute values for non-linear filtering of images and signals. Generalized Method of Least Absolute Values is more efficient than median methods of image processing in case of impulse interference, as well as when suppressing noise interference on high-contrast images. Workload in case of data smoothing based on Generalized Method of Least Absolute Values is comparable with the volume of calculations of median filter. Examples of realization of a method are resulted.</p>
      </abstract>
      <kwd-group>
        <kwd>generalized method of least absolute values</kwd>
        <kwd>image filtering</kwd>
        <kwd>median filter</kwd>
        <kwd>impulsive disturbance</kwd>
        <kwd>smoothing</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Noise suppression is one of topical problems of signals and images processing.
All linear filtering algorithms lead to smoothing of sharp overfalls of brightness of
images under processing. This feature, being most critical in case if the information is
intended for human user, shall not be conceptually excluded from the procedure of
linear processing. The point is that linear procedures are optimal when Gaussian
distribution takes place with signals, interference and observed data. Technically, actual
images do not conform with this probability distribution. Moreover, one of basic
causes of this behavior is that an image has various boundaries, brightness overfalls,
texture transitions, and so on. In this respect, many real images locally described as
Gaussian within the limited area, unlikely appear as Gaussian objects. This is the
particular cause of poor rendering of boundaries with linear filtering.</p>
      <p>Second feature of linear filtering is its optimality, as mentioned before, in
connection with Gaussian nature of interference. Normally it is related to noise interference
on images, and due to this fact, when suppressed, their linear algorithms have high
rates. However, we often deal with images distorted with interference of other types.
One of which is impulsive disturbance. When interference affects the image we
observe white or (and) black dots randomly scattered across the frame. Application of
linear filtering in this case is inefficient, since each input pulse responds as filter pulse
characteristic, and altogether they promote interference distribution throughout the
frame area.</p>
      <p>
        Successful solution for the described issue is the method of median filtering
introduced by John Wilder Tukey [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Sequential processing of each point of a frame
occurs when median filter is applied, resulting in formation of sequence of estimators
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Conceptually, processing in separate points is independent, but to speedup the
process it is practical to use previous calculations on each step. Median filters are
efficient when impulse noise smoothing.
      </p>
      <p>
        But the worst case for median filtering is high-contrast image. Median filter is
sensitive to high brightness overfalls. Thus, median filtering leads to signal depression,
which manifests as blurred contours of contrast image details. As well, during noise
suppression, pulses, which are close to each other, may persist. To eliminate the
mentioned limitations, a number of various modifications to median filtering were
proposed [
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3–5</xref>
        ]. They may include various weighed and adaptive algorithms of medial
filtering. In some cases these are of certain advantage compared to median filtering,
but still they are insufficiently formalized, and normally require additional a priori
information.
      </p>
    </sec>
    <sec id="sec-2">
      <title>The research part</title>
      <p>
        Let us consider the possibility of usage of generalized method of least absolute
values (GMLAV) for non-linear filtering of images and signals [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        To simplify this, we describe data smoothing with regard to signals filtering. Let us
assume a non-stationary series of observations {x1, x2 ,...}. A fundamental case of
non-stationary process xk = a +ξ k is overfall, where a is wanted signal, ξ k – random
component. In terms of data smoothing this is the study of moving filter behavior on
the boundary. Behavior of moving median has been studied in many works.
Therefore, let us comparatively analyze the statistic performance of moving median and
GMLAV-estimators. The study will be made as per typical “overfall+noise” model
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
…, x0,…, x3, x4 + h,…, x7 + h,… ,
(1)
where xk ~ (1 −γ )N(0,σ 2 ) +γN(µ ,σ 12 ), 0 ≤ γ &lt; 1 . Assume overfall value as (1) for
certainty, as in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], h = 5 , and moving filter aperture as L = 2m + 1 = 5 . In this case
moving median for any number of k equals to
y LD = med{xk−m ,…, xk+m}= med{xk−2 ,…, xk+2}.
      </p>
      <p>k
Moving GMLAV-estimator of mean value appears as
ykGLD = arg main ∑
m 2
−mρ ( xk+i − a )= argamin ∑i=−2ρ ( xk+i − a ),
where ρ is a monotone increasing function twice continuously differentiable on the
positive half-line, with ρ (0) = 0 and ρ ʹʹ′′( x) &lt; 0 for any x &gt; 0. Let's give examples of
0 &lt; α &lt; 1 ;
ρ(x) = ln( x +1);
ρ(x) = 1− e− x ;
ρ(x) = x ( x +1);
such loss functions:</p>
      <p>ρ(x) = x α ,
ρ(x) = arctan( x ).</p>
      <p>For certainty, let us be confined to the cases of normal distribution of random
errors and symmetrical runouts. It is evident that ∀k E[xk ] = 0 . Therefore, “ideally”, at
output the sequence shall be: … , y3 = 0, y4 = 0, y5 = 5, y6 = 5, …. Estimators of
mathematical expectation (yk) and standard deviation (syk) of mean value, median and
GMLAV-statistics on sequence “boundary+noise” (1) are given in Tables 1 and 2.
0,998
0,273
0,255
1 − e− x
0,083
x ( x +1) arctan( x )
0,114</p>
      <p>0,113</p>
      <p>Estimations were performed with Monte-Carlo method for the number of
statistical tests M = 400000 . Estimators of mathematical expectation are displayed on
Figure 1: mean value (line 1), median (line 2), GMLAV-estimator with ρ ( x) = arctan x
(line 3), and of input process at overfall (line 4) for xk ~ N (0,1) .</p>
      <p>The analysis was performed near boundary ( 2 ≤ k ≤ 5 ), since with k &lt; 2 and
k &gt; 5 mathematical expectation of all moving estimators will coincide and be
unbiased. The results of the study make evident that smoothing based on
GMLAVestimators leads to less diffusion of wanted signal at overfall, as compared to median
smoothing. Similar results were obtained for asymmetrical contamination.</p>
      <p>We observe that there is a possibility of increasing the rate of Gaussian noise
suppression while maintaining the same efficiency for impulsive disturbance. This is
achieved by using convex-concave loss functions of type:
ρ ( x) = ln( x 1+δ + 1) ,
ρ ( x) = arctg( x 1+δ ) , δ &gt; 0 .</p>
      <p>ρ ( x) = 1 − exp(− x 1+δ ) ,
ρ ( x) = [ x /( x +1)]1+δ ,</p>
      <p>Implementation of moving GMLAV-smoothing is not much more complex than
median smoothing. Actually, in this case we do not need to resolve linear equation
systems to find nodal points since they are represented by values of input process
inside moving data window, namely xk −m ,…, xk +m . The task is reduced to their
simple sorting, which may be simplified by using recurrent algorithms.</p>
      <p>Moving GMLAV-smoothing process can be applied for suppression of noise in the
shape of overshoots, and for smoothing non-steady processes. However, joint analysis
of smoothed and noise components has independent significance.</p>
      <p>
        Let us compare two methods of smoothing. We distort a photograph of the Moon
with impulse noise of 74% density. Then we process the noisy photograph (Fig. 2a)
by applying two-dimensional median filter (Fig. 2b), and then by Generalized Method
of Least Absolute Values (Fig. 2c), using the same aperture-cross and same number of
times.
ty [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
      </p>
      <p>W = 20lg
255
s
where s is recovery mean-square error calculated by the formula
s =
1 N ⌢</p>
      <p>∑( fi − fi )2 ,</p>
      <p>N i=1
N is number of pixels in the image, f ( x, y) is initial (without additive noise) image,
⌢
f ( x, y) is recovered image.</p>
      <p>For median filter we obtained WLD = 12.86 dB, at that not only noise pixels
remained, but also the filter has modified the pixels of the initial image. When
processed with GMLAV-filter, we obtained WGLD = 38.67 dB. These results represent
higher stability of Generalized Method of Least Absolute Values against impulse
interference, as well as its efficiency with regard to noise suppression of high-contrast
images.</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusions</title>
      <p>Thus, it is possible to draw the following conclusions:
1. Generalized Method of Least Absolute Values is more efficient than median
methods of image processing in case of impulse interference, as well as when
suppressing noise interference on high-contrast images.</p>
      <p>2. Workload in case of data smoothing based on Generalized Method of Least
Absolute Values is comparable with the volume of calculations of median filter.
Аннотация. Целью статьи является анализ применения сглаживания на
основе обобщенного метода наименьших модулей. В ходе исследования
было выявлено, что предложенный метод сглаживания приводит к
меньшему растеканию полезного сигнала при наличии импульсных помех, а
также при подавлении шумовых помех на контрастных изображениях.
Трудоемкость реализации сглаживания данных на основе обобщенного
метода наименьших модулей соизмерима с вычислительными затратами
медианного фильтра.
Ключевые слова. Нелинейная фильтрация, изображение, сигнал, метод
наименьших модулей, помеха, подавление помех.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Tukey</surname>
            <given-names>JW</given-names>
          </string-name>
          (
          <year>1961</year>
          )
          <article-title>Discussion emphasizing the connection between analysis of variance and</article-title>
          spectrum analysis // Technometrics, V.
          <fpage>3</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Huang</surname>
            <given-names>TS</given-names>
          </string-name>
          , Ed (
          <year>1981</year>
          )
          <string-name>
            <surname>Two-Dimensional Digital Signal Processing</surname>
            <given-names>II</given-names>
          </string-name>
          : Transforms and
          <string-name>
            <given-names>Median</given-names>
            <surname>Filters</surname>
          </string-name>
          . Berlin: Springer-Verlag
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Abreu</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lightstone</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mitra</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arakawa</surname>
            <given-names>K</given-names>
          </string-name>
          (
          <year>1996</year>
          )
          <article-title>A new efficient approach for the removal of impulse noise from highly corrupted images /</article-title>
          / IEEE Trans, on Image Processing, V.
          <fpage>5</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Chan</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ho</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nikolova</surname>
            <given-names>M</given-names>
          </string-name>
          (
          <year>2004</year>
          )
          <article-title>Convergence of Newton's Method for a Minimization Problem in Impulse Noise Removal /</article-title>
          / J. Comput. Math, V.
          <fpage>2</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Schulte</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nachtegael</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Witte</surname>
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Van der Weken</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kerre</surname>
            <given-names>E</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>A fuzzy impulse noise detection</article-title>
          and reduction method // IEEE Trans,
          <article-title>on image processing</article-title>
          , V.
          <fpage>15</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Tyrsin</surname>
            <given-names>AN</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Robust construction of regression models based on the generalized least absolute deviations method /</article-title>
          / Journal of Mathematical Sciences,
          <string-name>
            <surname>V.</surname>
          </string-name>
          <year>328</year>
          .(In Russian)
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bukhtoyarov</surname>
            <given-names>SS</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Priorov</surname>
            <given-names>AL</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Apalkov</surname>
            <given-names>IV</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khryashchev</surname>
            <given-names>VV</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Application switching median filters for the restoration of noisy images. - Questions of radio electronics: Series all-technical, V.2</article-title>
          . (In Russian)
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>