<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Comparative Study of Restoration Techniques for Images Defined by Chaotically Scattered Point Set</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aleksey Maksimov</string-name>
          <email>aleksei.maksimov.ssau@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>A. Restoration quality</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Geoinformatics and Information Security Samara National Research University Samara</institution>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Fig. 1. Test images of the Waterloo Greyscale Set 2</institution>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Yuliya Vybornova Department of Geoinformatics and Information Security Samara National Research University Samara</institution>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>141</fpage>
      <lpage>144</lpage>
      <abstract>
        <p>-Fast interpolation algorithms suggest that the value at a particular element of the image is calculated based on some neighborhood, the choice of which can significantly affect the interpolation result. In this paper, we investigate how the choice of reference image elements affects the quality of interpolation methods. Three classical interpolation methods (Linear, Nearest Neighbor, and Cubic) as well as two wellknown spatial interpolation methods (Inverse Distance Weighting and Akima) are considered. Results of the experimental research, such as the dependencies of RMSE on the noise proportion in test images, are presented, as well as computational complexity assessment.</p>
      </abstract>
      <kwd-group>
        <kwd>Comparative Study</kwd>
        <kwd>Low-Level Processing</kwd>
        <kwd>Filtering</kwd>
        <kwd>Still Images</kwd>
        <kwd>Image Restoration</kwd>
        <kwd>Interpolation</kwd>
        <kwd>Delaunay Triangulation</kwd>
        <kwd>Morton Curve</kwd>
        <kwd>Hilbert-Peano Scan</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        One of the problems of image processing consists in
predicting the values of raster cells given a certain limited
number of input points on a two-dimensional grid. To solve
this task interpolation methods are usually used [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>Today, there are various interpolation methods, which
can be divided into two classes: deterministic and statistical.
The the deterministic methods are constructed on the basis
of some distance (or area) function. The main advantage of
such methods is the high processing speed. The statistical
methods are based on the function of statistical spatial
similarity. Their main advantage is sensitivity to
multidirectional data. Therefore, such methods are mostly
used to interpolate various kinds of surfaces.</p>
      <p>Fast interpolation algorithms suggest that the value at a
certain location on the image is predicted using several
nearest points, instead of the entire set of known values.
Thus, in this paper, a comparative analysis of existing
interpolation methods is given, taking into account the
choice of a specific algorithm for the construction of a
reference point set.</p>
    </sec>
    <sec id="sec-2">
      <title>II. METHODS UNDER INVESTIGATION</title>
      <p>In this paper, we study 17 methods of image
reconstruction using a randomly scattered set of points.</p>
      <p>
        Three classical interpolation methods (Linear [2],
Nearest Neighbor [2], Cubic [2]) are compared with two
well-known spatial interpolation methods: Inverse Distance
Weighting (IDW) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and Akima [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        For classical interpolation methods, the order of
reference points is specified either by transition to a 1-D
signal, or via 2-D triangulated irregular network. The
transition to the 1-D signal is carried out based on
progressive and zigzag scan [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], as well as Morton [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and
Hilbert-Peano [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] curves. The triangular partition is
constructed using the Delaunay triangulation [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>The experimental study was carried out as follows. A
mask was applied to the test image, after which the image
with punctured samples was interpolated by one of the
selected methods. After, the RMSE of the interpolation was
calculated relative to the original image.</p>
      <p>The results are averaged over the test set for a fixed
fraction of reference points, the interpolation method, and the
method of reference point set construction. The results of this
experimental study are presented in Fig. 3 and Fig. 4.</p>
      <p>Also, for the IDW method, the dependences of the MSE
on the noise fraction were studied for various settings of the
algorithm: with a constant power p and a variable radius r,
and with a constant radius r and a variable power p. The
dependencies are shown in the Fig. 5.</p>
      <p>The examples of some restored images for the same
fraction of reference points are presented in Fig. 6. The final
dependencies are presented in Fig. 7.</p>
      <p>As can be seen from the presented results, in the case of
the one-dimensional methods for construction of the
reference point set, the use of the Hilbert-Peano curve
provides the smallest MSE for the nearest neighbor, linear
and cubic interpolation, and also when using the Akima
method. However, the use of the Hilbert-Peano curve still
shows the greater error than the use of a two-dimensional
partition based on the Delaunay triangulation. As for the
interpolation methods, a significant advantage in terms of the
mean square error of restoration can be obtained when using
the Inverse Distance Weighting method.
B. Computational Complexity</p>
      <p>The analysis of the computational complexity of the
investigated methods is performed. The parameters of the
computing machine are shown in Table I. The graphic
accelerator was not used during the experimental study. The
average processing time for one image of the test set is
shown in Table II.</p>
      <p>As can be seen from Table II and Fig. 7, the Inverse
Distance Weighting method provides the smallest mean
square error but requires much longer processing time
compared to all other methods (this case is denoted in bold).
A compromise solution providing both an acceptable image
restoration quality and average processing time can be
obtained by constructing a set of reference points using
Delaunay triangulation and predicting the missing values
using the linear or cubic interpolation (italicized in Table II
and denoted in red and light green in Fig. 7). It is shown that,
these methods give similar values of MSE and processing
time.</p>
    </sec>
    <sec id="sec-3">
      <title>IV. CONCLUSION</title>
      <p>This paper is aimed at solving the problem of restoration
of images defined by a set of randomly scattered points. We
investigate five widely known interpolation methods: three
classical (the nearest neighbor, linear and cubic), the Inverse
Distance Weighting method, and Akima, which are
implemented using various methods for construction of the
reference point set.</p>
      <p>For the classical methods and the Akima method, the
dependences of the Mean Square Error (MSE) on the
fraction of reference points are estimated using various
techniques of the reference point set construction. Similar
dependencies are calculated for the IDW method performed
for various parameters of radius and power. In addition, the
performance of investigated methods is evaluated.</p>
      <p>The IDW method demonstrates the lowest MSE and the
highest average processing time. For classical methods, the
lowest MSE is achieved when using Triangulated Irregular
Network.</p>
    </sec>
    <sec id="sec-4">
      <title>ACKNOWLEDGMENT</title>
      <p>The reported study was funded by RFBR (Russian
Foundation for Basic Research): projects № 19-07-00474,
№ 19-31-90113, № 19-29-09045.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Y.D.</given-names>
            <surname>Vybornova</surname>
          </string-name>
          , “
          <article-title>Application of spatial interpolation methods for restoration of partially defined images</article-title>
          ,
          <source>” CEUR Workshop Proceedings</source>
          , vol.
          <volume>2210</volume>
          , pp.
          <fpage>89</fpage>
          -
          <lpage>95</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>M.V.</given-names>
            <surname>Gashnikov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.I.</given-names>
            <surname>Glumov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.V.</given-names>
            <surname>Kuznetsov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.A.</given-names>
            <surname>Mitekin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.V.</given-names>
            <surname>Myasnikov</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.V.</given-names>
            <surname>Sergeev</surname>
          </string-name>
          , “
          <article-title>Hyperspectral remote sensing data compression and protection</article-title>
          ,”
          <source>Computer Optics</source>
          , vol.
          <volume>40</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>689</fpage>
          -
          <lpage>712</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>2412</fpage>
          -6179-2016-40-5-
          <fpage>689</fpage>
          -712.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Shepard</surname>
          </string-name>
          , “
          <article-title>A two-dimensional interpolation function for irregularly-spaced data</article-title>
          ,
          <source>” ACM: Proceedings of the 23rd ACM national conference</source>
          , pp.
          <fpage>517</fpage>
          -
          <lpage>524</lpage>
          ,
          <year>1968</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>H.</given-names>
            <surname>Akima</surname>
          </string-name>
          , “
          <article-title>A new method of interpolation and smooth curve fitting based on local procedures</article-title>
          ,
          <source>” Journal of the ACM (JACM)</source>
          ,
          <year>1970</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R.</given-names>
            <surname>Candra</surname>
          </string-name>
          , “
          <article-title>The Implementation of an Efficient Zigzag Scan</article-title>
          ,
          <source>” Journal of Telecommunication, Electronic and Computer Engineering</source>
          , vol.
          <volume>9</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>95</fpage>
          -
          <lpage>98</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Jin</surname>
          </string-name>
          , “
          <article-title>SFCGen: A framework for efficient generation of multidimensional space-filling curves by recursion</article-title>
          ,
          <source>” ACM Transactions on Mathematical Software</source>
          , vol.
          <volume>31</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>120</fpage>
          -
          <lpage>148</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>V.V.</given-names>
            <surname>Sergeev</surname>
          </string-name>
          , “
          <string-name>
            <surname>Image Processing Using Hilbert-Peano</surname>
            <given-names>Scanning</given-names>
          </string-name>
          ,” Optoelectronics,
          <source>Instrumentation and Data Processing</source>
          , vol.
          <volume>2</volume>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>34</lpage>
          ,
          <year>1984</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>B.</given-names>
            <surname>Zalik</surname>
          </string-name>
          , “
          <article-title>An efficient sweep-line Delaunay triangulation algorithm,” Computer-Aided Design</article-title>
          , vol.
          <volume>37</volume>
          , pp.
          <fpage>1027</fpage>
          -
          <lpage>1038</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Greyscale</given-names>
            <surname>Set</surname>
          </string-name>
          <article-title>2</article-title>
          .
          <source>The Waterloo Fractal Coding and Analysis Group: Image Repository</source>
          ,
          <year>2009</year>
          [Online]. URL: http:// links.uwaterloo.ca/Repository.html.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>