<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualization of the movements of natural objects based on remote sensing data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aleksey A. Buchnev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Aleksandr V. Getling</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vladimir A. Krovotyntsev</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Valery P. Pyatkin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Computational Mathematics and Mathematical Geophysics SB RAS</institution>
          ,
          <addr-line>Novosibirsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Research Center “Planeta”</institution>
          ,
          <addr-line>Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University</institution>
          ,
          <addr-line>Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>32</fpage>
      <lpage>38</lpage>
      <abstract>
        <p>Methods of constructing vector fields of natural objects' movements based on a series of consecutive satellite images are considered: cloud formations in the atmosphere based on a series of consecutive images obtained from geostationary satellites; water masses and ice fields based on a series of images from low-orbit satellites; using the example of the evolution of bipolar spots, the trajectories of trial corks in the Solar photosphere are constructed based on the data of sounders installed on heliophysical satellite observatories.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Natural objects</kwd>
        <kwd>cloud formation</kwd>
        <kwd>standard</kwd>
        <kwd>water masses</kwd>
        <kwd>ice fields</kwd>
        <kwd>Delaunay triangulation</kwd>
        <kwd>trial corks</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>(  − 1)</p>
      <p>(1)
Here  — the average value of pixels in the standard ,  — the average value of the image
elements  in the area covered by the reference. The denominator in (1) uses the product of the
standard deviation   of the pixels of the standard  by the standard deviation   of the pixels
of the image  in the area covered by the reference.</p>
      <p>
        In general, the size and orientation of the standard object found in the next image of a series
of images may have diferent values in the subsequent image. The expression (1) normalized
with respect to changes in amplitudes is not the same with respect to rotation or changes
in the size (scaling) of the standard. In [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] it is noted that “Normalization with respect to
dimensions is associated with spatial scaling, which in itself is associated with very
timeconsuming calculations. Normalization with respect to rotation is an even more dificult task...”.
Sometimes, to solve the problem of matching (combining) images, taking into account the
scaling and rotation of the standard, less accurate criteria are used in comparison with (1), but
simpler from a computational point of view (for example, in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and a number of other works,
the sum of the absolute values of the diferences of the corresponding image components is
used).
      </p>
      <p>
        According to [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], the search for the positions of the found standards (determination of ofsets)
in the next image of the series can be implemented by one of three methods: determining the
maximum of the cross-correlation coeficient in the spatial domain, determining the maximum
of the cross-correlation coeficient in the frequency domain based on the fast Fourier transform,
and finding the minimum of the sum of the squares of distances. The mentioned source also
does not assume any standard transformations when searching for ofsets, with the exception
of the transfer transformation.
      </p>
      <p>In the presented work, the standard displacements are determined on the basis of determining
the maximum of the cross-correlation coeficient in the spatial domain in accordance with the
formula (1). In this case, the standard can be transformed, consisting of scaling, rotation and
transfer. An eficient algorithm based on the scanning rows method has been developed. The
obtained results of computational experiments on images from the METEOSAT-8 spacecraft
indicate both the need to take into account the scaling and rotation of the standard, and the
acceptable time of the corresponding calculations. Level 1B data (10-bit pixels) is used.</p>
      <p>The solution of the problem consists of the following basic steps: search square standard
objects in the current image  , based on achieving the maximum contrast or maximum entropy;
the center of the standard coincides with the center of the square; search for the positions of
the found standard in the subsequent image  , based on the achievement of the maximum
value of the cross-correlation coeficient; plotting vector fields of spatial movements of objects
in accordance with the found positions.</p>
      <p>
        Search for standards. The search for standards is based on the methodology proposed by
EUMETSAT [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. According to this methodology, two types of standards are provided: main
and secondary. The positions of the main standards coincide with the ends of the displacement
vectors of the standards from the previous image (there are no main standards for the first
image).
      </p>
      <p>The search for secondary standard of the Targ_Size size is performed in the grid nodes with
the Grid_Size size. The size of the square area centered at the grid nodes for searching for
standards is set by the Targ_Search parameter. The allowed minimum distance between the
standards is controlled by the Targ_Dist parameter. The optimal position for the standard within
the search area is the one where the maximum value of the control parameter Par — contrast or
entropy is reached. When searching for standards within a region of the Targ_Search size, local
averages and standard deviations calculated from the 3 × 3 neighborhood are used. Contrast is
defined as the diference between the maximum and minimum values of the local averages. In
addition to the listed parameters that determine the “physical” characteristics, when searching
for standards, the parameters that characterize the “variability” of the image inside the area
covered by the standard are used: Min_St_Dev — the minimum value of the local standard
deviation, Num_Gr_SD — the minimum number of pixels with a standard deviation greater than
Min_St_Dev.</p>
      <p>Determination of standard ofsets. The ofset is determined for each of the K_Targs found
benchmarks. The search for a new standard position is performed inside a square area of
the Search_Size size. The center of the search area coincides with the original position of the
standard. The new position of the standard is the position where the maximum value of the
cross-correlation coeficient Corr is reached. During the scan of the search area, the standard is
subjected to scaling and rotation transformations. The scale and angle of rotation of the standard
are determined by the following parameters: Scale_Min — the minimum value of the scale of
the standard; Scale_Max — the maximum value of the scale of the standard; Scale_Delta — the
increment of the scale of the standard; Angle_Beg — the initial angle of rotation of the standard
in degrees; Angle_End — the final angle of rotation of the standard in degrees; Angle_Delta — the
increment of the angle of rotation of the standard in degrees. Since, in general, the transformed
discrete grid of the reference does not coincide with the discrete grid of the output image, it
becomes necessary to interpolate the pixel values. We ofer three ways to get the pixel values
of the transformed standard: rounding to the nearest integer; bilinear interpolation; bicubic
interpolation.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Movement of water masses and ice fields</title>
      <p>One of the important uses of satellite data is the monitoring the movement of water pollution
and ice fields in marine areas.</p>
      <p>
        The problem of constructing the fields of propagation of marine pollution from
diferenttime satellite data is closely related to the problem of determining the speed and direction of
vectors of spatial movements of water masses [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Satellite information of the visible, infrared,
or microwave (radar data) ranges is used as the initial data in the problem. The method of
constructing the fields of spatial movements of water masses based on identifiable changes in
some water objects (tracers) on successive satellite images transformed into a single cartographic
projection is used. As tracers in optical range images water bodies formed as a result of water
blooming (linear and vortex structures of phytoplankton and algae distribution) are used. For
infrared images, linear and vortex thermal structures are mainly used as tracers, while for radar
images, oil films and films of biogenic pollutants are used.
      </p>
      <p>A similar approach is used in monitoring the spatial movements of ice fields. Here, mosaics,
made up of radar satellite images transformed into the same cartographic basis, are mainly used
(images of the Arctic Ocean are most often used, because of their importance for the purposes
of meteorology and ships navigation).</p>
      <p>The process of entering the coordinates of tracer objects consists in specifying their position
on the current and next images and saving the entered coordinates in a file that will be used in
the final stage of processing and saved for further use.</p>
      <p>At the same time, satellite images are pre-made to “fix” the contours of the coastline using
reference points, and, thus, on the maps of the distribution of the fields of spatial movements of
natural objects, the stationary land is separated from the moving objects.</p>
      <p>The Delaunay triangulation is constructed based on the entered coordinates of the objects in
the current image. Each triangle of the triangulation corresponds to a triangle in the following
image. Such a set of pairs of triangles determined the set of piecewise afine transformations
of the plane. These transformations are applied to the nodes of the regular grid in the current
image, thereby forming the required displacement vectors.</p>
      <p>Simultaneously with the construction of the vector fields of spatial displacements of
water masses and ice fields, histograms of the velocities and directions of these vectors can be
constructed.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Evolution of bipolar spots in the Solar photosphere</title>
      <p>Theoretically, the technologies for constructing displacement fields of natural objects presented
in paragraphs 1 and 2 can be applied to image sequences of any length. However, in the practice
of constructing operational hydrometeorological forecasts, for which these technologies were
developed, no more than 3–4 images are mainly used. Interactive versions of the corresponding
programs are used for this purpose.</p>
      <p>
        But in the processing of data obtained from heliophysical satellite platforms, there is a need
to process a series of consecutive images with a length of 100 or more frames. An example is the
image of a bipolar group of spots shown in Figure 5. We use here data from the Helioseismic and
Magnetic Imager of the Solar Dynamics Observatory (NASA, USA). The goal of processing from
the point of view of visualization is to build a field of horizontal velocities of the so-called “trial
corks”, which at the initial moment are located in the nodes of a regular rectangular grid. As
the process progresses, it is necessary to track the trajectory of each trial cork. We considered
a series of images of diferent duration from 2 to 4 hours with an interval of 135 s. between
frames [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        For this purpose, we used a console program [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], which includes the technology of claim 1
and a modified version of the technology of claim 2. The processing parameters are located in a
text file, which is a program parameter. For each pair of adjacent images, you must: 1) in the first
image, find the standards in accordance with claim 1; 2) find the positions of these standards in
the second image by correlation comparison (claim 1); 3) in the first image, build a Delaunay
triangulation based on the found positions of the standards; 4) from the obtained triangles of
triangulation and the corresponding triangles in the second image, build a set of piecewise
afine transformations; 5) for each trial cork, determine its new position by applying a suitable
afine transformation. The final stage of processing is the plotting of trial corks trajectories
(Fig. 6).
      </p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgments</title>
      <p>The research was partially carried out within the framework of the state task of the ICM&amp;MG
SB RAS 0251-2021-0003.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Jähne</surname>
            <given-names>B.</given-names>
          </string-name>
          <article-title>Digital image processing</article-title>
          . Berlin: Springer,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Gonzalez</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Woods</surname>
            <given-names>R</given-names>
          </string-name>
          .
          <article-title>Digital image processing</article-title>
          .
          <source>Trans. from English</source>
          . Edited by
          <string-name>
            <given-names>P.A.</given-names>
            <surname>Chochia</surname>
          </string-name>
          . Moscow: Technosphere,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Zabelin</surname>
            <given-names>V.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pyatkin</surname>
            <given-names>V.P.</given-names>
          </string-name>
          <article-title>Identification of control points in aerospace images //</article-title>
          <source>In: Mathematical and Technical Problems of Image Processing. CC SB of the USSR Academy of Sciences. Novosibirsk</source>
          ,
          <year>1980</year>
          . P.
          <volume>50</volume>
          -
          <fpage>59</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <article-title>[4] MSG meteorological products extraction facility</article-title>
          . Algorithm specification document // Doc. No. EUM/MSG/SPE/022.
          <year>2004</year>
          . Is.
          <volume>2</volume>
          .6.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Asmus</surname>
            <given-names>V.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buchnev</surname>
            <given-names>A.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krovotyntsev</surname>
            <given-names>V.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pyatkin</surname>
            <given-names>V.P.</given-names>
          </string-name>
          <article-title>Software complex in the tasks of space monitoring of dangerous hydrometeorological phenomena</article-title>
          // Problems of Informatics.
          <year>2018</year>
          . No.
          <volume>4</volume>
          (
          <issue>41</issue>
          ). P.
          <volume>34</volume>
          -
          <fpage>49</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Getling</surname>
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buchnev</surname>
            <given-names>A.A.</given-names>
          </string-name>
          <article-title>The origin and early evolution of a bipolar magnetic region in the solar</article-title>
          photosphere // Astrophysical Journal.
          <year>2019</year>
          . Vol.
          <volume>871</volume>
          . No. 2. P.
          <volume>224</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Getling</surname>
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buchnev</surname>
            <given-names>A.A.</given-names>
          </string-name>
          <article-title>Some structural features of the convective-velocity field in the solar</article-title>
          photosphere // Astronomical Reports.
          <year>2010</year>
          . Vol.
          <volume>54</volume>
          . P.
          <volume>254</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>