<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A research of classification algorithm of spatial information on the basis of methods of persistent homology and random forest</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>S V Eremeev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>K V Kuptsov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yu A Kovalev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Vladimir State University named after Alexander and Nikolay Stoletovs</institution>
          ,
          <addr-line>Gorky street 87, Vladimir, Russia, 600000</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>165</fpage>
      <lpage>171</lpage>
      <abstract>
        <p>The classification problem of spatial data is one of the most difficult challenges in the field of the analysis and processing of spatial information. A new approach to a solution of the classification problem of spatial data is presented in article. The offered classification technology of objects will be based on algebraic topology, namely on methods of persistent homology. A barcode is a qualifier of a spatial object. It is determined by computation of topological features of a classified object. The distinctive feature of the offered algorithm is its invariance to affine and topological transformations. The research on results of classification algorithm operation on a set of spatial objects of different classes is carried out.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Automatic digitization of maps is one of global problems in geographic information systems [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ].
Questions of identification [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and classification of cartographical information appear within this
problem. The problem of classification of spatial data on object classes is one of the most difficult in
the field of the analysis and processing of spatial information. Russian and world researchers try to
solve this problem and propose a set of application-oriented solutions. Having studied scientific works
on this subject it is possible to tell that they solve a problem of object classification with various
degree of efficiency. There are different methods of classification of spatial objects.
      </p>
      <p>
        The method intended for work with topographic maps of average scale is presented in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].The main
application is a classification of the area of objects under construction. The method is based on
geometrical structures of data and spatial analytical methods. Advantage is improvement of quality of
automation of cards with areas of objects under construction.
      </p>
      <p>
        The problem of classification of spatial data is also relevant for control of information on
exhaustion of reservoirs or, on the contrary, – about their degradation [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The technology is applied to
spatial objects which have similar spectral features, but various form. The algorithm is realized for
classification of reservoirs on Alaska and also is used in Bolivia for classification of pastures.
      </p>
      <p>
        The analysis of the image is applied in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] together with network methods of extraction of
information within a problem of creation of digital tourist maps. The algorithm classifies spatial
objects according to the developed rules of simplification and generalization of maps to emphasize
reference points and to reduce a role of less significant objects. The technology is applied to creation
of tourist maps of San Francisco.
      </p>
      <p>
        Processing of satellite images or images with high resolution is made in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] for classification of the
objects which are contained in them. A classification is made for the main classes of objects which are
presented on topographic maps of large scale.
      </p>
      <p>
        An approach using the example of digitizing distribution maps taken from plant-taxonomic atlases
is described in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. In result, plant distributions over Europe and Asia have been digitized. The
algorithm is a tool to capture data from maps based on obscure projections.
      </p>
      <p>
        The purpose of work is creation of an algorithm for classification of cartographical information
which will make high-quality object classification of various spatial classes and also is invariant [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
to affine transformations and changes of scale.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. A classification algorithm of spatial data on the basis of methods of a persistent homology and random forest</title>
      <p>The offered algorithm of classification of objects is based on algebraic topology, namely by methods
of persistent homology. Application of topological characteristics and their analysis is new area of
theoretical researches for tasks of the analysis and processing of spatial information. Information from
aircraft is processed and analyzed. The allocated objects are distributed on spatial classes in
accordance with the classification of spatial information.</p>
      <p>A barcode is taken as the qualifier of a class of a spatial object. It is formed by calculation of
topological features of the classified object. Set of values of color intensity of all object points is
created. Sorting of this set of values according to increase is made. Search of vertices of some
intensity is run step by step. It is noted in the list of vertices when finding such point. If this vertice
appeared in the neighborhood of Moore of already noted point, then they are connected a line. The
triangle is formed at emergence of three such vertices. The number of components (vertices, lines and
triangles) at such approach can change on each step of an algorithm. Emergence of vertice adds a
component. Emergence of the line connecting different components leads to disappearance of
component (two components unite in one). Pass in reversed sequence (on decrease) is the following
stage of an algorithm. At the same time the number of holes and their existence time is counted. The
hole is formed at emergence of a triangle. The filtration list for holes turns out depending on
emergence of new components, their association and other operations. Search of the maximum
number of holes and lines is made by the following step. Barcode of the image of an object is
calculated on the basis of these numbers (fig. 1).</p>
      <p>(a) (b)
Figure 1. Barcodes: (a) – the car and (b) – the P-shaped building. The quantity of holes and intensity
of points on the color model RGB are displayed on axis X and on axis Y.</p>
      <p>
        A belonging of object to a spatial class is defined by comparing of barcodes of two objects.
Previously training on images of objects of differrent classes is made (fig. 2, a). Comparing represents
check of inclusion of Bettie numbers (the maximum numbers of holes and lines of the image of an
object) in the range which characterizes objects of a spatial class (fig.3). The algorithm is
complemented with the random forest method [
        <xref ref-type="bibr" rid="ref11 ref12 ref13">11-13</xref>
        ] for optimization of work of an algorithm on
time. It allows to improve speed of an algorithm. The decision tree is formed on the basis of this
distribution (fig. 2, b).It is result of work of algorithm.
      </p>
      <p>
        The random forest model is applied on the basis of values of Bettie numbers which are taken as
features. Random forest is the algorithm consisting of a set of decisive trees. It has been offered by
Leo Breiman and Adele Cutler [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The algorithm is implemented according to the following scheme.
1. Receiving subselection of the training model. Taking of selection of the training row happens at
this stage. The tree is building on its basis.
      </p>
      <p>Basic algorithms have to be unique. Each tree is formed on the training selection for this purpose.</p>
      <p>There is an element of randomness at the choice of splittings.</p>
      <p>The more trees, the quality is better. But time of control and work of Random forest increase in
proportion.
2. Viewing of set of random features. It is made for realization of splitting of each branch of a tree.
If the number of features for splitting increases, then time of creation of the forest increases, and
trees become "more monotonous".
3. Choice of the best feature and of branch of a tree. Creation of trees is made until disappearance
of elements from selection.</p>
      <p>Creation of Random forest in direct ratio to selection depth. The selection is deeper, the algorithm
is longer executed. The quality on training sharply increases at increase in selection depth. But it
usually increases on control selection.</p>
      <p>It is recommended to use the maximum depth of trees at realization of this algorithm. Change of
the parameters connected with restriction of number of objects doesn't result in significant effect
when using superficial trees. Each feature has different degree of importance therefore a part of
features can not bear advantages.</p>
    </sec>
    <sec id="sec-3">
      <title>3. A research of work of classification algorithm on real spatial objects</title>
      <p>The research of the offered algorithm is carried out. Testing of spatial information on the basis of
images from aircraft from some height is executed. Classes of spatial objects such as vehicles and
buildings are considered. The detailing is made on each class. Vehicles such ascars (are presented on
fig.4,a-f), light commercial vehicles and minibuses(fig.4,g-j), buses (fig.4,k-l) are considered.
Rectangular, G-shaped, P-shaped, private types of buildings are presented (fig.5).The quantity of the
training and test selections in the sum is equal 100 images of objects.</p>
      <p>(a)
(d)
(g)
(j) (k) (l)
Figure 4. Spatial class of objects "Vehicles". (a-f) – cars; (g-j) – light commercial vehicles and
minibuses; (k-l) – buses.
(c) (d)
Figure 5. Spatial class of objects of "Building". (a) – rectangular; (b) – G-shaped; (c) – P-shaped; (d)
– private houses.</p>
      <p>Algorithm is invariant to affine transformations. Therefore tests with the different angles of
shooting are carried out for the offered types of an object (90˚,180˚,270˚, 360˚– fig.6). Research results
of invariancy of an algorithm to affine transformations are presented in table 2.</p>
      <p>Object class
Vehicles</p>
      <p>Also an algorithm is invariant to scale. Therefore tests in images of the same area of different
scales are carried out (table 3). The algorithm hasn't made mistake for two subclasses of vehicles
(from three) and for two subclasses of buildings (from four).</p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>Existing approaches of classification of spatial data are considered in article. New approach of
realization of an classification algorithm on the basis of topological characteristics of the image is
offered. At the heart of an algorithm methods of a persistent homology and the Random Forest method
are put. Results of researches have shown expediency of application of the developed classification
algorithm of spatial information as it invariant to affine transformations and changes of scale.</p>
      <p>A deformation (distortion) of source data is one of problems of map object classification. A
stretching of images of spatial objects is one of types of deformation.The solution of this problem is
important within the solution of a problem of classification of spatial information and automatic
digitization of maps.Algorithm modernization in the sphere of processing of spatial data with
deformations of various types is the following step in improvement of work of the offered algorithm.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgment</title>
      <p>The reported study was funded by RFBR and Vladimir region according to the research project №
1747-330387. The reported study was funded by Vladimir region according to the research project №
326 of 29.09.2017.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Andrianov</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eremeev</surname>
            <given-names>S</given-names>
          </string-name>
          and
          <article-title>Kuptsov K 2017 Identification of spatial objects on digital maps</article-title>
          <source>CEUR Workshop Proceedings</source>
          <volume>1940</volume>
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Shekhar</surname>
            <given-names>S</given-names>
          </string-name>
          and
          <string-name>
            <surname>Xiong</surname>
            <given-names>H</given-names>
          </string-name>
          <source>2008 Digitization of Maps Encyclopedia of GIS</source>
          (Springer, Boston, MA)
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Fursov</surname>
            <given-names>V A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goshin Ye</surname>
            <given-names>V</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kotov A P 2016</surname>
          </string-name>
          <article-title>The hybrid CPU/GPU implementation of the computational procedure for digital terrain models generation from satellite images</article-title>
          <source>Computer Optics</source>
          <volume>40</volume>
          (
          <issue>5</issue>
          )
          <fpage>721</fpage>
          -
          <lpage>728</lpage>
          DOI: 10.18287/
          <fpage>2412</fpage>
          -6179-2016-40-5-
          <fpage>721</fpage>
          -728
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Vizilter</surname>
            <given-names>Y V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gorbatsevich</surname>
            <given-names>V S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vorotnikov</surname>
            <given-names>A V</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kostromov</surname>
            <given-names>N A</given-names>
          </string-name>
          <year>2017</year>
          <article-title>Real-time face identification VIA CNN and boosted hashing forest</article-title>
          <source>Computer Optics</source>
          <volume>41</volume>
          (
          <issue>2</issue>
          )
          <fpage>254</fpage>
          -
          <lpage>265</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Basaraner</surname>
            <given-names>M</given-names>
          </string-name>
          and
          <string-name>
            <surname>Selcuk M 2008</surname>
          </string-name>
          <article-title>A structure recognition technique in contextual generalisation of buildings and built-up areas</article-title>
          <source>Cartographic Journal</source>
          <volume>45</volume>
          (
          <issue>4</issue>
          )
          <fpage>274</fpage>
          -
          <lpage>285</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Frohn R C 2006</surname>
          </string-name>
          <article-title>The use of landscape pattern metrics in remote sensing image classification</article-title>
          <source>International Journal of Remote Sensing</source>
          <volume>27</volume>
          (
          <issue>10</issue>
          )
          <fpage>2025</fpage>
          -
          <lpage>2032</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Grabler</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agrawala</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sumner R W and Pauly</surname>
            <given-names>M 2008</given-names>
          </string-name>
          <article-title>Automatic generation of tourist maps ACM</article-title>
          <source>Transactions on Graphics</source>
          <volume>27</volume>
          (
          <issue>3</issue>
          )
          <fpage>100</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Guienko</surname>
            <given-names>G</given-names>
          </string-name>
          and
          <string-name>
            <surname>Doytsher</surname>
            <given-names>Y 2003</given-names>
          </string-name>
          <article-title>Geographic information system data for supporting feature extraction from high-resolution aerial and satellite images</article-title>
          <source>Journal of Surveying Engineering</source>
          <volume>129</volume>
          (
          <issue>4</issue>
          )
          <fpage>158</fpage>
          -
          <lpage>164</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Scholzel</surname>
            <given-names>C A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hense</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hubl</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuhl</surname>
            <given-names>N</given-names>
          </string-name>
          and
          <string-name>
            <surname>Litt</surname>
            <given-names>T 2002</given-names>
          </string-name>
          <article-title>Digitization and geo-referencing of botanical distribution maps</article-title>
          <source>Journal of Biogeography</source>
          <volume>29</volume>
          (
          <issue>7</issue>
          )
          <fpage>851</fpage>
          -
          <lpage>856</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Fedotov</surname>
            <given-names>N G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Syemov</surname>
            <given-names>A A</given-names>
          </string-name>
          and
          <string-name>
            <surname>Moiseev</surname>
            <given-names>A V</given-names>
          </string-name>
          <year>2016</year>
          <article-title>Analysis of conditions that influence the properties of the consructed 3D-image features</article-title>
          <source>Computer Optics</source>
          <volume>40</volume>
          (
          <issue>6</issue>
          )
          <fpage>887</fpage>
          -
          <lpage>894</lpage>
          DOI: 10.18287/
          <fpage>2412</fpage>
          -6179-2016-40-6-
          <fpage>887</fpage>
          -894
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Abdulsalam</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Skillicorn D B and Martin P 2011 Classification Using</surname>
          </string-name>
          <article-title>Streaming Random Forests IEEE Transactions on Knowledge</article-title>
          and
          <source>Data Engineering</source>
          <volume>23</volume>
          <fpage>22</fpage>
          -
          <lpage>36</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Biau</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Devroye</surname>
            <given-names>L</given-names>
          </string-name>
          and
          <string-name>
            <surname>Lugosi</surname>
            <given-names>G 2008</given-names>
          </string-name>
          <article-title>Consistency of random forests and other averaging classifiers</article-title>
          <source>Journal of Machine Learning Research</source>
          <volume>9</volume>
          <fpage>2015</fpage>
          -
          <lpage>2033</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Hastie</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tibshirani</surname>
            <given-names>R</given-names>
          </string-name>
          and
          <string-name>
            <surname>Friedman</surname>
            <given-names>J 2009</given-names>
          </string-name>
          <article-title>The Elements of Statistical Learning: Data Mining, Inference,</article-title>
          and
          <string-name>
            <surname>Prediction</surname>
          </string-name>
          (Springer-Verlag) p
          <fpage>746</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Breiman L 2001 Random Forests</surname>
          </string-name>
          Machine Learning
          <volume>45</volume>
          (
          <issue>1</issue>
          )
          <fpage>5</fpage>
          -
          <lpage>32</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>