<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mariya PASHKOVA, Sofya ILINYKH,</string-name>
          <email>Ilinykh-Sofya@mail.ru</email>
          <email>Pashkova.Mariya@rambler.ru</email>
          <email>Pashkova.Mariya@rambler.ru, Ilinykh-Sofya@mail.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Natalia GRAFEEVA</string-name>
          <email>N.Grafeeva@spbu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>X</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Saint-Petersburg State University</institution>
          ,
          <addr-line>St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Y</institution>
          ,
          <addr-line>value</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>- This article presents the problem of searching useful magnetic anomalies by using the magnetometric survey methods. Metal debris (spot anomalies) often create local interference that makes it difficult to find vast spatial anomalies caused by the remnants of ancient buildings, such as walls of houses, wells, dugouts, etc. The main purpose of this study is to develop an algorithm that eliminates such interference. We explore the methods of working with magnetometric data and design an algorithm which is based on seeking spot anomalies and using the arithmetic method of smoothing spatial data. We test the final algorithm on many real datasets, obtained during excavations in the Crimea, and it shows good results.</p>
      </abstract>
      <kwd-group>
        <kwd>magnetometric</kwd>
        <kwd>spatial data smoothing</kwd>
        <kwd>arithmetic mean of spatial data</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>I. INTRODUCTION</p>
      <p>In archaeology there are different methods of determining
the location of future excavation sites. One of those methods,
magnetometric survey, is based on magnetic properties of
hidden underground objects. The main advantage of this
method is a relatively low cost.</p>
      <p>The process of magnetometric survey is described in [6].
Magnetometric survey is usually performed on a square
surface area of proposed excavation site with the size ranging
from 50 by 50 meters to 100 by 100 meters. That square area
is called a quadrangle. At first, a modulus of magnetic
induction of the geomagnetic field is measured at previously
determined observation points. Then, collected data is
preprocessed (e.g. to take into account global geomagnetic
field changes). Then, researchers build a map of a quadrangle,
estimate the probability of finding objects of archaeological
value. Finally, a conclusion on conducting excavations is
made. Sometimes, anomalies (deviation from the average
value of magnetic field), created by past human activity, can
be spotted on a map.</p>
      <p>Often, small metal junk creates interferences represented
in numerical data by sharp value drops causing difficulties in
searching for vast spatial anomalies created by ancient
buildings (houses, wells and burial mounds). The main
objective of this study is developing and testing an algorithm
which will allow smoothing out sharp data drops thus
eliminating interferences caused by metal junk.
Min
1st Qu.</p>
      <p>Median
Mean.
3rd Qu.</p>
      <p>Max
x
0.0
12.5
25.0
25.0
37.5
50.0</p>
      <p>y</p>
      <p>There are three groups of methods are usually used to
process magnetometric data.</p>
      <p>
        Magnetometric data can be easily visualized [3]. For
example, magnetic value can serve as a color of the
black-towhite gradient. This way researchers can process data as an
image, apply filtration [
        <xref ref-type="bibr" rid="ref7">10</xref>
        ], stretching, etc. Some of these
methods are presented in [3].
      </p>
      <p>There are two different ways of processing images within
the context of the task:
•
•</p>
      <p>Methods based on processing pixels directly. For
example, logarithmic and power transformations,
application of Gaussian filter [8] and Sobel
operator [9], etc.</p>
      <p>Methods, based on modification of the Fourier
spectrum of the image [9]
B.</p>
    </sec>
    <sec id="sec-2">
      <title>Working with numerical data, based on its nature</title>
      <p>Considering the nature of data, it can be processed as
numbers. In each point x of quadrangle input data is
represented as a sum</p>
      <p>B(x) = R(x) + P(x) + A(x)
where R is a level of regional background magnetic field,
P – interference, A – local anomalies.</p>
      <p>Applying certain algorithms (analytical continuation of the
field into the upper half plane, Kalman filter, etc.) the
researcher is trying to distinguish and deduct the background
and the interference to find important local anomalies. The
main source of information about those methods is [2].</p>
    </sec>
    <sec id="sec-3">
      <title>C. Other approaches</title>
      <p>
        Lately, a variety of methods (clusterization [7], patterns
recognition [
        <xref ref-type="bibr" rid="ref8">11</xref>
        ], etc.), that can be applied to magnetometric
data, but do not take in consideration the nature of the data,
have been suggested.
      </p>
      <p>Often image processing methods cannot provide the
desired results. Application of those methods sometimes
causes strong distortion of the image (reasons include
aforementioned metal objects), which hinders the search for
useful spatial anomalies. Methods, based on the nature of the
data, are interesting and sometimes useful, but are costly. At
the same time simple disposal of interference, created by
metal objects, can drastically change the visual image of the
analyzed data. With that in mind in this study attention was
focused on finding an algorithm, which processes data to
eliminate interference that hinders the search of vast space
anomalies.</p>
      <p>IV. CHOOSING A METHOD FOR SMOOTHING MAGNETOMETRIC</p>
      <p>DATA</p>
      <p>In Fig. 2 black dots surrounded by white areas are clearly
visible (in numerical data they are represented by large
deviations from average value of the quadrangle). These are
the point anomalies, caused by metal junk or instrumentation
errors. Usually, they cover no more than 1-2% of the whole
area. They are not always objects of archaeological research,
but they can obstruct analysis of more significant objects.</p>
      <p>So, the idea is to smooth the values in such points. Then,
small meaningful deviations will be more noticeable when
visualized.</p>
      <p>This can be achieved, for example, by a simple method of
arithmetic mean, but instead of time series, space surrounding
the interference points can be used.</p>
      <p>Example of input data with point anomalies
V. DEVELOPMENT OF ALGORITHM</p>
    </sec>
    <sec id="sec-4">
      <title>B. Deviation-based approach</title>
      <p>During data analysis it was observed that in places of
metal junk concentration of large deviations occur, both
positive and negative. At the same time, points where such
situation happens make up a small portion of all points in the
quadrangle. There are two approaches for finding point
anomalies based on these ideas.</p>
    </sec>
    <sec id="sec-5">
      <title>A. Frequency-based approach</title>
      <p>First approach is based on sorting magnetic value by
frequency of appearance on a set area. Afterwards points, that
appear rarely enough (i.e. make up no more than M percent of
the area), are selected. Table II shows a table of magnetic
values and their corresponding frequencies with values,
selected to be smoothed, highlighted. In this example M
equals 2%. Fig. 3 shows values of the examined area with
selected values marked in dark grey.</p>
      <p>In the second approach points are considered to be
interference when their value deviates from the average by
more than parameter δ.</p>
      <p>Fig. 4 shows selected points with δ = 9. The average value
is -3.5.</p>
      <p>After the interference points have been found, their values
should be smoothed. Following solution has been considered:
points are assigned an average value of some neighborhood
that does not include point anomalies.</p>
      <p>Firstly, two extreme cases have been implemented. In the
first case an interference point was assigned a value of the
closest (using the Euclidean distance) point that is not a
subject to smoothing. In the second case, the average value of
the quadrangle is assigned to all interference points. As can be
seen in Fig. 5-7, results of applying these extreme cases are
not what we are looking for: smoothing is too rough and
inaccurate, distortions are still visible and local anomalies
become blurred, thus it does not solve our problem. In both
cases the interference points were found using deviation
method.</p>
      <p>Magnetic
values</p>
      <p>During the work it was found that in most cases 8 is an
optimal number of points in a neighborhood. Fig. 8 shows
interference points (marked in gray) and their corresponding
neighborhoods (marked in light gray). The interference points
were found using the deviation method, where parameter M is
equal 9.
For the next step of the work it was decided to divide the
initial quadrangle into smaller parts and then apply
aforementioned approaches to each of them. Figures 11-12
show the results of dividing the quadrangle into 25 parts.</p>
      <p>Results are improved and the frequency method performs
better than the deviation method. Thus, by dividing initial data
into separate parts and smoothing rarely occurring values,
desired results can be achieved.
Fig. 10. Deviation method, δ = 13 and δ = 9</p>
      <p>During the work spatial magnetometric data was smoothed
using arithmetic average values helping in identifying local
magnetic anomalies.</p>
      <p>As can be seen in Fig. 13-14, developed algorithm
processes initial data in such way, that an archaeology
specialist would have no trouble determining the contours of
the object and deciding if the excavation is advisable at the
sector in question.</p>
      <p>
        An advantage of the algorithm is that it transforms
numbers, not images. Therefore it can be used not only by
itself, but also as preprosessing step for other methods, for
example, clustering[4],[5] or filtering[
        <xref ref-type="bibr" rid="ref7">10</xref>
        ].
      </p>
      <p>Sample data</p>
      <p>ACKNOWLEDGMENT</p>
      <p>The authors would like to thank the Low Field Magnetic
Resonance Laboratory in Saint Petersburg State University for
provided data, which were obtained as a result of excavations
in the Crimea.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>V.A.</given-names>
            <surname>Kutajsov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.N.</given-names>
            <surname>Smekajlov</surname>
          </string-name>
          ,
          <article-title>Materials for archaeological map of Crimea: History and archaeology of Northwestern Crimea</article-title>
          , Simferopol: Phoenix Company,
          <year>2014</year>
          . [in Russian] Dudkin
          <string-name>
            <given-names>V.P.</given-names>
            and
            <surname>Koshelev</surname>
          </string-name>
          <string-name>
            <surname>I.N.</surname>
          </string-name>
          ,
          <article-title>Method for complex interpreting the results of magnetometric survey of archaeological landmarks, Vostochnoevropeisk</article-title>
          . Arkheol. Zh., No.
          <volume>3</volume>
          (
          <issue>6</issue>
          ),
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>V. S.</given-names>
            <surname>Mikhailova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. G.</given-names>
            <surname>Grafeeva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. G.</given-names>
            <surname>Mikhailova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. V.</given-names>
            <surname>Chudin</surname>
          </string-name>
          , Magnetometry Data Processing to Detect Archaeological Sites,
          <source>Pattern Recognition and Image Analysis</source>
          ,
          <year>2016</year>
          , Vol.
          <volume>26</volume>
          , No.
          <issue>4</issue>
          , pp.
          <fpage>789</fpage>
          -
          <lpage>799</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>©Pleiades</surname>
            <given-names>Publishing</given-names>
          </string-name>
          , Ltd.,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Belim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. V.</given-names>
            <surname>Kutlunin</surname>
          </string-name>
          ,
          <article-title>Boundary Extraction in Images Using A Clustering Algorithm</article-title>
          ,
          <source>Computer Optic</source>
          , Vol.
          <volume>39</volume>
          , No.
          <issue>1</issue>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>124</lpage>
          ,
          <year>2015</year>
          . [in Russian] Elena Volzhina ;
          <article-title>Andrei Chudin ; Boris Novikov ; Natalia Grafeeva ; Elena Mikhailova, Discovering geo-magnetic anomalies: a clusteringbased approach, 2016, Page(s):1-7 Intelligence, Social Media and Web (ISMW FRUCT), 2016 International FRUCT Conference V. K. Khmelevskoi, Geophysical Methods for Investigating the Earth Crust</article-title>
          , Dubna: Dubna Univ.,
          <year>1999</year>
          . [in Russian] Barsegjan
          <string-name>
            <given-names>A.A.</given-names>
            ,
            <surname>Kuprijanov</surname>
          </string-name>
          <string-name>
            <given-names>M.S.</given-names>
            ,
            <surname>Holod</surname>
          </string-name>
          <string-name>
            <given-names>I.I.</given-names>
            ,
            <surname>Tess M.D.</surname>
          </string-name>
          and
          <string-name>
            <surname>Elizarov</surname>
            <given-names>S.I.</given-names>
          </string-name>
          ,
          <article-title>Data and process analysis</article-title>
          ,
          <source>St. Petersburg: BHV-Petersburg</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [in Russian] Duda and
          <string-name>
            <given-names>P.</given-names>
            <surname>Hart</surname>
          </string-name>
          , Pattern Classification and
          <string-name>
            <given-names>Scene</given-names>
            <surname>Analysis</surname>
          </string-name>
          , New York: John Wiley and Sons,
          <year>1973</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Jian-Lei Liu</surname>
          </string-name>
          Da-Zheng Feng, “
          <article-title>Two-dimensional multi-pixel anisotropic Gaussian filter for edge-line segment”, Image and Vision Computing archive</article-title>
          , vol.
          <volume>32</volume>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2014</year>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>R.</given-names>
            <surname>Gonzalez</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Woods</surname>
          </string-name>
          , Digital Image Processing, New Jersey: Prentice Hall,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Mesteckiy</surname>
            <given-names>L. M.</given-names>
          </string-name>
          ,
          <source>Mathematical methods of pattern recognition. Lecture course</source>
          , Moscow: Moscow State University,
          <source>Faculty of Mathematic and Cybernetics</source>
          ,
          <year>2002</year>
          . [in Russian]
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>