<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>and Dublin Philosophical
Magazine and Journal of Science 10 (1855) 30-39. doi:10.1080/14786445508641925.
[7] B. Mildenhall</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.1080/14786445508641925</article-id>
      <title-group>
        <article-title>Neural-based reconstruction of radioactivity distribution in large water volumes with underwater gliders</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Melkon Chatsikian</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Valsamis Ntouskos</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Angelos Mallios</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Konstantinos Karantzalos</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ploa Technology Consultants S.L.</institution>
          ,
          <addr-line>17003 Girona</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Remote Sensing Laboratory, National Technical University of Athens</institution>
          ,
          <addr-line>15772 Zographos</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <volume>33</volume>
      <fpage>30</fpage>
      <lpage>39</lpage>
      <abstract>
        <p>This work focuses on the problem of reconstructing the 3D distribution of radioactivity in large water volumes based on measurements collected with underwater gliders. We present a high-level simulation environment to study radioactivity reconstruction accuracy and eficiency considering diferent reference radioactivity distributions and under diferent types of glider trajectories, also taking into account the limitations of radioactivity detection in the water. A neural-based sampling approach is adopted for reconstructing the radioactivity distribution based on the highly sparse measurements.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;underwater robotics</kwd>
        <kwd>gliders</kwd>
        <kwd>radioactivity mapping</kwd>
        <kwd>environmental intelligence</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Radioactivity, although present in the marine environment, is still significantly
undersampled and understudied. Fortunately, water acts as a very efective protective shield
against radioactivity emitted from sources deep inside the water, either man-made or
natural. Nevertheless, it is important to map radioactivity in underwater environments both
because natural radioactivity can be correlated with intense phenomena as earthquakes
and volcanic eruptions ([
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]), and because the presence of radioactivity in the water
(either natural or man-made) can afect the marine biome, with possible environmental
and human health risks. For this reason we consider here the possibility to map the
distribution of radiation in a large water volume via the detection of gamma radiation in
the water using gamma detectors mounted on underwater gliders.
      </p>
      <p>
        Underwater gliders are underactuated autonomous underwater vehicles, which take
advantage of their buoyancy to move through the water [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Unlike underwater vehicles
that use an engine to create thrust for moving through the water, underwater gliders
change their buoyancy and center of gravity, and use their wings to convert vertical
motion to horizontal. Diferent types of sensors can be installed on the gliders, covering
a wide range of applications including oceanic research, environmental monitoring, as
well as military ones. The most important advantage ofered by gliders is their very
low energy consumption, as they only require energy to periodically shift slightly their
volume and center of gravity to move, allowing them to perform extensively long missions,
ranging from days to months, covering very large areas before requiring recharging. Due
to these characteristics, underwater gliders are suitable for long surveys, where the ability
to remain in the sea for longer periods is more important than the high speed or rapid
change of direction ofered by other autonomous underwater vehicles. As mentioned
above, underwater gliders use the change of their buoyancy, the change of their rudder,
and at some cases a minimal thrust from an engine to achieve their motion [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ]. Based
on these movements, by altering their pitch angle gliders can follow saw-tooth like vertical
movements, typically called yo-yos, as well as helical movements with diferent radii by
actuating their ruder at the same time.
      </p>
      <p>In this work, we present a novel high-level simulation environment, which allows to
simulate the data collected by gamma radiation detectors mounted on underwater gliders
under typical forms of glider trajectories that can be used to scan the volume of interest.
To reconstruct the radioactivity distribution in the reference volume based on the sparse
measurements, we present a novel interpolation method based on multi-layer perceptrons
(MLPs) that is several times more eficient than linear interpolation methods while
showing improved accuracy in most cases.</p>
      <p>In the following, Section 2 presents a high-level simulation and a novel MLP-based
interpolation method developed for studying detection and mapping of radioactivity
using underwater gliders, Section 3 discusses the results obtained for a variety of reference
radioactivity distributions in the water considering diferent glider trajectories and
interpolation methods, and Section 3 provides concluding remarks.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Methodology</title>
      <p>For the purposes of this work we consider that measurements from the gamma radiation
detectors are stored in tabular format along with the position of the gliders corresponding
at the measurement time. Radioactivity mapping considers these data in order to produce
a map of the radioactivity distribution in the underwater volume being surveyed. Even
without considering uncertainties in the estimated location of the gliders, the problem is
notoriously challenging, as measurements cover an infinitesimal portion of the scanned
volume. This is inherent to the problem having co-dimension 2, as measurements are
virtually 1-dimesional, due to the high locality of the measurements caused by water
shielding, and the scanned volume being 3-dimensional. The most obvious solution to
propagate measurements to the volume of interest in order to provide a radioactivity map
is through interpolation of the recorded values. The simulation environment described
next is used to assess the accuracy of the maps reconstructed through interpolation, as
well as the eficiency of their calculation. Performing the interpolation using classical
methods, as linear interpolation, leads to very demanding computation due to the very
high number of measurements involved and the large extent of the volume needed to be
iflled. To address these challenges, a novel MLP-based sparse measurement interpolation
method is developed, described in the following.</p>
      <sec id="sec-2-1">
        <title>2.1. Simulation environment</title>
        <p>A high-level simulation environment has been developed to provide simulated radioactivity
measurements given an underlying radioactivity distribution in a reference volume and
considering typical trajectories that underwater gliders can execute based on their
kinematics. Simplified models are considered both for the radioactivity measurement
and the movement of the gliders, not taking into account the eficiency of the gamma
radiation detector and the presence of noise regarding the former and not accounting for
localization uncertainty regarding the latter. The goal is to provide an environment where
diferent radioactivity detection and mapping scenarios can be tried out, allowing to
choose suitable scanning patterns and better understanding limitations due to challenges
from radioactivity shielding of the water and the significantly small coverage of the area of
interest. The simulator has been developed in Python using the Plotly library, both for the
graphical representations, and for the numerical simulations of the measured radioactivity
values. A reference volume of interest has been defined in the form of a three-dimensional
cuboid with a size of 3000 × 3000 × 300 (x, y, z axes, respectively) and the simulation
is performed in a 1 : 1 scale. In this reference volume, two types of underwater glider
trajectories are considered. The first corresponds to yo-yo vertical motions, and the other
to helical movements, as shown in Figure 1. The simulation considers diferent spacing
between the trajectories. For the yo-yo movement, the horizontal distance between
two parallel trajectories is defined as trajectory spacing. For the helical movement, the
original volume is divided into smaller sub-volumes with square horizontal section with a
given spacing distance. The radius of the helical movement is defined as 1/4 of the size
of this horizontal spacing. The vertical movement of the underwater gliders is limited to
the range 25 − 285 , considering suitable margins for safe operation of the vehicle.</p>
        <p>The type of glider trajectory has an important impact on the time required to cover the
reference volume and to the total coverage. The simulation environment allows to estimate
the time needed to scan the entire volume. Given a specific type of movement, providing
the value of the trajectory spacing, the volume is filled with the planned trajectories,
allowing to compute the total length of the resulting scan-path. Dividing the scan-path
length by the speed of underwater gliders the duration of the scan can be estimated.
Additionally, considering a maximum detection range for the radioactivity detectors
mounted on the gliders , the volume of the space measured can be estimated in relation
to the total scan volume. Table 1 reports indicative scan times and volume coverage
estimations for diferent spacings of the two trajectory types, considering  = 0.5/
which is a representative value for underwater glider speed and   = 1 based on sea
water shielding efects afecting radiation detection limit.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Radioactivity Distributions</title>
        <p>In order to assess the ability of underwater gliders to efectively map underwater
radioactivity we consider diferent radioactivity distributions and use the developed simulator
to examine how accurately these distributions can be reconstructed from radioactivity
measurements acquired from an underwater glider traversing through them based on
diferent scan trajectories, as described above. Figure 2 summarizes the main types
of radioactivity distribution considered. They comprise analytically, geometrically and
difusion based distributions that show diferent characteristics in terms of shape and
spatial frequencies. The first reference distribution is a purely analytical one containing
a wide range of spatial frequencies and covering the entire area of interest, defined based
on the following relation:
 (, , 
) = sin</p>
        <p>radius and a top radius of 300 , approximating the shape
of a hydrothermal plume emitted through the center of the volume of interest. The
measurements inside the cone are taken as equal to 10 and outside as equal to 1.</p>
        <p>The last reference distribution is also approximating a hydrothermal plume, however,
considering the difusion of radioactive material across the vertical column to the
surrounding water. Letting  be the difusion rate, 
the difusion coeficient,
 the concentration
of the substance and  the distance along the difusion axis, the radioactivity distribution
evolution through time is given based on Fick’s second law of difusion, expressed by [ 6]:


=  ·
 2
 2
in the range 0 to 100, as can be seen in Figure 2.</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Interpolation</title>
        <p>The most straightforward way to reconstruct the radioactitvity distribution based on the
values measured along the trajectories is through linear interpolation. Specifically, one
can consider a discretized volumetric representation of the space, according to a spatial
sampling distance which defines the dimensions of the resulting voxels. Then, each voxel
is filled based on the average of the measurments along the trajectories weighed by the
inverse distance to the voxel. It should be noted that even for relatively low measurement
rate and spatial resolution(e.g. 1 measurement every 10 and voxels of ∼ 50 size) an
exact calculation is quite demanding on computational resources, especially in terms of
memory.</p>
        <p>To better capture the characteristics of the underlying radioactive distribution a
nonlinear interpolation scheme based on MLPs was considered. The idea of using an MLP
for interpolating values from a highly complex function builds on the work of NeRF [7].
In fact, a function of interest can be approximated in arbitrary precision by an MLP,
according to the universal approximation theorem [8]. In this context one can optimize
the weights of an MLP by providing the function argument as input and using the
measured (or computed) value of the function as supervision. In practice, [7] has found
that MLPs are not capable of learning high degree functions from low-dimensional inputs.
This dificulty can be overcome by applying positional encoding to the input, which
artificially increases the dimensionality of the input through the use of Fourier features [ 9].
In the context of radioactivity mapping, using an MLP as a function approximator and,
subsequently as an interpolator through querying values at specific locations, typically
leads to an improvement in the accuracy as well as a significant reduction of the required
execution time.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Results</title>
      <p>To assess radioactivity mapping algorithms, the developed simulation environment
was used, considering diferent types of underwater glider trajectories and diferent
radioactivity distributions. A grid of query coordinates was considered consisting of
31 × 31 × 8 = 7688 regularly spaced points. The points are equally spaced in 31 intervals
along the  and  axes in the range [0, 3000] and in 8 equally spaced intervals along the
 axis in the range [0, 300]. The grid size was chosen with the rationale of having enough
points to produce a reconstruction accurate and detailed enough, but also with a number
of points as small as possible because, as described above, typical implementations (e.g.,
function ‘griddata’ of SciPy in Python) are very demanding computationally and an
excessive number of query points is prohibitive due to space and time constraints. Table 2
presents the root-mean square error (RMSE) and peak signal to noise ratio (PSNR)
metrics, typical metrics used for assessing signal reconstruction quality [10], for the
estimated radioactivity maps computed using linear interpolation for yo-yo and helical
glider trajectories, respectively.</p>
      <p>We note that the radioactivity distribution based on difusion is better approximated.
This can be attributed to the fact that changes in the radioactivity values are quite
small. Plume (conical) distribution gives the second-best results, while the analytical
distribution of relation (4) is the most challenging, mainly due to the large extent of
spatial frequencies that the distribution contains. In terms of the glider trajectories
used for scanning the volume, the best results are obtained with the helical motion with
200 × 200 spacing, at the cost of excessively long time to complete the mapping.
Yoyo-type movement, on the other hand, provides slightly worse results but with the
important advantages in terms of reduced scan time. The last column of Table 2 reports
the time required to execute the linear interpolation on the 31 × 31 × 8 grid on a typical
workstation. This time ranges from 15 minutes to approximately 3 hours. The time
required to complete the interpolation task is directly related to the trajectory and the
number of query locations. These extended computation times are also one of the reasons
of proposing the MLP-based interpolation method.</p>
      <p>Regarding MLP-based interpolation, a reference architecture composed of four hidden
layers was considered, of which the first three consist of 256 neurons, while the third one
consists of 128 neurons. The ReLU activation function was considered for all the hidden
layers. The MLP is optimized considering the  2 loss with respect to the measured values
in the corresponding spatial locations. Ten percent of the available data is considered
as validation data and an early stopping strategy is implemented, with patience equal
to 7 epochs. The early stopping helps to prevent the model from overfitting, thus
allowing better approximation of values far from the measured locations. To be able to
capture functions with spatial high-frequency components, the three-dimensional input
coordinates are transformed using Positional encoding based on Fourier Features [9].</p>
      <p>Figure 3, shows the performance comparison of the MLP-based interpolation with
respect to the linear interpolation baseline using the PSNR metric, for the yo-yo and
helical trajectories. It can be seen that MLP gives comparable performance with the
linear based interpolation in the case of yo-yo trajectories, while they lead to significantly
better performance when helical trajectories are used. As expected, the smallest
subvolume spacing, i.e., 200 × 200 , leads to the best results. Importantly, the execution
time of MLP-based interpolation is sped-up multiple times with respect to linear-based
interpolation. In particular, the time required for MLP-based interpolation for the
scenarios we considered range from 18 to 369 seconds with an average of 101 seconds.
Compared to the corresponding linear interpolation times, this corresponds to a speedup
in the worst case of 8 and in the best case of 26 times.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>A high-level simulation environment has been developed to study the performance of
radioactivity mapping based on sparse measurements based on diferent combinations of
glider trajectories, radioactivity distributions and interpolation algorithms. The results
are encouraging for the efective mapping of large areas/volumes using glider vehicles,
with the simulations suggesting that mapping accuracy depends on the characteristics of
the radioactivity distribution, the type and spacing of the scan trajectories, as well as the
method used to propagate the measurements to the entire scan volume. Regarding the
latter, a novel MLP-based interpolation method has been developed that achieves higher
accuracy in most cases with notable speedup with respect to typical linear interpolation
implementations. An important outcome of the simulations is that they allow to better
understand the trade-of between mapping accuracy and time required to execute the
selected scan paths. Finally, although the analysis presented above is based on the
characteristics of radioactivity sampling, the developed methodology can be also applied
to the 3D mapping of other highly localized physical or chemical quantities of interest in
large volumes.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Acknowledgments</title>
      <p>This work was supported in part by the RAMONES EU H2020 FET-proactive project
under Grant 101017808, in part by the iSEAu EU H2020 MSCA-IF project under Grant
101030367, and in part by the SANTORY program funded by the Hellenic Foundation
for Research and Innovation under Grant 1850.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Neri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Ferrera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Giammanco</surname>
          </string-name>
          , G. Currenti,
          <string-name>
            <given-names>R.</given-names>
            <surname>Cirrincione</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Patanè</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Zanon</surname>
          </string-name>
          ,
          <article-title>Soil radon measurements as a potential tracer of tectonic and volcanic activity</article-title>
          ,
          <source>Scientific Reports</source>
          <volume>6</volume>
          (
          <year>2016</year>
          )
          <fpage>24581</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>M. M. Parks</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Caliro</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Chiodini</surname>
            ,
            <given-names>D. M.</given-names>
          </string-name>
          <string-name>
            <surname>Pyle</surname>
            ,
            <given-names>T. A.</given-names>
          </string-name>
          <string-name>
            <surname>Mather</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Berlo</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Edmonds</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Biggs</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Nomikou</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Raptakis</surname>
          </string-name>
          ,
          <article-title>Distinguishing contributions to difuse co2 emissions in volcanic areas from magmatic degassing and thermal decarbonation using soil gas</article-title>
          222 - 13 systematics: Application to santorini volcano, greece,
          <source>Earth and Planetary Science Letters 377-378</source>
          (
          <year>2013</year>
          )
          <fpage>180</fpage>
          -
          <lpage>190</lpage>
          . doi:https://doi.org/ 10.1016/j.epsl.
          <year>2013</year>
          .
          <volume>06</volume>
          .046.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M. Y.</given-names>
            <surname>Javaid</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ovinis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Nagarajan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. B.</given-names>
            <surname>Hashim</surname>
          </string-name>
          ,
          <article-title>Underwater gliders: a review</article-title>
          ,
          <source>in: MATEC Web of Conferences</source>
          , volume
          <volume>13</volume>
          ,
          <string-name>
            <given-names>EDP</given-names>
            <surname>Sciences</surname>
          </string-name>
          ,
          <year>2014</year>
          , p.
          <year>02020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>N.</given-names>
            <surname>Mahmoudian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Woolsey</surname>
          </string-name>
          ,
          <article-title>Underwater glider motion control</article-title>
          ,
          <source>in: IEEE Conf. on Decision and Control</source>
          ,
          <year>2008</year>
          , pp.
          <fpage>552</fpage>
          -
          <lpage>557</lpage>
          . doi:
          <volume>10</volume>
          .1109/CDC.
          <year>2008</year>
          .
          <volume>4739432</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <surname>F. Zhang,</surname>
          </string-name>
          <article-title>Spiraling motion of underwater gliders: Modeling, analysis, and experimental results</article-title>
          ,
          <source>Ocean Engineering</source>
          <volume>60</volume>
          (
          <year>2013</year>
          )
          <fpage>1</fpage>
          -
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>