<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Surfzone Topography-informed Deep Learning Techniques to Nearshore Bathymetry with Sparse Measurements</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Yizhou Qian</string-name>
          <email>1yzqian@stanford.edu</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hojat Ghorbanidehno</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthew Farthing</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ty Hesser</string-name>
          <email>thesser1g@gmail.com</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter K. Kitanidis</string-name>
          <email>5peterk@stanford.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eric F. Darve</string-name>
          <email>darveg@stanford.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Civil and Environmental Engineering, Stanford University</institution>
          ,
          <addr-line>CA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Mechanical Engineering, Stanford University</institution>
          ,
          <addr-line>CA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Nearshore bathymetry, the knowledge of water depth in coastal zones, has played a vital role in a wide variety of applications including shipping operations, coastal management, and risk assessment. However, direct high resolution surveys of nearshore bathymetry are relatively difficult to perform due to budget constraints and logistical restrictions. One possible approach to nearshore bathymetry without such limitations is the use of spatial interpolation with sparse measurements of water depth by using, for example, geostatistics. However, it is often difficult for traditional methods to recognize patterns with a sharp gradient often shown on coastal sand bars, especially in the case of sparse measurements. In this work, we use a conditional Generative Adversarial Neural Network (cGAN) to generate abruptly changing bathymetry samples while being consistent with our sparse, multi-scale measurements. We train our neural network based on synthetic data generated from nearshore surveys provided by the U.S. Army Corps of Engineer Field Research Facility (FRF) in Duck, North Carolina. We compare our method with Kriging on real surveys as well as ones with artificially added patterns of sharp gradient. Results show that our conditional Generative Adversarial Network provides estimates with lower root mean squared errors than Kriging in both cases.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Nearshore bathymetry, or the topography of ocean floor in
coastal zones, has been one of the most critical variables in
many areas including geomorphology (Finkl, Benedet, and
Andrews 2005), harbor managements
        <xref ref-type="bibr" rid="ref5">(Grifoll et al. 2011)</xref>
        and flood risk assessment (Casas et al. 2006). Hence,
accurate estimations of nearshore bathymetry with relatively
low cost in area of interest, have become increasingly
important in recent years due to the expansion of coastal
activities and the improvement of sensor technologies. Nearshore
bathymetry typically exhibits time-varying multi-scale
features such as sand bars due to short-term wave and storm
forcing as well as long-term climate and sea level changes.
In this work, we focus primarily on the comparisons of
spatial interpolation methods (SIMs) for nearshore bathymetry.
In particular, Kriging, which is one of the most widely used
stochastic techniques for environmental data, will be
compared with our deep learning methods.
      </p>
    </sec>
    <sec id="sec-2">
      <title>Generative Adversarial Networks</title>
      <p>Generative Adversarial Networks are a class of deep
generative models that consists of two types of neural networks
(Goodfellow et al. 2014): a generator G and a
discriminator D. The generator G takes some noise vector z, which
is usually from some normal distribution p1(z), as input to
generate fake images, and the discriminator takes images as
input and tries to classify them as real or fake. The networks
are trained in an adversarial manner: the generator G tries to
generate as realistic images as possible to fool the
discriminator D, while D tries to accurately distinguish between
real images and fake images generated by G. Formally, let x
represent the bathymetric images with some prior
distribution p2(x), then the objective function of GAN will be:
min max Exsp2(x)(log D(x))+ Ezsp1(z)(1 log D(G(z)))
G D</p>
      <p>
        Conditional Generative Adversarial Networks (cGANs)
are an extension of GANs
        <xref ref-type="bibr" rid="ref7">(Mirza and Osindero 2014)</xref>
        , in
which an extra label y, which represents indirect
observations, is passed as input to both the generator G and the
discriminator D. The two networks are trained alternatively
using the output of each other, and the generator will
supposedly generate sample images consistent with observations at
the end of several training cycles. In this work, two
different scale data types of 1) point-wise sparse measurements
and 2) averages over each grid are used with labels y for
our cGAN. The overall scheme is shown in Figure 1. The
objective function of cGAN then becomes:
min max Exsp2(x)(log D(xjy))+Ezsp1(z)(1 log D(G(zjy)))
G D
240 surveys are used to generate synthetic training data for
cGAN by adding Gaussian noises with the following
covariance matrix:
      </p>
      <p>Cij =
exp
kxi
r2
xj k2
where is chosen in (1; 2) and r is chosen in (80; 100).
9600 training samples in total are generated to be training
data. We also introduce random sand bar structures as our
topographical understanding in the surf zone and investigate
cGAN’s potential ability to recognize patterns with sharp
gradient. For this, rectangular jumps with random locations
(uniformly in the computational domain) and random sizes
are added to real bathymetry surveys (9600 samples) as well
as profiles with constant values uniformly chosen from 0 to
10 (9600 samples) with Gaussian variations. We also add
Gaussian white noise with a variance of 0.2 to all training
input. In our comparisons below, we consider using only 35
evenly distributed grid points with a grid size of 136 meters
along-shore and 76 meters across-shore for our sparse
measurements. For Kriging, we used the method of CoKriging
to incorporate grid cell averages as auxiliary measurements.</p>
    </sec>
    <sec id="sec-3">
      <title>Performance on Real Data</title>
      <p>
        In the first case, we compare cGAN with Kriging based on
15 real FRF surveys not included in the training set. For
each prediction, 100 samples are generated by cGAN and
we use the point-wise average over those samples as our
final estimate. Figure 2 shows the root mean squared
errors of cGAN and Kriging on those 15 surveys. Our results
show that cGAN produces estimates of bathymetry profiles
with consistently lower root mean squared errors than
Kriging. This is because when training data are sampled from
a carefully chosen prior distribution, deep neural networks
are known to provide posterior estimates that minimize the
mean squared error
        <xref ref-type="bibr" rid="ref1">(Adler and O¨ ktem 2018)</xref>
        .
      </p>
      <p>Performance on Data with
0.7
0.6
r
o
rrE0.5
d
e
rau0.4
q
S
an0.3
e
M
to0.2
o
R
0.1
0.0</p>
      <p>
        Comparison of OK and cGAN on Real Surveys
cGAN
OK
0
2
4
6 8
FRF Surveys
10
12
14
In the second case, one FRF survey taken on June 21th,
2017 is chosen for comparisons on performance of cGAN
and Kriging while random rectangular jumps are added
(uniformly random location and sizes). Similarly, 100 samples
are generated by cGAN to compute the average as its
final prediction. The result is shown in Figure 3 and
Figure 4. Figure 3 shows predictions of nearshore bathymetry
by cGAN and Kriging with the corresponding mean
absolute error (MAE), as well as the variance of samples
generated by cGAN. Figure 4 shows the corresponding cross
section plots near the location of discontinuity. We
observe that cGAN gives estimates with almost vertical jumps,
as well as a lower mean absolute error. This is because
deep neural networks can express highly complex
functions in an efficient manner
        <xref ref-type="bibr" rid="ref8">(Poole et al. 2016)</xref>
        while
Kriging requires a carefully chosen nonlinear kernel function
to achieve the same performance
        <xref ref-type="bibr" rid="ref9">(Williams 1996)</xref>
        .
Furthermore, GAN tends to produce sharper samples than other
available methods
        <xref ref-type="bibr" rid="ref4">(Goodfellow 2017)</xref>
        , thus is suitable for
general nearshore bathymetry interpolation applications.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In this work, we compare cGAN with Kriging on real
nearshore bathymetry surveys. Results show that cGAN
provides estimates with lower root mean squared errors than
Kriging on real FRF surveys not included in the training set.
We also compared cGAN with Kriging on synthetic surveys
with rectangular jumps. It is shown that cGAN produces
samples with lower mean absolute errors as well as sharper
boundaries.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgement</title>
      <p>This research was supported in part by an appointment to
the Research Participation Program at the U.S. Army
Engineer Research and Development Center, Coastal and
Hydraulics Laboratory (ERDC-CHL) administered by the Oak
Ridge Institute for Science and Education through an
interagency agreement between the U.S. Department of
Energy and ERDC. The research is also supported in part by
funding from the Army High Performance Computing
Research Center (AHPCRC), sponsored by the U.S. Army
Research Laboratory under contract No. W911NF-07-2-0027,
at Stanford. Jonghyun Lee was supported in part by Hawai’i
Experimental Program to Stimulate Competitive Research
(EPSCoR) provided by the National Science Foundation
Research Infrastructure Improvement (RII) Track-1: ’Ike Wai:
Securing Hawai’i’s Water Future Award #OIA-1557349.</p>
      <p>Casas, A.; Benito, G.; Thorndycraft, V.; and Rico, M. 2006.
The topographic data source of digital terrain models as a
key element in the accuracy of hydraulic flood modelling.
Earth Surface Processes and Landforms 31(4):444–456.
Finkl, C. W.; Benedet, L.; and Andrews, J. L. 2005.
Interpretation of seabed geomorphology based on spatial analysis of
high-density airborne laser bathymetry. Journal of Coastal
Research 213:501–514.</p>
      <p>Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.;
Warde-Farley, D.; Ozair, S.; Courville, A.; and Bengio, Y.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Adler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and O¨ktem,
          <string-name>
            <surname>O.</surname>
          </string-name>
          <year>2018</year>
          .
          <article-title>Deep bayesian inversion</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          arXiv preprint arXiv:
          <year>1811</year>
          .05910.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          2014.
          <article-title>Generative adversarial nets</article-title>
          .
          <source>In Advances in neural information processing systems</source>
          ,
          <volume>2672</volume>
          -
          <fpage>2680</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Goodfellow</surname>
            ,
            <given-names>I. J.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>NIPS 2016 tutorial: Generative adversarial networks</article-title>
          .
          <source>CoRR abs/1701</source>
          .00160.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Grifoll</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; Jorda`, G.; Espino,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Romo</surname>
          </string-name>
          , J.; and Garc´ıaSotillo,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <year>2011</year>
          .
          <article-title>A management system for accidental water pollution risk in a harbour: The barcelona case study</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <source>Journal of Marine Systems</source>
          <volume>88</volume>
          (
          <issue>1</issue>
          ):
          <fpage>60</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Mirza</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Osindero</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <year>2014</year>
          .
          <article-title>Conditional generative adversarial nets</article-title>
          .
          <source>arXiv preprint arXiv:1411</source>
          .
          <fpage>1784</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Poole</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Lahiri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; Raghu,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Sohl-Dickstein</surname>
          </string-name>
          , J.; and
          <string-name>
            <surname>Ganguli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <year>2016</year>
          .
          <article-title>Exponential expressivity in deep neural networks through transient chaos</article-title>
          . In
          <string-name>
            <surname>Lee</surname>
            , D. D.; Sugiyama,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Luxburg</surname>
          </string-name>
          , U. V.;
          <string-name>
            <surname>Guyon</surname>
            ,
            <given-names>I.;</given-names>
          </string-name>
          and Garnett, R., eds.,
          <source>Advances in Neural Information Processing Systems</source>
          <volume>29</volume>
          . Curran Associates, Inc.
          <fpage>3360</fpage>
          -
          <lpage>3368</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>C. K. I.</given-names>
          </string-name>
          <year>1996</year>
          .
          <article-title>Computing with infinite networks</article-title>
          .
          <source>In Proceedings of the 9th International Conference on Neural Information Processing Systems</source>
          ,
          <volume>NIPS96</volume>
          ,
          <fpage>295</fpage>
          -
          <lpage>301</lpage>
          . Cambridge, MA, USA: MIT Press.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>