<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>ADGN20: First workshop on Applied Deep Generative Networks</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jer Hayes</string-name>
          <email>jeremiah.hayes@accenture.com</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cathal Gurrin</string-name>
          <email>cgurrin@computing.dcu.ie</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Azzurra Pinio</string-name>
          <email>oazzurra.pini@fjordnet.com</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mark Keane</string-name>
          <email>mark.keane@ucd.ie</email>
        </contrib>
      </contrib-group>
      <abstract>
        <p>Generative models are widely used in many sub elds of AI and Machine Learning. More recently generative models using deep learning have been employed in a creative manner to generate new media (images, text and music), but they have also been applied to areas such as drug discovery and data anonymisation. This workshop focused on the applications and research problems related to the practical use of deep generative models in the real world and where examples ranged from drug discovery to bespoke furniture generation.</p>
      </abstract>
      <kwd-group>
        <kwd>Generative Networks</kwd>
        <kwd>GANs</kwd>
        <kwd>Applied Research</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Background</title>
      <p>
        A generative model is a powerful way of learning data distributions using
unsupervised learning; essentially the model learns unseen patterns or hidden
structures in data in order to synthesis new example data. When we speak of deep
generative networks we are describing models that are built as deep neural network
(or deep learning) models and that typically are grouped into types of
autoencoders (especially variational autoencoders [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]); generative adversarial networks
(GANs) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]; and combinations of the two. The main applications of generative
networks have been based on using image data. Given an image dataset new
example images are created, e.g., [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Depending on the dataset these can have
speci c domains, e.g., generating realistic human faces [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]; anime characters
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Another use case is `translation' of one input into another. These include
transforming satellite photographs to Google maps images, transforming sketch
images to realist color photographs. A signi cant number of image-to-image
translations are called `style transfers' and they include examples such
transforming photos from day to night; transforming black and white photographs to
color; transforming a painting to a photograph; and transforming a photograph
to a painting (with a certain artistic style). However, there have also been
examples where text is used in association with images, e.g., text-to-image translation
where an image is created based on the text input. Some of these techniques have
also had negative applications, e.g., the use of 'deepfakes' [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] whereby realistic
fake content is generated sometimes for purpose of creating fake news content.
      </p>
      <p>The intention of the workshop was to focus on research problems related to
the practical use of deep generative models in the real world. It was also intended
to be an in-person workshop but travel restrictions due to the Covid-19 pandemic
resulted the workshop and indeed the whole conference being held virtually.
Ultimately seven papers were accepted for presentation at the workshop. These
papers explore topics mainly related the following:
{ Business / Service Applications
{ Exploration of latent space
{ Human-machine collaboration</p>
      <p>The papers were divided into sessions that covered business and health
Applications; human-machine collaboration; and the latent Space. We now brie y
introduce these seven contributions.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Work presented at the workshop</title>
      <p>Relating to business / health Applications, Pandey et al., apply GANs to the
general problem of dealing with data that is imbalanced. This occurs in many
sectors but it is especially prevalent in the nancial sector where legitimate
transactions make up the vast majority of total transactions, thereby making it
harder for to detect fraudulent transactions. They presented a study on GANs
for synthetic fraud data generation and demonstrate improved classi er
performance for detecting fraud. In related work, Zhang and Li's paper (they could not
attend the virtual workshop) introduced research on generating latent weights
for few shot image classi cation. This work focused on another common problem
building models from limited labeled data. Additionally Gaal et al. presented
research on adding an adversarial critic model to a CNN in the application area
of Chest X-ray Lung Segmentation where both performance and interpretability
of the model results are important.</p>
      <p>Within the domain of human + machine collaboration, Pini presented work
that takes a design approach to style transfer. This work is an application of
season transfer with GANs to design a visual booking service for the travel industry.
Gonzalez and Muin~os-Landin Santiago then presented work on generative design
for social manufacturing with a use case featuring furniture design. Given the
remote nature of the workshop we unfortunately could not hand the physical
outputs of their use case.</p>
      <p>Research into exploration of latent space included Singh et al. who presented
work on manifold traversal of latent spaces for novel molecule discovery.
Fernandes et al. also presented work on latent Space exploration for classi er
improvement. They proposed a framework that combined GANS and evolutionary
computation to perform data augmentation on small datasets in order to improve
the performance of image classi ers trained via supervised learning.
Despite the vagaries of remote meetings the workshop was held as originally
intended and provided a form for both presentation and discussion. Six of the
the seven accepted papers were presented during the workshop. In terms of the
discussions that took place the focus was on the move towards real-world
application and the implications for ethics, collaboration, and interpretability of
bringing GANs from the lab into the real-world. It was highlighted that considering
technology application was opening up new research opportunities and that this
move to application-driven research was mirroring the situation in other elds of
AI and machine learning. Collaboration was a talking point as currently many
of these models and techniques are used by experts but Pini pointed out that
products like RunwayML (https://runwayml.com/) allow non-ML experts to use
generative networks. The question of interpretability also arose as currently for
some models it is not clear as to why a particular example was synthesised etc.
Overall the discussion was robust and involved the organisers and many of the
participants. The organisers noted the potential for follow-on workshops that
will facilitate a continuation of the discussions.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>D. P.</given-names>
            <surname>Kingma</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Welling</surname>
          </string-name>
          , \
          <article-title>An introduction to variational autoencoders," Foundations and Trends in Machine Learning</article-title>
          , vol.
          <volume>12</volume>
          , no.
          <issue>4</issue>
          , p.
          <volume>307</volume>
          {
          <issue>392</issue>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>I. J.</given-names>
            <surname>Goodfellow</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Pouget-Abadie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mirza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Warde-Farley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ozair</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Courville</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Bengio</surname>
          </string-name>
          , \Generative adversarial networks,"
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>A.</given-names>
            <surname>Radford</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Metz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Chintala</surname>
          </string-name>
          , \
          <article-title>Unsupervised representation learning with deep convolutional generative adversarial networks,"</article-title>
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>T.</given-names>
            <surname>Karras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Aila</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Laine</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Lehtinen</surname>
          </string-name>
          , \
          <article-title>Progressive growing of gans for improved quality, stability</article-title>
          , and variation,"
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Jin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Tian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Zhu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Fang</surname>
          </string-name>
          , \
          <article-title>Towards the automatic anime characters creation with generative adversarial networks,"</article-title>
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>R.</given-names>
            <surname>Tolosana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Vera-Rodriguez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Fierrez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Morales</surname>
          </string-name>
          , and J.
          <string-name>
            <surname>Ortega-Garcia</surname>
          </string-name>
          ,
          <article-title>\Deepfakes and beyond: A survey of face manipulation and fake detection,"</article-title>
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>