<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>FAIRnets Search - A Prototype Search Service to Find Neural Networks</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Anna Nguyen?</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tobias Weller?</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Karlsruhe Institute of Technology (KIT)</institution>
          ,
          <addr-line>Karlsruhe</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Research on neural networks has gained signi cant momentum over the past few years. A vast number of neural networks is currently being developed and trained on available data in research as well as in industry. As the number of neural network architectures increases, we want to support people in the eld of machine learning by making existing architectures easier to nd and reuse. In this Demo, we support the ndability and reusability of Neural Networks by using the FAIRnets Search. Attendees will learn how to use the FAIRnets Search web service to search the FAIRnets dataset. The FAIRnets dataset is an RDF dataset containing information about already modeled neural networks. By applying RDF and OWL, our system can be queried using SPARQL queries indicating the desired characteristics of the neural network. As a result, all neural networks ful lling the search query are returned to the user. The returned search results support users to gain insights into existing neural networks. Furthermore, we give the possibility to get more detailed information about the architecture of the networks, as well as further links. The demo is available at http://km.aifb.kit.edu/services/fairnets/.</p>
      </abstract>
      <kwd-group>
        <kwd>Neural Network</kwd>
        <kwd>Ontology</kwd>
        <kwd>Reusability</kwd>
        <kwd>FAIR</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Neural networks (NNs) have become an important tool in research to make
predictions on measured data. Apart from preparing the data, it is use case and
data speci c which neural network to use regarding architecture and
parameters. Despite the huge amount of available neural network architectures online,
nding one that ts your problem is quite challenging because of information
overload. There are approaches in machine learning such as neural architecture
search [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] for neural network architecture design based on human knowledge
and trial-and-error. However, these methods are time and memory consuming
following a brute-force approach. Therefore, we want to focus on nding
existing archi- tectures given a use case to amplify the reuse of pre-trained neural
networks. Until now, there are neural network architecture repositories from
? These authors contributed equally to the work.
the Berkeley Arti cial Intelligence Research Lab Ca e Model Zoo1, Keras2 and
Wolfram Alpha3 containing a variety of architectures. However, these
repositories represent only a fraction of the already developed neural networks. An
overview of the neural networks implemented in practice is not given. With
this demo, we want to give the user the possibility to access and query
implemented neural networks. For this purpose, we make FAIRnets Search
available to search for neural networks in the FAIRnets dataset which is available at
https://zenodo.org/record/3228378. This dataset contains over 500 publicly
available neural networks under a license uploaded to GitHub. It is modeled in
RDF and uses the Neural Network Ontology for modeling the information which
is available at https://w3id.org/nno/ontology. These two resources are
described in a previous work [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] on representing neural networks according to the
FAIR guiding principles [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>Based on these two existing resources, we present in this work FAIRnets
Search, a search service to query, search and nd neural networks. The following
three use cases are covered by our demo:
{ Search for neural networks
{ Search for used datasets
{ Fine-grained Search by exploiting the SPARQL Endpoint.
2</p>
    </sec>
    <sec id="sec-2">
      <title>FAIRnets Search</title>
      <p>FAIRnets Search is a service provided by us to make neural networks searchable
and ndable. The service is available at the following URI http://km.aifb.
kit.edu/services/fairnets/. It represents an attempt to search for all neural
network architectures or neural network instances that ful ll speci c
requirements (e.g., used for speci c tasks, having a speci c architecture, etc.). For this
purpose, the Web service uses the FAIRnets dataset. This dataset currently
contains more than 500 neural networks. The FAIRnets dataset is modeled in RDF
and uses the Neural Network Ontology to structure the information. Figure 2
shows an overview of the framework. We collected neural networks from GitHub
and retrieved the information. The data is annotated using the Neural Network
Ontology and represented in RDF. For each of the neural networks in the
FAIRnets dataset, the relevant properties according to the Neural Network Ontology
such as the description and the architecture are stored. That way, the FAIRnets
dataset can be queried with a set of desired properties and responds with a set
of neural networks that have these properties with the SPARQL Endpoint. The
FAIRnets Search combines these implementations by a browser-based frontend
to the SPARQL endpoint.
1 https://github.com/BVLC/caffe/wiki/Model-Zoo, last accessed 2019-06-18
2 https://keras.io/applications/, last accessed 2019-06-18
3 https://resources.wolframcloud.com/NeuralNetRepository, last accessed
201906-18</p>
      <p>Reuse
Search Engine</p>
      <p>Link to GitHub</p>
      <p>Repository
Query in</p>
      <p>SPARQL
Transformation
into Ontology</p>
      <p>Neural Network</p>
      <p>Ontology
Data Extraction</p>
      <p>Annotation</p>
      <p>in RDF
Neural Network</p>
      <p>Repository</p>
      <p>Neural Networks</p>
      <p>in GitHub
The attendees of the demo will learn how FAIRnets Search can be used to
gain insights into the usage of existing neural networks and datasets in machine
learning. In the online demo, the users are encouraged to use the search engine to
nd and access neural network architectures. With the FAIRnets Search Demo
we will tackle the following three scenarios:
Search for Neural Networks. The FAIRnets Search engine allows users to
search keyword-based for neural networks. The FAIRnets dataset is searched
using SPARQL. Multiple keywords are supported in the search. The results are
sorted based on the number of hits counted, i.e. how often the keywords appear
in title and description. The attendee of the demo can, for example, search for
the terms image and classi cation and will get a list of neural networks that are
related to these terms (see Figure 2). Existing neural networks in this area can
thus easily be retrieved. Detailed information on the individual neural networks
can be accessed on the model sites of the neural network. Information such as the
publisher, links, architecture information and the latest update of the network
are provided and shown by our demo. The attendees of the demo can choose
based on the information and links provided by us if an already modeled neural
network ts their use case. We support the reusability of neural networks with
the FAIRnets Search Demo.</p>
      <p>Search for used datasets. Another use case is the usage of datasets. Attendees
of the demo can search for speci c datasets (e.g. search for mnist ). FAIRnets
Search lists neural networks that are related to the searched dataset. This gives
the attendees the possibility to nd out which neural network architectures have
been applied to a given dataset. Additional information such as the link to the
GitHub repository is available on the respective pages. This allows for getting
more information about the performance of the architectures on the datasets.
Besides identifying already applied neural network architectures on a given dataset,
the search can also be used to identify new datasets. This information is implicit
in the descriptions of neural networks. Searching for image classi cation lists all
available neural networks in this domain. In the description of the neural
network or on the corresponding GitHub repository page further information about
the used datasets for training can be found. This supports the attendees of the
demo to nd new datasets suitable for their use case.</p>
      <p>
        Fine-grained Search by exploiting the SPARQL Endpoint. Besides the
search functionality, we o er the attendees of the demo the possibility to post
individual SPARQL queries to the FAIRnets endpoint. We use YASGUI [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] to
display the results of the queries. The interface to the provided endpoint can be
accessed via the following link: https://km.aifb.kit.edu/services/fairnets/
sparql. The endpoint allows for answering individual requests upon the dataset.
We already o er some pre-selected SPARQL queries, such as a list of all neural
networks with a maximum number of layers (see gure 3) and an overview of
the frequencies of the activation functions used. Further ad-hoc requests during
the demo are welcome.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Conclusions</title>
      <p>This demo presents FAIRnets Search, a web service that allows users to query
for publicly available neural networks. FAIRnets Search allows for making neural
networks better ndable, searchable and accessible. Also, it allows for gaining a
better understanding of the used architectures of neural networks. In three use
cases, we allow the attendees for querying neural networks, nding the use cases
for datasets and analyzing the structure of neural networks.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Elsken</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Metzen</surname>
            ,
            <given-names>J.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hutter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Neural architecture search: A survey</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          <volume>20</volume>
          (
          <issue>55</issue>
          ),
          <volume>1</volume>
          {
          <fpage>21</fpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Nguyen</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weller</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sure-Vetter</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Making neural networks fair (</article-title>
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Rietveld</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoekstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>The YASGUI family of SPARQL clients</article-title>
          .
          <source>Semantic Web</source>
          <volume>8</volume>
          (
          <issue>3</issue>
          ),
          <volume>373</volume>
          {
          <fpage>383</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aalbersberg</surname>
            ,
            <given-names>I.J.</given-names>
          </string-name>
          , et al.:
          <article-title>The FAIR Guiding Principles for scienti c data management and stewardship</article-title>
          .
          <source>Scienti c Data</source>
          <volume>3</volume>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>