<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Rapid Explainability for Skill Description Learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Caglar Demir</string-name>
          <email>caglar.demir@upb.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anna Himmelhuber</string-name>
          <email>anna.himmelhuber@siemens.com</email>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yushan Liu</string-name>
          <email>yushan.liu@siemens.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander Bigerl</string-name>
          <email>alexander.bigerl@upb.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Diego Moussallem</string-name>
          <email>diego.moussallem@upb.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Axel-Cyrille Ngonga Ngomo</string-name>
          <email>axel.ngonga@upb.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ludwig Maximilian University of Munich</institution>
          ,
          <addr-line>Munich</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Paderborn University</institution>
          ,
          <addr-line>Paderborn</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Siemens AG</institution>
          ,
          <addr-line>Munich</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Technical University of Munich</institution>
          ,
          <addr-line>Munich</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We tackle the problem of learning the description of skills of machines within an Industry 4.0 setting using Class Expression Learning (CEL). CEL deals with learning description logic concepts from an RDF knowledge base and input examples. The goal is to learn a concept that covers all positive examples while not covering any negative examples. Although state-of-the-art models have been successfully applied to tackle this problem, their application at large scale, e.g., for skill learning, have been severely hindered due to their impractical runtimes. We report on the initial results of the RAKI project jointly carried out by Paderborn University, Leipzig University, and Siemens AG. We designed a framework to facilitate CEL on large industrial RDF knowledge bases. Our framework learns concepts significantly faster than state-of-the-art models. Our verbalisation approaches ensure that our framework yields interpretable results. Our framework is open-source to foster large-scale applications.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;skill description learning</kwd>
        <kwd>class expression learning</kwd>
        <kwd>description logics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>not utilizing parallelism. We hence rely on a framework that reduces the impractical runtimes of
classical CEL approaches so that CEL can be carried out on large RDF knowledge bases. The
framework includes a verbalisation module to decrease the amount of AI expertise necessary to
interpret results of CEL problems, e.g. predictions are interpretable even by novice practitioners.</p>
      <p>
        Solution: We designed the RAKI framework (https://github.com/dice-group/DRILL_RAKI)
is based on inductive logic programming, deep reinforcement learning and verbalisation modules.
We designed a model (DRILL) based on deep Q-Network model to significantly decrease the
impractical runtimes [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. This is achieved by replacing a fixed myopic heuristic function with a
learned Q-function that incorporates future considerations in immediate actions. In the RAKI
framework, knowledge graph embeddings can be easily learned to train DRILL [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. The
verbalisation module translates a learned class expression into sentences.
      </p>
      <p>Results &amp; Business value: The RAKI framework was evaluated on learning problems from
the skill description use case. The results show that our framework yields the best performance
with respect to accuracy and F1-score, and that it can also learn class expressions that describe
the positive and negative examples in the learning problem more precisely than state-of-the-art
baselines. In particular, the integration of domain knowledge by excluding previously defined
concepts leads to non-trivial and thus more useful class expressions. Especially the high scalability
of the framework allowed the calculation of results in a short time, while the second-fastest
baseline needed approximately 8 times as long on this use case. Moreover, the verbalization of the
class expressions to natural language made it easier for the plant operators to understand the skill
descriptions, facilitating the subsequent skill matching step. Automatizing the skill description
learning problem reduces personnel expenses since a skill description of a production module can
be learned without a domain expert. Moreover, the verbalisation module saves time of domain
experts, as learned descriptions can be interpreted easily. Importantly, the ability of tackling this
problem efficiently allows us to fully utilize large RDF knowledge bases 1.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Himmelhuber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Grimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Runkler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Zillner</surname>
          </string-name>
          ,
          <article-title>Ontology-based skill description learning for flexible production systems</article-title>
          ,
          <source>in: ETFA</source>
          <year>2020</year>
          , volume
          <volume>1</volume>
          , IEEE,
          <year>2020</year>
          , pp.
          <fpage>975</fpage>
          -
          <lpage>981</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Auer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Bühmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Tramp</surname>
          </string-name>
          ,
          <article-title>Class expression learning for ontology engineering</article-title>
          ,
          <source>Journal of Web Semantics</source>
          <volume>9</volume>
          (
          <year>2011</year>
          )
          <fpage>71</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Moussallem</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Gnaneshwar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. C.</given-names>
            <surname>Ferreira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-C. N.</given-names>
            <surname>Ngomo</surname>
          </string-name>
          ,
          <article-title>Nabu-multilingual graphbased neural rdf verbalizer</article-title>
          ,
          <source>in: ISWC</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>420</fpage>
          -
          <lpage>437</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A.</given-names>
            <surname>Holzinger</surname>
          </string-name>
          , G. Langs,
          <string-name>
            <given-names>H.</given-names>
            <surname>Denk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Zatloukal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Müller</surname>
          </string-name>
          ,
          <article-title>Causability and explainability of artificial intelligence in medicine</article-title>
          ,
          <source>Data Mining and Knowledge Discovery</source>
          <volume>9</volume>
          (
          <year>2019</year>
          )
          <article-title>e1312</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Demir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-C. N.</given-names>
            <surname>Ngomo</surname>
          </string-name>
          ,
          <article-title>Drill-deep reinforcement learning for refinement operators in alc</article-title>
          ,
          <source>arXiv preprint arXiv:2106.15373</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>C.</given-names>
            <surname>Demir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Moussallem</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Heindorf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-C. N.</given-names>
            <surname>Ngomo</surname>
          </string-name>
          ,
          <article-title>Convolutional hypercomplex embeddings for link prediction</article-title>
          ,
          <source>in: Asian Conference on Machine Learning</source>
          ,
          <year>2021</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>C.</given-names>
            <surname>Demir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-C. N.</given-names>
            <surname>Ngomo</surname>
          </string-name>
          ,
          <article-title>Hardware-agnostic computation for large-scale knowledge graph embeddings</article-title>
          ,
          <source>Software Impacts</source>
          <volume>13</volume>
          (
          <year>2022</year>
          )
          <fpage>100377</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <article-title>1This work has been supported by the BMWi-funded project RAKI (</article-title>
          <year>01MD19012D</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>