<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Rapid Explainability for Skill Description Learning</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Caglar</forename><surname>Demir</surname></persName>
							<email>caglar.demir@upb.de</email>
							<affiliation key="aff0">
								<orgName type="institution">Paderborn University</orgName>
								<address>
									<settlement>Paderborn</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Anna</forename><surname>Himmelhuber</surname></persName>
							<email>anna.himmelhuber@siemens.com</email>
							<affiliation key="aff1">
								<orgName type="institution">Siemens AG</orgName>
								<address>
									<settlement>Munich</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
							<affiliation key="aff2">
								<orgName type="institution">Technical University of Munich</orgName>
								<address>
									<settlement>Munich</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Yushan</forename><surname>Liu</surname></persName>
							<email>yushan.liu@siemens.com</email>
							<affiliation key="aff1">
								<orgName type="institution">Siemens AG</orgName>
								<address>
									<settlement>Munich</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
							<affiliation key="aff3">
								<orgName type="institution">Ludwig Maximilian University of Munich</orgName>
								<address>
									<settlement>Munich</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Alexander</forename><surname>Bigerl</surname></persName>
							<email>alexander.bigerl@upb.de</email>
							<affiliation key="aff0">
								<orgName type="institution">Paderborn University</orgName>
								<address>
									<settlement>Paderborn</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Diego</forename><surname>Moussallem</surname></persName>
							<email>diego.moussallem@upb.de</email>
							<affiliation key="aff0">
								<orgName type="institution">Paderborn University</orgName>
								<address>
									<settlement>Paderborn</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Axel-Cyrille</forename><surname>Ngonga</surname></persName>
							<email>axel.ngonga@upb.de</email>
							<affiliation key="aff0">
								<orgName type="institution">Paderborn University</orgName>
								<address>
									<settlement>Paderborn</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Rapid Explainability for Skill Description Learning</title>
					</analytic>
					<monogr>
						<idno type="ISSN">1613-0073</idno>
					</monogr>
					<idno type="MD5">F5587AFD57897AE783AF7C6EE7D156F0</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-25T03:14+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>skill description learning, class expression learning, description logics A. N. Ngomo) 0000-0001-8970-3850 (C. Demir)</term>
					<term>0000-0002-9617-1466 (A. Bigerl)</term>
					<term>0000-0002-9617-1466 (D. Moussallem)</term>
					<term>0000-0002-9617-1466 (A. N. Ngomo)</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>We tackle the problem of learning the description of skills of machines within an Industry 4.0 setting using Class Expression Learning (CEL). CEL deals with learning description logic concepts from an RDF knowledge base and input examples. The goal is to learn a concept that covers all positive examples while not covering any negative examples. Although state-of-the-art models have been successfully applied to tackle this problem, their application at large scale, e.g., for skill learning, have been severely hindered due to their impractical runtimes. We report on the initial results of the RAKI project jointly carried out by Paderborn University, Leipzig University, and Siemens AG. We designed a framework to facilitate CEL on large industrial RDF knowledge bases. Our framework learns concepts significantly faster than state-of-the-art models. Our verbalisation approaches ensure that our framework yields interpretable results. Our framework is open-source to foster large-scale applications.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>not utilizing parallelism. We hence rely on a framework that reduces the impractical runtimes of classical CEL approaches so that CEL can be carried out on large RDF knowledge bases. The framework includes a verbalisation module to decrease the amount of AI expertise necessary to interpret results of CEL problems, e.g. predictions are interpretable even by novice practitioners.</p><p>Solution: We designed the RAKI framework (https://github.com/dice-group/DRILL_RAKI) is based on inductive logic programming, deep reinforcement learning and verbalisation modules. We designed a model (DRILL) based on deep Q-Network model to significantly decrease the impractical runtimes <ref type="bibr" target="#b4">[5]</ref>. This is achieved by replacing a fixed myopic heuristic function with a learned Q-function that incorporates future considerations in immediate actions. In the RAKI framework, knowledge graph embeddings can be easily learned to train DRILL <ref type="bibr" target="#b5">[6,</ref><ref type="bibr" target="#b6">7]</ref>. The verbalisation module translates a learned class expression into sentences.</p><p>Results &amp; Business value: The RAKI framework was evaluated on learning problems from the skill description use case. The results show that our framework yields the best performance with respect to accuracy and F1-score, and that it can also learn class expressions that describe the positive and negative examples in the learning problem more precisely than state-of-the-art baselines. In particular, the integration of domain knowledge by excluding previously defined concepts leads to non-trivial and thus more useful class expressions. Especially the high scalability of the framework allowed the calculation of results in a short time, while the second-fastest baseline needed approximately 8 times as long on this use case. Moreover, the verbalization of the class expressions to natural language made it easier for the plant operators to understand the skill descriptions, facilitating the subsequent skill matching step. Automatizing the skill description learning problem reduces personnel expenses since a skill description of a production module can be learned without a domain expert. Moreover, the verbalisation module saves time of domain experts, as learned descriptions can be interpreted easily. Importantly, the ability of tackling this problem efficiently allows us to fully utilize large RDF knowledge bases<ref type="foot" target="#foot_0">1</ref> .</p></div>			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0">This work has been supported by the BMWi-funded project RAKI (01MD19012D).</note>
		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<analytic>
		<title level="a" type="main">Ontology-based skill description learning for flexible production systems</title>
		<author>
			<persName><forename type="first">A</forename><surname>Himmelhuber</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Grimm</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Runkler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Zillner</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">ETFA 2020</title>
				<imprint>
			<publisher>IEEE</publisher>
			<date type="published" when="2020">2020</date>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="page" from="975" to="981" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">Class expression learning for ontology engineering</title>
		<author>
			<persName><forename type="first">J</forename><surname>Lehmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Auer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Bühmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Tramp</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Web Semantics</title>
		<imprint>
			<biblScope unit="volume">9</biblScope>
			<biblScope unit="page" from="71" to="81" />
			<date type="published" when="2011">2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">Nabu-multilingual graphbased neural rdf verbalizer</title>
		<author>
			<persName><forename type="first">D</forename><surname>Moussallem</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Gnaneshwar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">C</forename><surname>Ferreira</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A.-C</forename><forename type="middle">N</forename><surname>Ngomo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">ISWC</title>
				<imprint>
			<date type="published" when="2020">2020</date>
			<biblScope unit="page" from="420" to="437" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">Causability and explainability of artificial intelligence in medicine</title>
		<author>
			<persName><forename type="first">A</forename><surname>Holzinger</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Langs</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Denk</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Zatloukal</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Müller</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Data Mining and Knowledge Discovery</title>
		<imprint>
			<biblScope unit="volume">9</biblScope>
			<biblScope unit="page">e1312</biblScope>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<monogr>
		<author>
			<persName><forename type="first">C</forename><surname>Demir</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A.-C</forename><forename type="middle">N</forename><surname>Ngomo</surname></persName>
		</author>
		<idno type="arXiv">arXiv:2106.15373</idno>
		<title level="m">Drill-deep reinforcement learning for refinement operators in alc</title>
				<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
	<note type="report_type">arXiv preprint</note>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">Convolutional hypercomplex embeddings for link prediction</title>
		<author>
			<persName><forename type="first">C</forename><surname>Demir</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Moussallem</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Heindorf</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A.-C</forename><forename type="middle">N</forename><surname>Ngomo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Asian Conference on Machine Learning</title>
				<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">Hardware-agnostic computation for large-scale knowledge graph embeddings</title>
		<author>
			<persName><forename type="first">C</forename><surname>Demir</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A.-C</forename><forename type="middle">N</forename><surname>Ngomo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Software Impacts</title>
		<imprint>
			<biblScope unit="volume">13</biblScope>
			<biblScope unit="page">100377</biblScope>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
