<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Learning Ontologies with Epistemic Reasoning: The EL Case (Extended Abstract)</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Ana</forename><surname>Ozaki</surname></persName>
							<email>ana.ozaki@unibz.it</email>
							<affiliation key="aff0">
								<orgName type="department">KRDB Research Centre</orgName>
								<orgName type="institution">Free University of Bozen-Bolzano</orgName>
								<address>
									<country key="IT">Italy</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Nicolas</forename><surname>Troquard</surname></persName>
							<email>nicolas.troquard@unibz.it</email>
							<affiliation key="aff0">
								<orgName type="department">KRDB Research Centre</orgName>
								<orgName type="institution">Free University of Bozen-Bolzano</orgName>
								<address>
									<country key="IT">Italy</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Learning Ontologies with Epistemic Reasoning: The EL Case (Extended Abstract)</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">F4C9071829BE92478DC1AA019B106232</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-23T21:12+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<abstract/>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>This extended abstract gives an overview of the work presented in <ref type="bibr" target="#b7">[8]</ref>. We are interested in the formal and computational aspects of the problem of an agent learning from the knowledge of another agent, playing the role of a domain expert. In general, the raw knowledge of an agent is not directly accessible. In particular, the knowledge of an expert, the target domain of interest, cannot be duplicated as is and transferred to a learner. Nonetheless, agents can still learn from one another through questions and answers in a communication protocol. These acts of communication are expected to be simple.</p><p>A classical communication protocol from computational learning theory is based on questions of two types: membership and equivalence queries <ref type="bibr" target="#b0">[1]</ref>. In a learning from entailments setting <ref type="bibr" target="#b4">[5]</ref>, these questions can be described as follows. Membership queries correspond to asking whether a certain statement formulated as a logical sentence follows from the target. Equivalence queries correspond to asking whether a certain logical theory, called hypothesis, precisely describes the target. If there are wrong or missing statements in the hypothesis, a statement illustrating the imprecision should be returned to the agent playing the role of the learner. Arguably, equivalence queries are not in fact simple, and this is one of the main difficulties in implementing this protocol in practice <ref type="bibr">[7, page 297</ref>]. Whenever a learner poses an equivalence query, the expert playing the role of an oracle needs to evaluate the whole hypothesis and decide whether or not it is equivalent to the target. If not, then the oracle returns a statement in the logical difference between the hypothesis and the target.</p><p>One way out of this difficulty is hinted to us by a simple observation: during interactive communication among agents, not only domain knowledge is exchanged and acquired but also second-order knowledge, which is the knowledge of what is known by the other agents. We propose a new and more realistic learning model which takes into account what is known by the agents, either because a statement was explicitly communicated or because it is a logical consequence of previous statements given during their interaction. Our protocol is based on queries of two types. The first is an epistemic version of membership queries where the oracle 'remembers' those membership queries whose reply was 'yes'. We call the second type example queries. When asked an example query, the oracle answers a statement which follows from its knowledge but does not follow from its knowledge about what the learner knows. The oracle also 'remembers' that the statements given are now known by the learner.</p><p>Formally, each i ∈ A aims at learning a target formula l j ∈ L j of each other agent j = i ∈ A by posing them queries. A membership query to i asks an oracle </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>EPISTEMIC[MEM,EX]</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>⊂ EXACT[EQ]</head><p>[1] and <ref type="bibr" target="#b1">[2]</ref> ⊂ PAC Fig. <ref type="figure">1</ref>. Polynomial learnability. Each class denotes the set of frameworks that are polynomial query learnable in the corresponding learning model. MEM, EQ and EX stand for membership, equivalence, and example queries respectively.</p><p>MEM whether an example x ∈ X i is entailed by l i . An equivalence query to i asks an oracle EQ whether a formula h ∈ L i is equivalent to l i ; it returns yes if it is the case, or an counterexample in X i otherwise. Here, we introduce new kinds of queries. A K-membership query to i asks an oracle MEM K whether an example x ∈ X i is entailed by l i . When it is the case, the oracle MEM K also remembers that the learner j knows that x, adding K j x to its own knowledge. An example query to i requests the oracle EX to provide an example x that is entailed by l i but does such that K j x does not follow from the oracle's knowledge. An exact learning algorithm for a learning framework is a deterministic algorithm that takes no input, is allowed to make queries to MEM and EQ, and eventually halts and outputs some h ∈ L i , equivalent to l i . An epistemic learning algorithm is similar to an exact learning algorithm, except that it is only allowed to make queries to MEM K and EX. Polynomial time learnability means that there is an algorithm such that the time used is bounded by a polynomial in the size of the target and the largest counterexample seen so far. An analogous notion depending on the size and number of queries is used for polynomial query learnability <ref type="bibr" target="#b7">[8]</ref>.</p><p>We show that if a multi-agent learning framework is polynomial query (resp. time) epistemically learnable with only example queries then it is polynomial query (resp. time) exactly learnable with only equivalence queries; while the other direction does not hold. Example queries to EX are indeed less powerful than equivalence queries to EQ. Indeed, we show that if a multi-agent learning framework is polynomial query (resp. time) epistemically learnable with only example queries then it is polynomial query (resp. time) exactly learnable with only equivalence queries. This is summarized in Figure <ref type="figure">1</ref>, together with known results about the relationship between exact learning and PAC learning. We then instantiate our learning framework to EL. We prove that satisfiability of conjunctive formulas of EL extended with epistemic modal operators (called conjunctive ELK) is PTime-complete (see, <ref type="bibr" target="#b7">[8,</ref><ref type="bibr">Th. 5]</ref>). Conjunctive ELK captures the expressivity used in the epistemic learning model. Together with the results in Figure <ref type="figure">1</ref>, the PTime complexity of the satisfiability problem of conjunctive ELK demonstrates that epistemic learning is a reasonable substitute to the exact learning model in the EL case. Finally, we transfer known results <ref type="bibr" target="#b2">[3,</ref><ref type="bibr" target="#b3">4,</ref><ref type="bibr" target="#b5">6]</ref> for exact learnability of EL ontologies and its fragments to our learning model.</p></div>		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<analytic>
		<title level="a" type="main">Queries and concept learning</title>
		<author>
			<persName><forename type="first">D</forename><surname>Angluin</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Machine Learning</title>
		<imprint>
			<biblScope unit="volume">2</biblScope>
			<biblScope unit="issue">4</biblScope>
			<biblScope unit="page" from="319" to="342" />
			<date type="published" when="1988">1988</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">Separating distribution-free and mistake-bound learning models over the boolean domain</title>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">L</forename><surname>Blum</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">SIAM J. Comput</title>
		<imprint>
			<biblScope unit="volume">23</biblScope>
			<biblScope unit="issue">5</biblScope>
			<date type="published" when="1994">1994</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">Exact learning of EL ontologies</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">R C</forename><surname>Duarte</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Konev</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ozaki</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 31st International Workshop on Description Logics co-located with 16th International Conference on Principles of Knowledge Representation and Reasoning</title>
				<meeting>the 31st International Workshop on Description Logics co-located with 16th International Conference on Principles of Knowledge Representation and Reasoning<address><addrLine>KR</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">Exactlearner: A tool for exact learning of EL ontologies</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">R C</forename><surname>Duarte</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Konev</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ozaki</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Principles of Knowledge Representation and Reasoning: Proceedings of the Sixteenth International Conference</title>
				<imprint>
			<date type="published" when="2018">2018</date>
			<biblScope unit="page" from="409" to="414" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">Learning from entailment: An application to propositional Horn sentences</title>
		<author>
			<persName><forename type="first">M</forename><surname>Frazier</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Pitt</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">International Conference on Machine Learning, ICML</title>
				<imprint>
			<date type="published" when="1993">1993</date>
			<biblScope unit="page" from="120" to="127" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">Exact learning of lightweight description logic ontologies</title>
		<author>
			<persName><forename type="first">B</forename><surname>Konev</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Lutz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ozaki</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Wolter</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Machine Learning Research</title>
		<imprint>
			<biblScope unit="volume">18</biblScope>
			<biblScope unit="issue">201</biblScope>
			<biblScope unit="page" from="1" to="63" />
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<monogr>
		<title level="m" type="main">Foundations of Machine Learning</title>
		<author>
			<persName><forename type="first">M</forename><surname>Mohri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Rostamizadeh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Talwalkar</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2012">2012</date>
			<publisher>The MIT Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Learning Ontologies with Epistemic Reasoning: The EL Case</title>
		<author>
			<persName><forename type="first">A</forename><surname>Ozaki</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Troquard</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 16th European Conference on Logics in Artificial Intelligence (JELIA</title>
				<meeting>the 16th European Conference on Logics in Artificial Intelligence (JELIA</meeting>
		<imprint>
			<date type="published" when="2019">2019. 2019</date>
		</imprint>
	</monogr>
	<note>to appear</note>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
