<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Bayesian Ontology Reasoner is BORN!</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>İsmail İlkan Ceylan</string-name>
          <email>ceylan@tcs.inf.tu-dresden.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Julian Mendez</string-name>
          <email>mendez@tcs.inf.tu-dresden.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rafael Peñaloza</string-name>
          <email>rafael.penaloza@unibz.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>KRDB Research Centre, Free University of Bozen-Bolzano</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Theoretical Computer Science</institution>
          ,
          <addr-line>TU Dresden</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Bayesian ontology languages are a family of probabilistic ontology languages that allow to encode probabilistic information over the axioms of an ontology with the help of a Bayesian network. The Bayesian ontology language BEL is an extension of the lightweight Description Logic (DL) EL within the above-mentioned framework. We present the system BORN that implements the probabilistic subsumption problem for BEL.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>ontologies usually have rather small modules, even if the total size of the ontology
might be large.</p>
      <p>In this paper we describe the implementation of BORN,3 a Bayesian ontology
reasoner based on the ideas sketched above. Our first experiments show that
reasoning with this system is feasible.
2</p>
      <p>
        The Bayesian Ontology Language BEL
The Bayesian ontology language BEL is a probabilistic extension of the
lightweight DL EL [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], where probabilities are encoded using a Bayesian network [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
Formally, a Bayesian network (BN) is a pair B = (G; ), where G = (V; E) is
a finite directed acyclic graph (DAG) whose nodes represent Boolean random
variables, and contains, for every node x 2 V , a conditional probability
distribution PB(x j (x)) of x given its parents (x). Every BN B defines a unique
joint probability distribution (JPD) over V given by
      </p>
      <p>PB(V ) = Y PB(x j (x)):</p>
      <p>x2V</p>
      <p>As with classical DLs, the main building blocks in BEL are concepts, which
are syntactically built as EL concepts. In BEL, the domain knowledge is encoded
via probabilistic GCIs of the form hC v D : xi where (C v D) is an EL GCI
and x is either a literal4 over a fixed set of variables V or the empty set. A BEL
TBox is a finite set of probabilistic GCIs over V . A BEL KB is a pair (T ; B)
where T is a BEL TBox and B is a BN, both defined over V .</p>
      <p>A contextual interpretation is a pair (I; VI ) where I is an EL interpretation
and VI is a propositional interpretation. The contextual interpretation (I; VI )
satisfies hC v D : xi iff (i) VI 6j= x, or (ii) I j= C v D. It is a model of the TBox
T iff it is a model of all the probabilistic GCIs in T .</p>
      <p>Intuitively, axioms of the form hC v D : ;i represent crisp (or classical)
axioms. In this view, the DL EL is an instance of BEL where all axioms are of the
form hC v D : ;i. For brevity, we often write hC v Di to denote such axioms.</p>
      <p>The probabilistic information provided by the BN is handled via the so-called
multiple-world semantics. Briefly, a contextual interpretation describes a possible
world; by assigning a probabilistic distribution over these interpretations, we
describe the required probabilities, which should be consistent with the BN.
Definition 1. A probabilistic interpretation is a pair P = (I; PI), where I is a
set of contextual interpretations and PI is a probability distribution over I such
that PI(I) &gt; 0 only for finitely many interpretations I 2 I.</p>
      <p>P is a model of the TBox T if every I 2 I is a model of T . P is consistent
with the BN B if for every possible valuation W over V it holds that</p>
      <p>X PI(I; W) = PB(W):
(I;W)2I
3 Available under http://lat.inf.tu-dresden.de/systems/born
4 We point out that in the general case BEL allows for a set of literals.
P is a model of the KB (B; T ) iff it is a model of T and consistent with B.
The main reasoning problem in BEL is answering probabilistic subsumption
queries. In contrast to classical subsumption, in this case we are interested in
computing the probability with which a subsumption relation holds, as given by
the BN.</p>
      <p>Definition 2 (probabilistic subsumption). Let K be a BEL KB, and A; B
BEL concept names. The probability of the subsumption A v B w.r.t. the
probabilistic interpretation P = (I; PI) is</p>
      <p>PP (A v B) :=</p>
      <p>X
(I;W)2I;Ij=AvB</p>
      <p>PI(I; W):
The probability of A v B w.r.t. K is PK(A v B) := infPj=K PP (A v B):
We consider special restrictions over a BEL TBox T w.r.t. a valuation VI = W:</p>
      <p>TW := fhA v B : ;i j hA v B : xi 2 T ; W j= xg:
Intuitively, every valuation defines an EL TBox and to decide the probability of
a subsumption A v B it is enough to sum up the probabilities of the valuations
W for which the classical entailment relation TW j= A v B holds:
PK(A v B) =</p>
      <p>X
TW j=AvB</p>
      <p>
        PB(W):
Computing the probability of a subsumption query in BEL is shown to be
PP-complete [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] by a reduction to inference in BNs. We refer to [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ] for the
detailed definitions and proofs.
3
      </p>
    </sec>
    <sec id="sec-2">
      <title>BORN: System Overview</title>
      <p>
        BORN accepts a BEL KB (T ; B) and a subsumption query as input and
transforms the input into a probabilistic logic program. BORN is implemented on
top of jcel [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. It first normalizes the given BEL TBox T and then computes
a module of T w.r.t. the given query by making use of existing features of jcel.
Briefly, let T 0 T be two BEL TBoxes and let S be a signature. We say that
T 0 is a module of T w.r.t. the signature S if for every subsumption query q with
sig(q) S it holds that T j= q iff T 0 j= q. Intuitively a module T 0 is a minimal
subset of T containing all and only the relevant information w.r.t. a signature.
      </p>
      <p>BORN requires a BEL KB (T ; B) and a subsumption query as input. As an
answer, BORN returns the probability for the query to hold.</p>
      <p>Example 3. Consider the BEL KB K = (ABC; BABC) where</p>
      <p>ABC := f hA v 9r:B : x0i ; hA v C : x4i ; hB v 9s:C : :x3i ;</p>
      <p>hC u D v E : x5i ; h9r:B v D : :x2i ; hC v E : x3ig;
BABC is the BN given in Figure 1 and the subsumption query A v E. The relevant
computations yield PK(A v E) = 0:1796:
We use the functional syntax throughout the paper for the sake of legibility,
but all known OWL syntax paradigms are accepted by BORN. After performing
module extraction, all axioms are converted into a set of clauses. For instance,
the first axiom is rewritten as:
con('a'). con('b'). role('r').
subs('a', exists('r', 'b')) :- x0.</p>
      <p>Clearly, con, role and subs are reserved predicate names used to denote
concepts, roles and explicit subsumption relations. We assume that the BN and the
query use the ProbLog syntax, that is roughly the Prolog syntax enriched with
probabilistic annotations. A portion of the BN B from the Example 3 is then
given by
0.7::x0.
0.8::x1:-x0.
0::x1:-\+x0.
0.6::x2:-x0,x1.
0.1::x2:-x0,\+x1.
0.5::x2:-\+x0,x1.
0.9::x2:-\+x0,\+x1.
and the query from the Example 3 is given as query(sub('a', 'e')).</p>
      <p>
        We use an additional reserved symbol sub to represent all subsumption
relations and not only the explicit ones. This distinction is forced for optimization
reasons. Finally, we implement the deduction rules [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] for DL EL into the
probabilistic logic program ProbLog as follows:
sub(X, B) :- subs(X, B).
sub(X, B) :- subs(A, B), sub(X, A), con(X), con(A), con(B).
sub(X, B) :- subs(and(A1, A2), B), sub(X, A1), sub(X, A2),
      </p>
      <p>con(X), con(A1), con(A2), con(B).
sub(X, exists(R, B)) :- subs(A, exists(R, B)), sub(X, A),</p>
      <p>con(X), con(A), con(B), role(R).
sub(X, B) :- subs(exists(R, A), B), sub(X, exists(R, Y)), sub(Y, A),
con(X), con(Y), con(A), con(B), role(R).</p>
      <p>As an answer, BORN returns the subsumption relation with a probability value
attached to it: sub('a','e') : 0.1796</p>
      <p>
        The lack of Bayesian ontologies has led additional difficulties in evaluating
BORN. To show some initial results on BORN, we have created the artificial
ontologies listed in Table 1. DBPEDIA is adopted from http://trill.lamping.
unife.it/swish/ and GO is the Gene Ontology [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] annotated with literals. Each
terminology is paired with two randomly generated BNs of the same size. The
difference is in their independence assumptions, i.e. BO consists of independent
nodes, whereas BO0 is well-connected. Table 1 represents the relative sizes of
terminologies and BNs, where the former is measured in the number of axioms
and the latter in the number of nodes.
      </p>
      <p>We ran our experiments on a PC equipped with a 2,3 GHz Intel Core i7 with
8 GB of main memory and obtained feasible execution times for the limited
number of queries we have posed. Before moving to a detailed analysis, we stress
the fact that all of the results we present here are preliminary. To speak of a
general evaluation, there is still the need for further experiments with different
types of ontologies and a large number of queries.</p>
      <p>Performing module extraction prior to probabilistic inference turns out to be
a simple but effective approach. The idea is that a module is usually much smaller
than the original TBox. This is, of course, not always the case as evidenced by
the module sizes of ABC w.r.t. some queries given in Figure 2. However, for some
0:4
s
d
n
ceo 0:35
is
en
m
i
ton 0:3
itcexu
E 0:25 6
1
(ABC, BABC)
(ABC, BA0BC)
Preprocessing
(DBPEDIA, BDB)
(DBPEDIA, BD0B)
Preprocessing
6
2
4
3
Queries
2
4
1
5
0:45
0:4
0:35
real terminologies (e.g. GO) the size of a module turns out to be extremely small
compared to the original ontology. Notice that GO is very flat from its nature
and leads to really small module sizes.</p>
      <p>We report the module sizes (in the number of axioms), the total execution
times and the execution times for preprocessing in Figure 2. The delay in
preprocessing is mainly due to modularization, but preprocessings times remain rather
stable over different queries compared to the total execution time. This time is
below 1.4s even for GO, that consists of 23507 normalized axioms originally.</p>
      <p>As expected, the size and shape of the network influences the performance
greatly. We expect the number of the literals and the conditional dependencies to
be much smaller compared to the sizes of terminologies. Given these assumptions,
our initial experiments show that BORN is a promising tool for probabilistic
reasoning over DL ontologies.
4</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusions</title>
      <p>
        We have introduced the Bayesian Ontology reasoner BORN. To the best of our
knowledge BORN is the first Bayesian reasoner over DL ontologies based on
the multiple world semantics. Another probabilistic formalism is PR-OWL [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ],
which is based on a very different semantics. Closer to our semantics are the
lightweight Bayesian ontology languages [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] for which no implementation has
been provided yet. The closest existing system to BORN is the probabilistic DL
reasoner TRILL [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. However, TRILL forces independence of axioms.
      </p>
      <p>We plan to create realistic test data and evaluate BORN and generalize the
results to extensions of EL as well as to other DL-based ontology languages.
Additionally, we think that further optimizations are possible for BORN.
Ultimately, we plan to improve BORN to achieve a scalable probabilistic reasoner
over arbitrary Bayesian DL ontologies.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <article-title>Gene ontology: tool for the unification of biology. The Gene Ontology Consortium</article-title>
          .
          <source>Nature genetics 25(1)</source>
          ,
          <fpage>25</fpage>
          -
          <lpage>29</lpage>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brandt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Pushing the EL envelope</article-title>
          .
          <source>In: Proc. of IJCAI'05</source>
          . AAAI Press (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nardi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P.F</given-names>
          </string-name>
          . (eds.):
          <article-title>The Description Logic Handbook: Theory, Implementation, and Applications</article-title>
          . Cambridge University Press, 2nd edn. (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Brandt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Polynomial Time Reasoning in a Description Logic with Existential Restrictions, GCI Axioms, and-What Else?</article-title>
          <source>In: Proc. of ECAI'04</source>
          . pp.
          <fpage>298</fpage>
          -
          <lpage>302</lpage>
          . IOS Press (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ceylan</surname>
          </string-name>
          , İ.İ.,
          <string-name>
            <surname>Peñaloza</surname>
          </string-name>
          , R.:
          <article-title>Bayesian Description Logics</article-title>
          .
          <source>In: Proc. of DL'14. CEUR Workshop Proceedings</source>
          , vol.
          <volume>1193</volume>
          .
          <string-name>
            <surname>CEUR-WS</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ceylan</surname>
          </string-name>
          , İ.İ.,
          <string-name>
            <surname>Peñaloza</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>The Bayesian Description Logic BEL</article-title>
          .
          <source>In: Proc. of IJCAR'14. LNCS</source>
          , vol.
          <volume>8562</volume>
          , pp.
          <fpage>480</fpage>
          -
          <lpage>494</lpage>
          . Springer Verlag (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Ceylan</surname>
          </string-name>
          , İ.İ.,
          <string-name>
            <surname>Peñaloza</surname>
          </string-name>
          , R.:
          <article-title>Tight Complexity Bounds for Reasoning in the Description Logic BEL</article-title>
          .
          <source>In: Proc. of JELIA'14</source>
          . vol.
          <volume>8761</volume>
          , pp.
          <fpage>77</fpage>
          -
          <lpage>91</lpage>
          . Springer Verlag (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. da Costa,
          <string-name>
            <given-names>P.C.G.</given-names>
            ,
            <surname>Laskey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.B.</given-names>
            ,
            <surname>Laskey</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.J.:</surname>
          </string-name>
          <article-title>PR-OWL: A Bayesian Ontology Language for the Semantic Web</article-title>
          . In:
          <article-title>Uncertainty Reasoning for the Semantic Web I. LNCS</article-title>
          , vol.
          <volume>5327</volume>
          , pp.
          <fpage>88</fpage>
          -
          <lpage>107</lpage>
          . Springer Verlag (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>D</given-names>
            <surname>'Amato</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Fanizzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Lukasiewicz</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          :
          <article-title>Tractable Reasoning with Bayesian Description Logics</article-title>
          .
          <source>In: Proc. of SUM'08. LNCS</source>
          , vol.
          <volume>5291</volume>
          , pp.
          <fpage>146</fpage>
          -
          <lpage>159</lpage>
          . Springer Verlag (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Darwiche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Modeling and Reasoning with Bayesian Networks</article-title>
          . Cambridge University Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>De Raedt</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kimmig</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Toivonen</surname>
          </string-name>
          , H.:
          <article-title>ProbLog: A probabilistic prolog and its application in link discovery</article-title>
          .
          <source>In: Proc. of IJCAI'07</source>
          . AAAI Press (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Mendez</surname>
          </string-name>
          , J.:
          <article-title>jcel: A modular rule-based reasoner</article-title>
          .
          <source>In: Proc. of ORE'12. CEUR Workshop Proceedings</source>
          , vol.
          <volume>858</volume>
          .
          <string-name>
            <surname>CEUR-WS</surname>
          </string-name>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Renkens</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shterionov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , Van den Broeck, G.,
          <string-name>
            <surname>Vlasselaer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fierens</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meert</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janssens</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Raedt</surname>
          </string-name>
          , L.:
          <article-title>ProbLog2: From probabilistic programming to statistical relational learning</article-title>
          .
          <source>Proc. of NIPS'</source>
          12 pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Suntisrivaraporn</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Polynomial-Time Reasoning Support for Design and Maintenance of Large-Scale Biomedical Ontologies</article-title>
          .
          <source>Phd thesis</source>
          , TU Dresden, Germany (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Zese</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bellodi</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lamma</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>B</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.R.</given-names>
            ,
            <surname>Aguiari</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          :
          <article-title>Semantics and inference for probabilistic description logics</article-title>
          .
          <source>In: Uncertainty Reasoning for the Semantic Web III. LNCS</source>
          , vol.
          <volume>8816</volume>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>99</lpage>
          . Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>