<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Strong Faithfulness for ELH Ontology Embeddings (Extended Abstract)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Victor Lacerda</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ana Ozaki</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ricardo Guimarães</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Bergen</institution>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Oslo</institution>
          ,
          <country country="NO">Norway</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present a region-based geometric model for embedding normalized ℰℒℋ ontologies into a continuous vector space and formally prove that normalized ℰℒℋ has the strong faithfulness property on convex geometric models. This means that there is an embedding that precisely captures the original ontology. We first prove the statement assuming (possibly) non-convex regions, and then impose convexity on the regions, showing that the property still holds.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Geometric Models</kwd>
        <kwd>Description Logics</kwd>
        <kwd>Knowledge Graph Embedding</kwd>
        <kwd>Faithfulness</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Knowledge Graphs (KGs) are a popular method for representing knowledge using triples of the form
(subject, predicate, object), called facts, corresponding to role assertions in DL ABoxes. Although KGs
contain a large number of facts, they are incomplete. This has sparked interest in using machine
learning methods to suggest plausible facts to add to the KG based on patterns found in the data using
KG embedding techniques, which aim to create representations of KGs in low-dimensional finite vector
spaces [
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4">1, 2, 3, 4</xref>
        ].
      </p>
      <p>
        Embeddings that consider TBoxes formulated in description logic are a more recent phenomenon, here
referred as ontology embeddings, where the ontology can have both facts and a TBox [
        <xref ref-type="bibr" rid="ref5 ref6 ref7 ref8">5, 6, 7, 8, 9, 10, 11</xref>
        ].
Ontology embeddings ofer advantages over traditional KGEs as they exploit the semantic relationships
between concepts and roles. One question that arises is how similar to the source ontology these
embeddings are, and, more strictly, whether the generated embeddings are guaranteed to precisely
represent the meaning of the source ontology and its entailments (of particular interest, the TBox
entailments), such that one can freely move from its classical set-theoretic interpretation to its geometric
one. This property is called the strong model faithfulness property [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. So far, no previous work for
ontology embeddings for fragments of ℰ ℒ++ has attempted to prove this property holds for their
embedding method, nor has its existence been formally proven for the ℰ ℒℋ language.
      </p>
      <p>We investigate whether ℰ ℒℋ has the strong faithfulness property over convex geometric models. We
ifrst prove the statement for embeddings in low dimensions, considering a region-based representation
for (possibly) non-convex regions. We investigate strong faithfulness on convex geometric models with a
number of dimensions connected to an ontology’s signature and domain. We do so including embeddings
for role inclusions, a problem that has not been well studied in the ℰ ℒℋ ontology embedding literature.
Additionally, we consider model checking in convex geometric models.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Preliminary Definitions</title>
      <p>
        Geometric models We go from the traditional model-theoretic interpretation of the ℰ ℒℋ description
logic to geometric interpretations, adapting definitions by Gutiérrez-Basulto and Schockaert [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and
      </p>
      <p>Bourgaux et al. [12]. Here we present the basic ingredients of the notion of a geometric interpretation.
The main idea of geometric models is that the sets on which we define our interpretation functions are
continuous vector spaces, and that the interpretation of concepts and roles are defined over geometric
regions.</p>
      <p>Definition 1 (Isomorphism Preserving Linear Maps). Let  be a natural number and  : R ×</p>
      <sec id="sec-2-1">
        <title>R2·  a fixed but arbitrary linear map satisfying the following:</title>
        <p>R ↦→</p>
        <sec id="sec-2-1-1">
          <title>1. the restriction of  to R × { 0} is injective;</title>
        </sec>
        <sec id="sec-2-1-2">
          <title>2. the restriction of  to {0} × R is injective;</title>
          <p>3.  (R × { 0}) ∩  ({0} × R) = {02· };
where 0 denotes the vector (0, ..., 0) with  zeros. For instance, the concatenation function is a linear
map that satisfies Points 1, 2, and 3.</p>
          <p>Definition 2 (Geometric Interpretation). Let  be an isomorphism preserving linear map and  a natural
number. An -dimensional  -geometric interpretation  of ( , ,  ) assigns to each  ∈  a
region  () ⊆ R, to each  ∈  a region  () ⊆ R2· , and to each  ∈  a vector  () ∈ R. We
have that  (⊥) := ∅,  (⊤) := R, and for arbitrary ℰ ℒℋ concepts:</p>
          <p>( ⊓ ) :=  () ∩  () and  (∃.) := { ∈ R | ∃ ∈  () with  (, ) ∈  ()}.
An -dimensional  -geometric interpretation  satisfies
• a concept assertion (), if  () ∈  (), a role assertion (, ), if  ( (),  ()) ∈  (),
• an ℰ ℒℋ instance query (IQ) (), if  () ∈  (),
• an ℰ ℒℋ CI  ⊑ , if  () ⊆  (), and an RI  ⊑ , if  () ⊆  ().</p>
          <p>
            We write  |=  if  satisfies an ℰ ℒℋ axiom  . A geometric interpretation satisfies an ontology ,
in symbols  |= , if it satisfies all axioms in . We define model faithfulness based on the work by [
            <xref ref-type="bibr" rid="ref7">7</xref>
            ].
Definition 3 (Faithfulness). Let  be a satisfiable ontology (or any other representation allowing the
distinction between IQs and TBox axioms). Given an -dimensional  -geometric interpretation  , we say
that:
•  is a strongly concept-faithful model of  if, for every concept  and individual name , if
 () ∈  () then  |= ();
•  is a strongly IQ-faithful model of  if it is strongly concept-faithful and for each role  and
individual names , : if  ( (),  ()) ∈  (), then  |= (, );
•  is a strongly TBox-faithful model of  if for all TBox axioms  : if  |=  , then  |=  .
          </p>
          <p>We say that an ontology language has the strong faithfulness property over a class of geometric
interpretations  if for every satisfiable ontology  in this language there is a geometric interpretation
in  that is both a strongly IQ-faithful and a strongly TBox-faithful model of .</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Strong Faithfulness on Convex Models</title>
      <p>
        We prove that normalized ℰ ℒℋ has the strong faithfulness property over a class of convex geometric
models. We introduce a new mapping  from the domain of a classical interpretation ℐ to a vector space
and a new geometric interpretation  ℐ based on this mapping. Our proofs now require us to fix the
isomorphism preserving linear map  used in the definition of geometric interpretations (Definition 2).
We choose the concatenation function, denoted ⊕ , as done in Gutiérrez-Basulto and Schockaert [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
The strategy for proving strong faithfulness for normalized ℰ ℒℋ requires us to (a) find a suitable
non-convex geometric interpretation for concepts and roles, and (b) show that the convex hull of the
region maintains the property.
and  ∈ :
Definition 4.
defining a new map  : ∆ ℐ ↦→ Rd, where d corresponds to | ()|+| ()|+|()|·| ∆ ℐ |. We assume,
      </p>
      <p>Let ℐ = (∆ ℐ , · ℐ ) be a classical ℰ ℒℋ interpretation, and  an ℰ ℒℋ ontology. We start by
without loss of generality, a fixed ordering in our indexing system for positions in vectors, where indices 0
to | ()| −</p>
      <p>1 correspond to the indices for individual names; | ()| to  = | ()| + | ()| − 1
correspond to the indices for concept names; and  to  + (|()| · | ∆ ℐ )
| − 1 correspond to the indices
for role names together with an element of ∆ ℐ . We write [], [], and [, ] to refer to the position in a
vector  corresponding to , , and  together with an element , respectively (according to our indexing
system). For example, [] = 0 means the value at the index corresponding to the individual name  is 0.
A vector is binary if  ∈ {0, 1}d. We define  using binary vectors. For all  ∈ ∆ ℐ ,  ∈  ,  ∈ 
•  ()[] = 1 if  = ℐ , otherwise  ()[] = 0,
•  ()[] = 1 if  ∈ ℐ , otherwise  ()[] = 0, and
•  ()[, ] = 1 if (, ) ∈ ℐ , otherwise  ()[, ] = 0.</p>
      <p>We introduce a definition for (possibly) non-convex geometric interpretations, using  .
Definition 5.
defined as:</p>
      <p>Let ℐ be a classical ℰ ℒℋ interpretation. The geometric interpretation of ℐ, denoted  ℐ , is
 ℐ () :=  (ℐ ), for all  ∈  ,
 ℐ () := { () |  ()[] = 1,  ∈ ∆ ℐ }, for all  ∈  ,
 ℐ () := { () ⊕  () |  ()[, ] = 1, ,  ∈ ∆ ℐ }, for all  ∈ .</p>
      <p>An intuitive way of thinking about our definition  is that it maps domain elements to a subset of
the vertex set of the d-dimensional unit hypercube, as in Fig. 1.
 ()[] = 1, and  ()[] = 0, while  ()[] = 0,  ()[] = 1, and  ()[] = 1.</p>
      <p>Example 1. Consider ,  ∈  and  ∈  . Let ℐ be an interpretation with ,  ∈ ∆ ℐ such that
 = ℐ ,  ∈ ℐ , and  ∈ ℐ ∩ ℐ . We illustrate  () and  () in Fig. 1. In symbols,  ()[] = 1,
Theorem 1. For all ℰ ℒℋ axioms  , ℐ |=  if</p>
      <p>ℐ |=  .</p>
      <p>The canonical models need to be finite because the definition of

ℐ uses vectors in a
finitelyifnite. The following holds for the canonical model just defined.
dimensional space whose dimension depends on the size of ∆  and . We then employ finite canonical
models for normalized ℰ ℒℋ since canonical models for arbitrary ℰ ℒℋ CIs are not guaranteed to be
Theorem 2. Let  be a normalized ℰ ℒℋ ontology. The following holds
• for all ℰ ℒℋ IQs and CIs  in normal form over sig(), ℐ |=  if  |=  ; and
• for all RIs  over sig(), ℐ |=  if  |=  .</p>
      <p>Theorem 3. Let  be an ℰ ℒℋ ontology and let ℐ be the canonical model of . The d-dimensional
(possibly non-convex) ⊕ -geometric interpretation  ℐ of ℐ is a strongly and IQ and TBox faithful model
of .</p>
      <p>Here, the vectors mapped by  and the regions given by the non-convex geometric interpretation  ℐ
are the anchor points for the convex closure of these sets. The geometric interpretation obtained by
taking the convex hull is denoted  ℐ* .</p>
      <p>Theorem 4. Let  ℐ be a geometric interpretation as in Definition 5. If  is an ℰ ℒℋ CI, an ℰ ℒℋ RI, or an
ℰ ℒℋ IQ in normal form then  ℐ |=  if  ℐ* |=  .</p>
      <p>Since normalized ℰ ℒℋ has a finite canonical model, we can take advantage of the previous theorem
to generalize it to arbitrary interpretations by applying it to the canonical ℐ of .
Theorem 5. Let  be a normalized ℰ ℒℋ ontology and let ℐ be the canonical model of . The
ddimensional convex ⊕ -geometric interpretation of ℐ is a strongly IQ and TBox faithful model of .
Corollary 6. Normalized ℰ ℒℋ has the strong faithful property over ⊕ -geometric interpretations.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgments</title>
      <p>Lacerda is supported by the Research Council of Norway, project number 316022, led by Ozaki.
[9] X. Peng, Z. Tang, M. Kulmanov, K. Niu, R. Hoehndorf, Description logic EL++ embeddings with
intersectional closure, CoRR abs/2202.14018 (2022). URL: https://arxiv.org/abs/2202.14018.
[10] S. Mondal, S. Bhatia, R. Mutharaju, Emel++: Embeddings for EL++ description logic, in: A. Martin,
K. Hinkelmann, H. Fill, A. Gerber, D. Lenat, R. Stolle, F. van Harmelen (Eds.), AAAI-MAKE, volume
2846 of CEUR Workshop Proceedings, CEUR-WS.org, ., 2021. URL: https://ceur-ws.org/Vol-2846/
paper19.pdf.
[11] C. d’Amato, N. F. Quatraro, N. Fanizzi, Injecting background knowledge into embedding models
for predictive tasks on knowledge graphs, in: R. Verborgh, K. Hose, H. Paulheim, P.-A. Champin,
M. Maleshkova, O. Corcho, P. Ristoski, M. Alam (Eds.), The Semantic Web, Springer International
Publishing, Cham, 2021, p. 441–457.
[12] C. Bourgaux, A. Ozaki, J. Z. Pan, Geometric models for (temporally) attributed description logics,
in: M. Homola, V. Ryzhikov, R. A. Schmidt (Eds.), DL, volume 2954 of CEUR Workshop Proceedings,
CEUR-WS.org, ., 2021. URL: https://ceur-ws.org/Vol-2954/paper-7.pdf.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bordes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Usunier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Garcia-Duran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Weston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Yakhnenko</surname>
          </string-name>
          ,
          <article-title>Translating embeddings for modeling multi-relational data</article-title>
          , in: C. J.
          <string-name>
            <surname>Burges</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Bottou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Welling</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Ghahramani</surname>
            ,
            <given-names>K. Q.</given-names>
          </string-name>
          <string-name>
            <surname>Weinberger</surname>
          </string-name>
          (Eds.),
          <source>Advances in Neural Information Processing Systems</source>
          , volume
          <volume>26</volume>
          ,
          <string-name>
            <surname>Curran</surname>
            <given-names>Associates</given-names>
          </string-name>
          , Inc., .,
          <year>2013</year>
          . URL: https://proceedings.neurips.cc/paper_files/paper/2013/file/ 1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Abboud</surname>
          </string-name>
          , I. Ceylan,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lukasiewicz</surname>
          </string-name>
          , T. Salvatori,
          <article-title>BoxE: A box embedding model for knowledge base completion</article-title>
          , in: H.
          <string-name>
            <surname>Larochelle</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Ranzato</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Hadsell</surname>
            ,
            <given-names>M. F.</given-names>
          </string-name>
          <string-name>
            <surname>Balcan</surname>
          </string-name>
          , H. Lin (Eds.),
          <source>Advances in Neural Information Processing Systems</source>
          , volume
          <volume>33</volume>
          ,
          <string-name>
            <surname>Curran</surname>
            <given-names>Associates</given-names>
          </string-name>
          , Inc., .,
          <year>2020</year>
          , p.
          <fpage>9649</fpage>
          -
          <lpage>9661</lpage>
          . URL: https://proceedings.neurips.cc/paper_files/paper/2020/file/ 6dbbe6abe5f14af882f977fc3f35501-Paper.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Pavlovic</surname>
          </string-name>
          , E. Sallinger,
          <article-title>ExpressivE: A spatio-functional embedding for knowledge graph completion</article-title>
          ,
          <source>in: The Eleventh International Conference on Learning Representations, ICLR</source>
          <year>2023</year>
          , Kigali, Rwanda, May 1-
          <issue>5</issue>
          ,
          <year>2023</year>
          , OpenReview.net,
          <year>2023</year>
          . URL: https://openreview.net/pdf?id=xkev3_
          <fpage>np08z</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>V.</given-names>
            <surname>Gutiérrez-Basulto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schockaert</surname>
          </string-name>
          ,
          <article-title>From knowledge graph embedding to ontology embedding? an analysis of the compatibility between vector space representations and rules</article-title>
          , in: M.
          <string-name>
            <surname>Thielscher</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Toni</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Wolter</surname>
          </string-name>
          (Eds.), KR, AAAI Press, .,
          <year>2018</year>
          , pp.
          <fpage>379</fpage>
          -
          <lpage>388</lpage>
          . URL: https://aaai.org/ocs/index.php/ KR/KR18/paper/view/18013.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>B.</given-names>
            <surname>Xiong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.-K. Tran</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Nayyeri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Staab</surname>
          </string-name>
          ,
          <article-title>Faithful embeddings for EL++ knowledge bases</article-title>
          ,
          <source>in: The Semantic Web - ISWC 2022</source>
          , Springer International Publishing, .,
          <year>2022</year>
          , pp.
          <fpage>22</fpage>
          -
          <lpage>38</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -19433-
          <issue>7</issue>
          _
          <fpage>2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Jackermeier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <article-title>Box2el: Concept and role box embeddings for the description logic EL++</article-title>
          ,
          <source>CoRR abs/2301</source>
          .11118 (
          <year>2023</year>
          ). URL: https://doi.org/10.48550/arXiv.2301.11118.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Ö. L.</given-names>
            <surname>Özçep</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Leemhuis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wolter</surname>
          </string-name>
          ,
          <article-title>Cone semantics for logics with negation</article-title>
          , in: C.
          <string-name>
            <surname>Bessiere</surname>
          </string-name>
          (Ed.), IJCAI, ijcai.org, .,
          <year>2020</year>
          , pp.
          <fpage>1820</fpage>
          -
          <lpage>1826</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>X.</given-names>
            <surname>Peng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kulmanov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Niu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Hoehndorf</surname>
          </string-name>
          ,
          <article-title>Description logic EL++ embeddings with intersectional closure</article-title>
          ,
          <source>CoRR abs/2202</source>
          .14018 (
          <year>2022</year>
          ). URL: https://arxiv.org/abs/2202.14018. arXiv:
          <volume>2202</volume>
          .
          <fpage>14018</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>