<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Mining the Web of Data with Metaqueries</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Francesca A. Lisi</string-name>
          <email>FrancescaAlessandra.Lisi@uniba.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dipartimento di Informatica &amp; Centro Interdipartimentale di Logica e Applicazioni (CILA) Universita` degli Studi di Bari “Aldo Moro”</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The Web of Data uses the World Wide Web (WWW) infrastructure to represent and interrelate data sources. These sources are referred to as knowledge graphs (KGs) and correspond to huge collections of facts in the form of RDF triples. The analysis of data contained in a KG is propaedeutic to several crucial KG curation tasks, notably the automated completion of the graph, which pose several challenges due to the open and distributed environment of the WWW infrastructure. However, KG mining could take advantage of some useful meta-information about the data to be analyzed, for instance, the schema of the KG when available. In this paper, we resort to the notion of a metaquery, proposed in the 90s as a template for patterns one is interested to discover in a relational database. We propose to extend this notion to the novel context of the Web of Data, in particular to the case of KG mining. A distinguishing feature of metaquerying problems is the use of a second-order logic language. In this paper, we present a metaquery language based on second-order Description Logics but implementable with standard technologies underlying the Web of Data, and briefly describe mechanisms for answering such metaqueries in the context of interest.</p>
      </abstract>
      <kwd-group>
        <kwd>Metaquerying</kwd>
        <kwd>Knowledge Graphs</kwd>
        <kwd>Rule Mining</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The current vision of the World Wide Web (WWW) is that of a Web of Data
(WoD), which highlights the central role of data in the WWW. More precisely,
the WoD builds upon the WWW infrastructure to represent and interrelate
data (aka Linked Data), with the aim of transforming the Web from a
distributed file system into a distributed database system. The foundational
standards of the WoD include the Uniform Resource Identifier (URI) and the
Resource Description Framework (RDF)1. The former is used to identify resources
whereas the latter is used to relate resources. In particular, RDF can be
considered as a data model according to which data is represented in the form of
triples hsubject predicate objecti. Huge collections of these triples can be then
organized into directed, labeled graphs known as knowledge graphs (KGs). A</p>
    </sec>
    <sec id="sec-2">
      <title>1 https://www.w3.org/RDF/</title>
      <p>
        typical case of a large KG is DBPedia,2 which, essentially, makes the content
of Wikipedia3 available in RDF and incorporates links to other datasets on the
Web, e.g., to Geonames4. An interesting point for the ILP community is that
RDF triples can be straightforwardly represented by means of unary and
binary first-order logic (FOL) predicates. More precisely, the unary predicates are
the objects of the RDF type predicate, while the binary ones correspond to all
other RDF predicates, e.g., halice type researcheri and hbob isM arriedT o alicei
from the KG in Fig. 1 refer to researcher(alice) and isM arriedT o(bob, alice)
respectively. KGs can be accessed by posing queries with the RDF query
language SPARQL5. Several entailment regimes are available for query answering
in SPARQL which are based on the existing link between RDF and the family
of Description Logics (DLs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>A distinguishing feature of KGs is their inherent incompleteness. Indeed, they
are constructed by automatically extracting available information from existing
Web information sources (see, e.g., the above mentioned case of DBPedia). The
curation of KGs is cumbersome due to their huge size. In particular, a major
activity aims at the completion of the KG in hand, in order to address the
issue of incompleteness. For instance, in link prediction, relational data mining
algorithms can be exploited to automatically build rules able to make predictions
on missing links. For example, the following rule
isM arriedT o(X, Y ), livesIn(X, Z) ⇒ livesIn(Y, Z)
(1)
can be mined from the KG in Fig. 1 and applied to derive new facts such as
livesIn(alice, berlin), livesIn(dave, chicago) and livesIn(lucy, amsterdam) to
be used for completing the graph. However, the extension of relational data</p>
    </sec>
    <sec id="sec-3">
      <title>2 http://wiki.dbpedia.org/ 3 https://www.wikipedia.org/ 4 http://www.geonames.org/ 5 https://www.w3.org/TR/sparql11-overview/</title>
      <p>
        mining to the WoD context is not straightforward. Indeed, being intrinsically
incomplete, KGs are naturally treated under the Open World Assumption (OWA)
as opposed to databases for which the Closed World Assumption (CWA) holds.
Nevertheless, KG mining algorithms could take advantage of some useful
metainformation about the KG in hand, e.g., domains, ranges and confidence values
of relations inside the KG (i.e., its schema). In this paper we resort to the notion
of a metaquery which was proposed in the 90s as a template that describes the
type of pattern one is interested to discover in a relational database [
        <xref ref-type="bibr" rid="ref14 ref2 ref3">14,2,3</xref>
        ]. A
common feature to metaquerying problems is the use of a second-order logic
language. For KG mining we devise a metaquery language based on second-order
DLs. A first step towards this direction of research was taken in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. In the
present paper we provide a more detailed description of the language (which
was only sketched in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]) and a preliminary analysis of the necessary steps for
answering metaqueries in the proposed language.
      </p>
      <p>The rest of the paper is structured as follows. Section 2 presents syntax and
semantics of the metaquery language. Section 3 briefly describes mechanisms for
answering metaqueries. Section 4 concludes the paper with final remarks and
directions of future work.
2</p>
      <sec id="sec-3-1">
        <title>A Metaquery Language for the Web of Data</title>
        <p>In our proposal for the WoD context, a metaquery is a second-order DL
conjunctive query. In the following we gently introduce the reader to this notion.
Syntax Let L be a DL language with syntax (NC, NR, NO) where NC, NR,
and NO are the alphabet of concept, role, and individual names, respectively.
Note that concepts and roles in the DL terminology correspond to classes and
properties in RDF.</p>
        <p>First, we consider the extension of L so that we can enable the formulation
of conjunctive queries (which go beyond the standard way of querying a DL
knowledge base). For this purpose, let VO be a countably infinite set of individual
variables disjoint from NC, NR, and NO. A term t is an element from VO ∪ NO.
Let c be a concept, r a role, and t, t′ terms.6 An atom is an expression which
can take three different forms: c(t), r(t, t′), or t ≈ t′. We refer to these three
kinds of atoms as concept atoms, role atoms, and equality atoms respectively. A
conjunctive query (CQ) of arity n is an expression of the form
q(X1, . . . , Xn) ← a1, . . . , am
(2)
where q, called the query predicate, does not belong to NC ∪ NR ∪ NO ∪ VO, every
Xi belongs to VO, every aj is a (possibly non-ground) atom, and all variables Xi
occur in some aj . The variables Xi are called the free variables (aka distinguished
variables) of the query, whereas the other variables appearing in a1, . . . , am are
6 In DLs concept and role names are usually capitalized. However, for the sake of
clarity, here we shall use capital letters only for variables.
called existential variables. A CQ is called Boolean if it has no free variable. An
example of CQ is the following
q(Y, Z) ← isM arriedT o(X, Y ), livesIn(X, Z), livesIn(Y, Z)
(3)
where Y and Z are the free variables, X is the existential one, and isM arriedT o(X, Y ),
livesIn(X, Z), livesIn(Y, Z) are role atoms.</p>
        <p>Since we are interested in second-order CQs, we need to introduce two further
sets of variables (of second-order this time): VC of so-called concept variables, i.e.
variables that can be quantified over NC, and VR of so-called role variables, i.e.
variables that can be quantified over NR. Let then MQ(L) be the second-order
DL language obtained by extending L with VC and VR. For the purpose of this
work, we can restrict MQ(L) to particular (second-order) CQs, e.g., involving
only role variables and individual variables. An example of one such metaquery
is the following</p>
        <p>M Q1 : mq(Q, Y, Z) ← P (X, Y ), Q(X, Z)
(4)
which looks for the properties (Q) holding for the individuals Y . Note that
P, Q ∈ VR whereas X, Y, Z ∈ VO Metaqueries are the starting point for the
definition of so-called metaquery extensions, i.e., implications of the form
(5)
(6)
(7)
(8)</p>
        <p>M Q1 → M Q2</p>
        <p>M Q1 ⇒ (M Q2 \ M Q1)
which are actually a compact representation of two metaqueries, M Q1 and M Q2,
where M Q2 is longer than - we say extends - M Q1. A shorter notation for (5)
is the following which stresses how M Q2 extends M Q1
The left-hand side and the right-hand side of (6) are called the body and the
head of the metaquery extension, respectively. Note that in the case of query
extensions, the head does not correspond to the conclusion (as with clauses).
Following the standard terminology, one should rather bear in mind the
unshortened notation, and call M Q2 the conclusion of the metaquery extension.
For instance, let us consider the following metaquery</p>
        <p>M Q2 : mq(Q, Y, Z) ← P (X, Y ), Q(X, Z), Q(Y, Z)
which looks for the properties (Q) holding for the individuals Y and shared with
the individuals X to which Y is related by some P . From (4) and (7) we can
build a metaquery extension as shown below</p>
        <p>P (X, Y ), Q(X, Z) ⇒ Q(Y, Z)</p>
        <p>
          Metaquery extensions serve as a template for rules we are interested in when
applying rule mining algorithms to a given KG.
Semantics As for the semantics of MQ(L), we plan to follow the Henkin style
[
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] for the following reasons. As opposed to the Standard Semantics, in the
Henkin semantics the expressive power of the language actually remains
firstorder. This is a desirable feature because it paves the way for the use of first-order
solvers in spite of the second-order syntax. Also, this is a shared feature with
RDF(S). Last, but not least, it makes possible an implementation with SPARQL.
        </p>
        <p>A few remarks are necessary here about the use of the symbol ⇒ in (1) and
(8). Differently from ←, it does not represent the logical implication. However, as
discussed in Sect. 3, it can be treated as such in contexts like the aforementioned
link prediction problem, provided that an appropriate choice of rule evaluation
measures is done.
3</p>
      </sec>
      <sec id="sec-3-2">
        <title>Answering Metaqueries in the Web of Data</title>
        <p>As said in the previous section, metaquery extensions are nothing but a
compact representation of two metaqueries. Therefore in this section we limit our
discussion to metaqueries.</p>
        <p>The process of answering a metaquery can be divided into two stages. In the
first stage, which we call the instantiation stage, we look for sets of concepts
and roles that match the pattern determined by the metaquery. In the second
stage, which we call the filtration stage, we filter out all the rules that match the
pattern of the metaquery but do not satisfy some predefined evaluation criteria.
Instantiation Instantiating a metaquery is similar to solving a Constraint
Satisfaction Problem (CSP) where one is interested in finding all solutions of the
CSP problem. The instantiation step is practically possible when the schema
of the KG in hand is available, which is not the case for every KG. Indeed the
schema provides the signature of the relations occuring in the KG, thus making
this step an informed search rather than a blind search. For instance, with
reference to the KG depicted in Fig. 1, (1) is an instantiation of (8) obtained by
substituting the role variables P and Q with the role names isM arriedT o and
livesIn, respectively.</p>
        <p>Filtration At this stage the rules like (1) obtained by instantiating the given
metaquery extension are evaluated according to some interestingness measures.
For instance, we could aim at filtering out rules with low support and confidence
values. In this case it is reasonable to compute confidence only for rules with
sufficient support.</p>
        <p>
          Following [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], the (absolute) support of a CQ Q in a KG G is the number of
distinct tuples in the answer of Q on G. The relative support of h(X , Y ) over G
is defined as follows:
supp(h(X, Y ), G) =
        </p>
        <p>
          #(X, Y ) : h(X, Y ) ∈ G
(#X : ∃Y h(X, Y ) ∈ G) ∗ (#Y : ∃X h(X, Y ) ∈ G)
(9)
The confidence of a rule w.r.t. G can be defined starting from (9). However, in
order to estimate the actual implication of the rule at hand, we could exploit
the rule evaluation measure called conviction [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. This choice is thus particularly
attractive for the KG completion task.
4
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>Conclusions and Future Work</title>
        <p>
          In this paper we have briefly presented a new approach to mining the Web of
Data. The approach adapts the notion of metaquery introduced by [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] for
relational data mining to the novel context of KG mining. The idea of considering
extensions of metaqueries is inspired by [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] in their seminal work on ILP for
association rule mining. However, differently from [
          <xref ref-type="bibr" rid="ref14 ref7">14,7</xref>
          ], our proposed metaquery
language is based on second-order DLs but can be implemented with standard
technologies of the Web of Data. The importance of metamodeling (of which
metaquerying is a special case) in several applications has been recently
recognized in the DL community. In particular, De Giacomo et al. [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] augment a DL
with variables that may be interpreted - in a Henkin semantics - as individuals,
concepts, and roles at the same time, obtaining a new logic Hi(DL). Colucci et
al. [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] introduce second-order features in DLs under Henkin semantics for
modeling several forms of non-standard reasoning. Lisi [
          <xref ref-type="bibr" rid="ref10 ref12">10,12</xref>
          ] extends [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] to some
variants of concept learning, thus being the first to propose higher-order DLs as
a means for metamodeling in data mining.
        </p>
        <p>
          In the KG community approaches for link prediction are divided into
statisticsbased (see [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] for an overview), and logic-based (e.g., [
          <xref ref-type="bibr" rid="ref15 ref8">8,15</xref>
          ]), which are the
closest to our work. The latter basically extend and adapt previous work in ILP on
relational association rule mining. However, they differ in the expressiveness of
the mined rules. AMIE+ [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] can mine only Horn rules, whereas the methodology
described in [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] can deal with the case of nonmonotonic rules.
        </p>
        <p>In the future, several aspects of the proposed approach should be clarified
before an implementation. First, we need to better define the semantics for the
proposed metaquery language, also concerning the link with SPARQL. Second,
we need to design algorithms for the instantiation stage and choose the most
appropriate evaluation measures for the intended application.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nardi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P</given-names>
          </string-name>
          . (eds.):
          <article-title>The Description Logic Handbook: Theory, Implementation and Applications (2nd ed</article-title>
          .). Cambridge University Press (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ben-Eliyahu-Zohary</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gudes</surname>
          </string-name>
          , E.:
          <article-title>Towards efficient metaquerying</article-title>
          . In: Dean,
          <string-name>
            <surname>T</surname>
          </string-name>
          . (ed.)
          <source>Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, IJCAI 99</source>
          , Stockholm, Sweden,
          <source>July 31 - August 6</source>
          ,
          <year>1999</year>
          . 2 Volumes, 1450 pages. pp.
          <fpage>800</fpage>
          -
          <lpage>805</lpage>
          . Morgan Kaufmann (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Ben-Eliyahu-Zohary</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gudes</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ianni</surname>
          </string-name>
          , G.:
          <article-title>Metaqueries: Semantics, complexity, and efficient algorithms</article-title>
          .
          <source>Artificial Intelligence</source>
          <volume>149</volume>
          (
          <issue>1</issue>
          ),
          <fpage>61</fpage>
          -
          <lpage>87</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Brin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motwani</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ullman</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsur</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Dynamic itemset counting and implication rules for market basket data</article-title>
          . In: Peckham,
          <string-name>
            <surname>J</surname>
          </string-name>
          . (ed.)
          <source>SIGMOD</source>
          <year>1997</year>
          ,
          <source>Proceedings ACM SIGMOD International Conference on Management of Data, May 13-15</source>
          ,
          <year>1997</year>
          , Tucson, Arizona, USA. pp.
          <fpage>255</fpage>
          -
          <lpage>264</lpage>
          . ACM Press (
          <year>1997</year>
          ). https://doi.org/10.1145/253260.253325
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Colucci</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Di Noia,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Di Sciascio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Donini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.M.</given-names>
            ,
            <surname>Ragone</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          :
          <article-title>A unified framework for non-standard reasoning services in description logics</article-title>
          . In: Coelho,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Studer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Wooldridge</surname>
          </string-name>
          , M. (eds.)
          <source>ECAI 2010 - 19th European Conference on Artificial Intelligence</source>
          , Lisbon, Portugal,
          <source>August 16-20</source>
          ,
          <year>2010</year>
          , Proceedings.
          <source>Frontiers in Artificial Intelligence and Applications</source>
          , vol.
          <volume>215</volume>
          , pp.
          <fpage>479</fpage>
          -
          <lpage>484</lpage>
          . IOS Press (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6. De Giacomo,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Lenzerini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Rosati</surname>
          </string-name>
          , R.:
          <article-title>Higher-order description logics for domain metamodeling</article-title>
          . In: Burgard,
          <string-name>
            <given-names>W.</given-names>
            ,
            <surname>Roth</surname>
          </string-name>
          ,
          <string-name>
            <surname>D</surname>
          </string-name>
          . (eds.)
          <source>Proceedings of the TwentyFifth AAAI Conference on Artificial Intelligence</source>
          ,
          <source>AAAI</source>
          <year>2011</year>
          , San Francisco, California, USA,
          <year>August</year>
          7-
          <issue>11</issue>
          ,
          <year>2011</year>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Dehaspe</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Raedt</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Mining Association Rules in Multiple Relations</article-title>
          . In: Lavraˇc, N.,
          <string-name>
            <surname>Dˇzeroski</surname>
          </string-name>
          , S. (eds.)
          <source>Inductive Logic Programming. Lecture Notes in Artificial Intelligence</source>
          , vol.
          <volume>1297</volume>
          , pp.
          <fpage>125</fpage>
          -
          <lpage>132</lpage>
          . Springer (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. Gala´rraga, L.,
          <string-name>
            <surname>Teflioudi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hose</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Suchanek</surname>
            ,
            <given-names>F.M.</given-names>
          </string-name>
          :
          <article-title>Fast rule mining in ontological knowledge bases with AMIE+</article-title>
          .
          <source>VLDB Journal</source>
          <volume>24</volume>
          (
          <issue>6</issue>
          ),
          <fpage>707</fpage>
          -
          <lpage>730</lpage>
          (
          <year>2015</year>
          ), https://doi.org/10.1007/s00778-015-0394-1
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Henkin</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Completeness in the theory of types</article-title>
          .
          <source>Journal of Symbolic Logic</source>
          <volume>15</volume>
          (
          <issue>2</issue>
          ),
          <fpage>81</fpage>
          -
          <lpage>91</lpage>
          (
          <year>1950</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Lisi</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          :
          <article-title>A declarative modeling language for concept learning in description logics</article-title>
          . In: Riguzzi,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Zelezny</surname>
          </string-name>
          ,
          <string-name>
            <surname>F</surname>
          </string-name>
          . (eds.)
          <article-title>Inductive Logic Programming</article-title>
          , 22nd International Conference, ILP 2012, Dubrovnik, Croatia,
          <source>September 17-19</source>
          ,
          <year>2012</year>
          ,
          <source>Revised Selected Papers. Lecture Notes in Computer Science</source>
          , vol.
          <volume>7842</volume>
          . Springer Berlin Heidelberg (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Lisi</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          :
          <article-title>Towards a metaquery language for mining the web of data</article-title>
          . In: Cal`ı,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Wood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.T.</given-names>
            ,
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.J.</given-names>
            ,
            <surname>Poulovassilis</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . (eds.) Data Analytics - 31st
          <source>British International Conference on Databases, BICOD</source>
          <year>2017</year>
          , London, UK,
          <source>July 10-12</source>
          ,
          <year>2017</year>
          ,
          <source>Proceedings. Lecture Notes in Computer Science</source>
          , vol.
          <volume>10365</volume>
          , pp.
          <fpage>90</fpage>
          -
          <lpage>93</lpage>
          . Springer (
          <year>2017</year>
          ). https://doi.org/10.1007/978-3-
          <fpage>319</fpage>
          -60795-5 8
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Lisi</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          :
          <article-title>A model+solver approach to concept learning</article-title>
          . In: Adorni,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Cagnoni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Gori</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Maratea</surname>
          </string-name>
          , M. (eds.)
          <source>AI*IA 2016: Advances in Artificial Intelligence - XVth International Conference of the Italian Association for Artificial Intelligence</source>
          , Genova, Italy,
          <source>November 29 - December 1</source>
          ,
          <year>2016</year>
          ,
          <source>Proceedings. Lecture Notes in Computer Science</source>
          , vol.
          <volume>10037</volume>
          , pp.
          <fpage>266</fpage>
          -
          <lpage>279</lpage>
          . Springer (
          <year>2016</year>
          ), https://doi.org/10.1007/978-3-
          <fpage>319</fpage>
          -49130-1 20
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Nickel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Murphy</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tresp</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabrilovich</surname>
          </string-name>
          , E.:
          <article-title>A review of relational machine learning for knowledge graphs</article-title>
          .
          <source>Proceedings of the IEEE</source>
          <volume>104</volume>
          (
          <issue>1</issue>
          ),
          <fpage>11</fpage>
          -
          <lpage>33</lpage>
          (
          <year>2016</year>
          ). https://doi.org/10.1109/JPROC.
          <year>2015</year>
          .2483592
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Shen</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ong</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mitbander</surname>
            ,
            <given-names>B.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zaniolo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Metaqueries for data mining</article-title>
          .
          <source>In: Advances in Knowledge Discovery and Data Mining</source>
          , pp.
          <fpage>375</fpage>
          -
          <lpage>398</lpage>
          . AAAI/MIT Press (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Tran</surname>
            ,
            <given-names>H.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stepanova</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gad-Elrab</surname>
            ,
            <given-names>M.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lisi</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>Towards nonmonotonic relational learning from knowledge graphs</article-title>
          . In: Cussens,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Russo</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . (eds.)
          <source>Inductive Logic Programming - 26th International Conference, ILP</source>
          <year>2016</year>
          , London, UK, September 4-
          <issue>6</issue>
          ,
          <year>2016</year>
          ,
          <source>Revised Selected Papers. Lecture Notes in Computer Science</source>
          , vol.
          <volume>10326</volume>
          , pp.
          <fpage>94</fpage>
          -
          <lpage>107</lpage>
          . Springer (
          <year>2017</year>
          ). https://doi.org/10.1007/978-3-
          <fpage>319</fpage>
          -63342-8 8
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>