<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Predicting Human Associations with Graph Patterns Learned from Linked Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jörn Hees</string-name>
          <email>joern.hees@dfki.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rouven Bauer</string-name>
          <email>rouven.bauer@dfki.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Joachim Folz</string-name>
          <email>joachim.folz@dfki.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Damian Borth</string-name>
          <email>damian.borth@dfki.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andreas Dengel</string-name>
          <email>andreas.dengel@dfki.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Science Department, University of Kaiserslautern</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Knowledge Management Department, DFKI GmbH</institution>
          ,
          <addr-line>Kaiserslautern</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The datasets provided by the Linked Data community currently form the world's largest, freely available, decentralised and interlinked knowledge bases. However, to be able to benefit from this knowledge in a specific use-case, one typically needs to understand the modelling of the knowledge and formulate appropriate SPARQL queries. In order to ease this process, we developed an evolutionary algorithm that learns such SPARQL queries (graph patterns) for pairwise relations between source and target entities. Given a training list of source-targetpairs, our algorithm learns a predictive model, which given a new source entity predicts target entities analogously to the training examples. In this demo paper we present a high level overview over our graph pattern learner and show its application to simulate human associations (e.g., “fish - water”). In the demo users can choose a semantic entity (e.g., dbr:Fish) as stimulus and let the learned model predict humanlike responses (e.g., dbr:Water).</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        In recent years, many large, machine accessible and interlinked RDF datasets
have emerged from the Semantic Web [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and its Linked Data [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] movement. The
datasets are prominently depicted as the LOD Cloud3 and form the currently
largest openly available representation of machine accessible knowledge. Due to
its encyclopaedic nature DBpedia4 [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] has become one of the most interlinked
and central datasets of the LOD Cloud.
      </p>
      <p>Despite the availability of all this knowledge, actually using it typically
requires non-trivial up-front work: SPARQL queries need to be formulated to
extract relevant knowledge for the given use-case.</p>
      <p>
        Hence, we developed a graph pattern learning algorithm [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] that can help
to learn such SPARQL queries. While several other systems exist that learn
SPARQL queries (e.g., AutoSPARQL [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], kretr [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]), they typically focus on
learning a single query for a simple list of entities. Our algorithm differs from these
3 http://lod-cloud.net/
4 http://dbpedia.org
      </p>
      <p>
New Data
?source
dbr:Fish
Training Data
d?bsro:Durocge d?btar:rCgaett
dbr:Summer dbr:Winter
.d.br:Paris .d.br:France
 ESnPdApRoQinLt</p>
      <p>New Data
?source
dbr:Fish</p>
      <p>Trained Model
Graph Patterns
Fusion Model
Graph Pattern</p>
      <p>Learner
Pattern Learner
Fusion Training
Trained Model
Graph Patterns
Fusion Model</p>
      <p>Application Phase
(Demo)
in two main aspects: (i) it learns an ensemble model that can (and will) consist
of many queries and (ii) it doesn’t try to learn queries that reproduce a given
list of entities, but it learns queries that represent a relation R between entity
source-target-pairs (s; t) 2 R. By learning queries for a relation between pairs of
entities, the graph pattern learner can generate a predictive model, that given a
new source entity s0 can predict targets ft0j(s0; t0) 2 Rg.</p>
      <p>In this demo paper we show one such predictive trained model that has been
generated by our graph pattern learner as detailed in the following sections.
2</p>
      <p>
        Graph Pattern Learner System Overview
5 Datasets available at http://w3id.org/associations/#datasets.
6 For further details, see set-up instructions at: https://joernhees.de/blog/2015/
11/23/setting-up-a-linked-data-mirror
7 See [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] for details on the training and evaluation.
      </p>
      <p>(a) Stimulus auto-complete input-box
(b) Fused Prediction Results
(c) Filtered graph patterns highlighting
those that generated the target dbr:</p>
      <p>Fishing
to an arbitrary source s0 (e.g. with a VALUES (?source) {(s0)} block). This results
in one list of target candidates per pattern that need to be ranked to yield the
set of predicted targets. The fusion training component uses several strategies
to generate (late) fusion models for this purpose.</p>
      <p>In order to fuse such resulting target-lists for a provided new source node, the
graph pattern learner includes a fusion training component that generates late
fusion machine learning models. The fusion models vary in complexity from
basic to full-fledged machine learning models themselves. For example, we provide
basic target-occurrence ranking over all queries (called “target occurrences”)
potentially normalised so that each pattern only has a total vote of 1 (called
“precisions”). As full machine learning models, we provide amongst others KNN, SVM,
Logistic Regression and RankSVM models estimating relevance based on target
candidate vectors wrt. the generating queries. In the demo the user can switch
between these fusion models with a simple drop-down as shown in Section 3.</p>
      <p>After training, the set of graph patterns and fusion model form a predictive
trained model that is used in the application phase. Given a new source node
(e.g. dbr:Fish) the trained model uses all learned graph patterns to issue SELECT
?target queries in which the ?source variable is bound to the new source node
against the SPARQL endpoint, and fuses the individual target result lists into
an overall ranked list of target predictions.
3</p>
    </sec>
    <sec id="sec-2">
      <title>Demo</title>
      <p>The main screen of our online demo8 starts with the stimulus auto-complete
input-box on top (Figure 2a) asking the user to enter a stimulus. The
auto8 https://w3id.org/associations/gp_learner/demo/predict.html
complete is realised via the Wikipedia OpenSearch API9, allowing a fuzzy search
for matching Wikipedia Articles, including the resolving of redirects.</p>
      <p>After selecting one of the Wikipedia articles from the auto-complete box, the
URI is transformed to the corresponding DBpedia resource and the prediction
started. The fused prediction results are then presented in the “Fused Prediction”
tab (Figure 2b), in which the user can provide feedback about the generated
targets (logged and used for future improvements). The user can also click the
explain button to gain insight on why a target was predicted. All graph patterns
that played a role in predicting this target will be highlighted and expanded in
the “Graph Patterns” tab (Figure 2c).
4</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>In this demo paper we presented a high level overview over the graph pattern
learner and show its application to simulate human associations. The algorithm,
used datasets and interactive visualisation of the results are available online.</p>
      <p>https://w3id.org/associations/gp_learner/demo/predict.html.
This work was supported by the University of Kaiserslautern CS PhD scholarship
program and the BMBF project MOM (Grant 01IW15002).
9 https://www.mediawiki.org/wiki/API:Opensearch</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lassila</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>The Semantic Web</article-title>
          .
          <source>Scientific American</source>
          <volume>284</volume>
          (
          <issue>5</issue>
          ),
          <fpage>34</fpage>
          -
          <lpage>43</lpage>
          (may
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heath</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Linked Data - The Story So Far</article-title>
          .
          <source>International Journal on Semantic Web and Information Systems</source>
          <volume>5</volume>
          (
          <issue>3</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>22</lpage>
          (jan
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kobilarov</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Becker</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hellmann</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>DBpedia - A crystallization point for the Web of Data</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <fpage>154</fpage>
          -
          <lpage>165</lpage>
          (sep
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Hees</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bauer</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Folz</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Borth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dengel</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>An Evolutionary Algorithm to Learn SPARQL Queries for Source-Target-Pairs. In: Knowledge Engineering and Knowledge Management - EKAW</article-title>
          <year>2016</year>
          . vol.
          <volume>10024</volume>
          , pp.
          <fpage>337</fpage>
          -
          <lpage>352</lpage>
          . Springer LNCS, Bologna, Italy (nov
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Hees</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bauer</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Folz</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Borth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dengel</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Edinburgh associative thesaurus as RDF and DBpedia mapping</article-title>
          .
          <source>In: The Semantic Web - ESWC 2016 SE</source>
          . vol.
          <volume>9989</volume>
          LNCS, pp.
          <fpage>17</fpage>
          -
          <lpage>20</lpage>
          . Springer LNCS, Heraklion, Crete, Greece (may
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kiss</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Armstrong</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Milroy</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piper</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An associative thesaurus of English and its computer analysis</article-title>
          .
          <source>In: The Computer and Literary Studies</source>
          , pp.
          <fpage>153</fpage>
          -
          <lpage>165</lpage>
          . Edinburgh University Press, Edinburgh, UK (
          <year>1973</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bühmann</surname>
          </string-name>
          , L.:
          <article-title>AutoSPARQL: Let users query your knowledge base</article-title>
          .
          <source>In: The Semantic Web: Research</source>
          and
          <string-name>
            <surname>Applications - ESWC</surname>
          </string-name>
          <year>2011</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>6643</volume>
          , pp.
          <fpage>63</fpage>
          -
          <lpage>79</lpage>
          . Springer, Heraklion, Crete, Greece (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Potoniec</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An On-Line Learning to Query System</article-title>
          .
          <source>In: Proc. of the ISWC 2016 Posters &amp; Demonstrations Track</source>
          . vol.
          <volume>1690</volume>
          . CEUR-WS.org, Kobe, Japan (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>