<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Everything is Connected: Using Linked Data for Multimedia Narration of Connections between Concepts?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Miel Vander Sande</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ruben Verborgh</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sam Coppens</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tom De Nies</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pedro Debevere</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Laurens De Vocht</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pieterjan De Potter</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Davy Van Deursen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Erik Mannens</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rik Van de Walle</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ghent University - IBBT Department of Electronics and Information Systems - Multimedia Lab Gaston Crommenlaan 8 bus 201</institution>
          ,
          <addr-line>B-9050 Ledeberg-Ghent</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper introduces a Linked Data application for automatically generating a story between two concepts in the Web of Data, based on formally described links. A path between two concepts is obtained by querying multiple linked open datasets; the path is then enriched with multimedia presentation material for each node in order to obtain a full multimedia presentation of the found path.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Interconnectedness is a major topic discussed in philosophy and physics,
stating that everything in the world is connected in some way. A
popular example is the Six degrees of Separation principle, introduced by S.
Milgram [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. It states that human networks grow in density despite the
big physical distances, resulting in a maximal connection of ve
acquaintances between two people in the whole world. Between academia, this
concept is often discussed for not being really scienti cally proven [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
However, with the Web of Data emerging, links between things become
well de ned and more known [
        <xref ref-type="bibr" rid="ref2 ref6">2</xref>
        ].
      </p>
      <p>This demonstration relies on Linked Data to illustrate the above
described principle (i.e. interconnectedness) by following
machine-processable links within today's Web of Linked Data. The presented application
will retrieve the connection (with intervening nodes) between two given
concepts. Next, for each resource corresponding to a node in the found
path, a media presentation is generated (e.g. use of a photo to illustrate
a person). Finally, the found path is narrated through a full multimedia
presentation, illustrating the intervening resources and their connections
(i.e. the links). The aim of this demo is therefore threefold:
{ bringing Linked Data closer to inexperienced users;
{ a practical test of the link quality in today's Web of Data;
{ investigate query/browse strategies for distributed path retrieval.</p>
    </sec>
    <sec id="sec-2">
      <title>The story between two concepts</title>
      <p>The goal of the demo is to automatically generate a story between two
concepts, based on formally described links. We obtain such a story in
three steps: path generation, node illustration, and path presentation.
2.1</p>
      <sec id="sec-2-1">
        <title>Path generation</title>
        <p>Path generation is based on querying Linked Data sources. In this demo,
we consider the following linked datasets to obtain a path: DBpedia,
Facebook, Freebase, Wiktionary, WordNet, CIA Factbook, Eurostat,
GeoNames, MusicBrainz, linkedMDB, and New York Times. DBpedia serves
as the interconnection hub between the other datasets; using Facebook
adds a personalized touch to the application. Note that we use standard
Named Entity and Disambiguation (NERD) techniques to link output
from the Open Graph Protocol to DBpedia resources. Also note that we
assume that the two input concepts (i.e. the start- and endpoint) are
located within our prede ned list of data sources.</p>
        <p>Since we do not want to load all our datasets into one RDF store for
scalability reasons, we introduce progressive parallel link browsing. The
latter tries to nd paths between two resources by combining the
following tasks:
(1) nd a path between the start resource and a DBpedia resource
(DBpedia start resource);
(2) nd a path between the end resource and a DBpedia resource
(DBpedia end resource);
(3) nd a path between the DBpedia start resource and the DBpedia
end resource (either inside DBpedia or via another dataset).
This approach enables parallel execution by making the rst task
independent from the last. Also, since the nodes in the path are discovered
sequentially, progressive playback is possible during discovery.
The choice of which links to follow is crucial in nding meaningful paths
for the end-user. Therefore, a property prioritization mechanism is
introduced. Certain properties (such as rdfs:seeAlso, foaf:primaryTopic,
dbpedia:wikiPageWikiLink) contain little semantics in order to explain
the link between two resources. Further, following rdf:type or dcterms:
subject might result in links that are too general (e.g. both resources are
owl:Things). However, when the type is speci c enough (e.g., Category:
FC_Bayern_Munich_players), it can be an interesting link. Therefore, a
priority list is needed indicating which properties and classes/categories
should be avoided during querying. Note that these `blacklists' might
still be used in fallback scenarios when the original attempt did not give
any result.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Node illustration</title>
        <p>Given a path between start and end resource, illustrations of the nodes
need to be found in order to enable a path presentation (see further).
These illustrations can be text, video, audio or images. A rst attempt
to provide a human-readable representation of a resource is to follow
your nose: lookup the RDF properties of the resources and search for
illustrative properties:
{ text: rdfs:label, dbpedia-owl:abstract, rdfs:comment, ...;
{ image: foaf:depiction, dbpprop:picture, lode:illustrate, ...;
{ video/audio: lode:illustrate, ...</p>
        <p>Alternatively, we use Web services to look up images (e.g. Flickr, Google
Images, Bing Images, ImageNet), videos (e.g. YouTube, Vimeo), and
audio (e.g. Grooveshark) to provide illustrative material for the resources.
2.3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Path presentation</title>
        <p>As a nal step, we present the retrieved path by means of a
multimedia presentation with voice over. This requires a uent narrated story,
assembled from two types of data: topic descriptions and links. Topic
descriptions are pieces of text fetched from certain RDF properties (see
previous section) and give a short summary about the current topic.
Links between nodes glue these pieces together into one story. However,
narrating links is more di cult, since there is no descriptive text
available. Di erent approaches are possible: from a simple display of the
property label (e.g. dbpedia-owl:birthDate becomes `has birth date') to a
property-speci c illustrator. The current version of the demo is limited
to the simple property label approach.</p>
        <p>Using the Acapela text-to-speech service1, we are able to provide a voice
over narrating the textual representation of nodes and links, making the
multimedia presentation complete.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Implementation</title>
      <p>The application runs on a classic client-server architecture where the
path generation step is executed on the server, while node illustration
and path presentation are performed at the client (i.e. in the browser).
A number of performance optimizations were implemented:
{ where possible, queries during the path generation are run in parallel;
{ when parts of a path are found, these are already send back to the
client;
{ the client will run the node illustration tasks in the background
(i.e. during presentation of the rst nodes, information about the
following nodes will be fetched).
4</p>
    </sec>
    <sec id="sec-4">
      <title>Example scenario</title>
      <p>In order to illustrate the idea, we will connect the dummy Facebook user
John Doe to Chicago. Using the Facebook Open Graph protocol, we nd
out that he likes David Guetta (ogp:userA ogp:likes dbpedia:David_
Guetta). By looking up dbpedia:David_Guetta, we nd his birthplace to
1 http://www.acapela-vaas.com
4
be Paris (dbpedia:David_Guetta dbpprop:birthPlace dbpedia:Paris).
We derive from this resource that it is the location of the Ei el tower
(dbpedia:Eiffel_Tower dbpedia-owl:location dbpedia:Paris). One
of the designers of the Ei el tower was Emile Nouguier who died in
189802-20 (dbpedia:Emile_Nouguier dbpedia-owl:significantBuilding
dbpedia:Eiffel_Tower; dbpprop:deathDate \1898-02-20"). The latter
is also the birthdate of Jimmy Yancey, who died in Chicago (dbpedia:
Jimmy_Yancey dbpprop:birthDate \1898-02-20"; dbpprop:deathPlace
dbpedia:Chicago.).</p>
      <p>A screencast of the Everything is Connected application is available at
http://youtu.be/FawygFT5Brs. In this screencast, we show the resulting
multimedia presentation for the above described example. Multimedia
content showed in this example comes from Google Images, Google Maps,
and YouTube.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Related Work</title>
      <p>
        Concerning path generation, some work is done in the eld of Social
Network search. Given the degrees of separation principle, [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] studies changes
made by today's popularity of social networks. New search techniques are
introduced to browse dynamic Internet-based graphs, resulting in better
memory-based search. Similar bidirectional search algorithms are
introduced, but only consider the narrow Twitter data domain.
In [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], West et al. perform a large scale study on human navigation
behaviour in Wikipedia. They examine the paths followed by users to get
from one topic to another, by listing all the visited topics in between.
From this extracted knowledge, a probabilistic model is derived for
predicting what users are looking for. For characterising the types of topics
a user will cross, a classi cation is introduced based on the connectedness
of a topic.
      </p>
      <p>For the Path presentation, QWiki2 produces similar output. However,
this tool is limited to turning any concept found on Wikipedia into a
automatically narrated multimedia presentation based on the Wikipedia
abstract.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Reza</given-names>
            <surname>Bakhshandeh</surname>
          </string-name>
          , Mehdi Samadi, Zohreh Azimifar, and
          <article-title>Jonathan Schae er. Degrees of separation in social networks</article-title>
          .
          <source>In SOCS</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Chris</given-names>
            <surname>Bizer</surname>
          </string-name>
          , Anja Jentzsch, and Richard Cyganiak.
          <article-title>State of the LOD Cloud</article-title>
          . http://www4.wiwiss.fu-berlin.de/lodcloud/state/.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Judith</given-names>
            <surname>Kleinfeld</surname>
          </string-name>
          .
          <source>Could It Be A Big World After All? The "Six Degrees of Separation" Myth. Society</source>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Jure</given-names>
            <surname>Leskovec</surname>
          </string-name>
          .
          <article-title>Human way nding in information networks</article-title>
          .
          <source>In In WWW-12</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Milgram</surname>
          </string-name>
          .
          <article-title>The small world problem</article-title>
          .
          <source>Psychology Today</source>
          ,
          <volume>61</volume>
          :
          <fpage>60</fpage>
          {
          <fpage>67</fpage>
          ,
          <year>1967</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <article-title>2 Example for the topic Gira e</article-title>
          - http://www.qwiki.com/q/Gira e
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>