<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>DRETa: Extracting RDF from Wikitables</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Emir Mun~oz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Aidan Hogan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessandra Mileo</string-name>
          <email>alessandra.mileog@deri.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Digital Enterprise Research Institute, National University of Ireland</institution>
          ,
          <addr-line>Galway</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Tables are widely used in Wikipedia articles to display relational information { they are inherently concise and information rich. However, aside from info-boxe s, there are no automatic methods to exploit the integrated content of these tables. We thus present DRETa: a tool that uses DBpedia as a reference knowledge-base to extract RDF triples from generic Wikipedia tables.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Large amounts of data on the Web are presented in tables [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Interpreting and
extracting knowledge from HTML Web tables is thus relevant for many areas,
including: nance, public policy, user experience, health-care, and so forth.
However, such tables are diverse in terms of representation, structure and vocabulary
used; they often contain polysemous (or missing or otherwise vague) attribute
labels, ambiguous free-text cell content and referents, cell spanning multiple
rows and/or columns, split tables, obscured contextual validity, and so forth.
Recovering the semantics of generic Web tables is thus extremely challenging.
      </p>
      <p>Instead of interpreting generic Web tables, we have rather been focussing on
(partially) interpreting the tables embedded in Wikipedia (henceforth
\Wikitables"). In particular, we have created DRETa: a prototype for
(semi)automatically performing a best-e ort extraction of RDF triples from
Wikitables. Though many of the challenges remain the same, focussing on Wikitables
has a number of distinct advantages over the more general Web table scenario:
(1) Wikitable cells often contain links to Wikipedia articles that disambiguate
the entities being talked about; (2) Wikitables contain a high ratio of rich
encyclopaedic knowledge; (3) the context of a Wikitable can be mapped to the
article in which it appears; (4) existing RDF knowledge-bases, that o er partial
exports of Wikipedia content, can be used for reference and for mining legacy
entity URIs and predicates. To maximise the precision of the triples extracted
from Wikitables, DRETa exploits these unique advantages insofar as possible.</p>
      <p>
        The DRETa system works by using a suitable reference
knowledgebase|such as DBpedia [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], YAGO2 [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], Freebase [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], etc.|to extract
triples from Wikitables. We only consider tables embedded in article bodies
(class=wikitables in the HTML source), ltering info-boxes (already used by
DBpedia and YAGO2) and tables-of-content. Our prototype system|available
at http://deri-srvgal36.nuigalway.ie:8080/wikitables-demo-0.1.0/|
currently uses DBpedia as the reference knowledge-base. Thus, the RDF triples
extracted by DRETa from Wikipedia's tables use the same URIs as DBpedia
to identify entities (subject/object URIs) and relations (predicate URIs). Our
system can be seen as enriching the reference knowledge-base with additional
facts found in tables using the legacy relations from the knowledge-base itself.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Triple Extraction: A Motivating Example</title>
      <p>We sketch the extraction process by way of a real-world example. Figure 1
presents a Wikitable abridged from the \Manchester United F.C." Wikipedia
article, containing relations between players, their shirt number, country and
position. There are also relations between players and the entity described by
the article (their current club is Manchester United F.C.).</p>
      <p>Aside from the No. columns, the cells of the table contain hyperlinks to
other articles in Wikipedia, including countries, football positions, and
individual players. For example, the ags link to articles for the country; GK links to
the article for Goalkeeper (associated football). These links provide unambiguous
referents to Wikipedia entities, which can in turn be mapped directly to
DBpedia entities and descriptions. Currently, DRETa focuses on the extraction of
relations between cells containing wiki-links and does not consider plain-string
values. For example, it would not try to extract player numbers from the table.</p>
      <p>
        Previous works on extracting RDF from such tables (e.g., [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]) propose a
vertical, column-centric approach, where columns are seen as referring to types and/or
relations that can then be extended to all rows. We rather adopt a horizontal,
row-centric approach and look at the pre-existing relations between entities on
the same row. For example, if we nd that the predicate dbp:position holds
between dbr:David de Gea and dbr:Goalkeeper (association football) (GK),
we can suggest that the relation holds from all entities in the Player column to
all entities on the same row in the Position column. Similarly, we consider the
article in which the table is found to be a protagonist for the table. If we nd
the predicate dbo:team and dbp:currentclub holds from dbr:David de Gea
to dbr:Manchester United F.C., we can propose that the same relations hold
from all entities in the textsfPlayer column to the protagonist (the article
entity).
      </p>
      <p>Candidate triples that we extract are further associated with a number of
features to help classify them as correct/incorrect, associating each triple with
a con dence score. Details of the features are out-of-scope, but, for example, we
hypothesise that the more rows a given relation holds for across entities in two
xed columns in the reference KB, the higher the likelihood that that relationship
exists on all such rows. Other features, such as a match between the label of the
candidate relation and a column header, can further strengthen con dence in
the match. Using a selection of 750 random triples labelled by three judges, we
employed o ine various machine learning methods (SVM, Nave Bayes, Bagging
Decision Trees, Random Forest, Logistic) to train a range of binary classi ers
that are then made available to the DRETa system for classifying (in)correct
triples, and ultimately for ranking and ltering candidate triples at runtime.
3</p>
    </sec>
    <sec id="sec-3">
      <title>DRETa system description</title>
      <p>The current DRETa prototype works with DBpedia 3.8 and Wikipedia article
names (for auto-completion) as last updated in May 2013. The user submits a
Wikipedia article title (with the help of auto-complete) and optionally selects
a classi er. The extraction process is then as follows: i) the selected article
is downloaded and cached in memory for future queries; ii) all the tables are
extracted, repaired (as applicable), and ltered; iii) for each table, mappings
from wiki-links to KB entities are executed; iv) candidate relations for pairs of
resources are collected from the reference KB and candidate triples proposed;
v) the selected classi er is run to rank triples by con dence, vi) each candidate
triple is tested against the KB to determine if it is a pre-existing triple or not.</p>
      <p>Following our motivating example, Figure 2 presents DRETa's results for the
Wikipedia article \Manchester United F.C.". After ca. 11 secs. we get 457 RDF
triples extracted from tables contained in that article as a result. Some of these
triples already exist in DBpedia (rows with an DBpedia icon visible). Others are
novel: from the top-10 extracted triples sorted by con dence, for example, we
extract triples for the birth-places of the footballers Rafael da Silva (Brazil) and
Phil Jones (England), which were not previously known to DBpedia.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In this paper, we have presented DRETa: a prototype system for extracting RDF
triples from Wikipedia tables. The process maps entities in table cells to entities
in a reference knowledge-base and then looks for potential relations that hold
between entities on the same row across two given columns, or that hold between
entities in a single column and the article entity. Triples are associated with a
set of features that help classify correct/incorrect triples. A selection of machine
learning methods are used o ine to train classi ers, where these classi ers can
then be used to rank the con dence of triples. The prototype is available online
at http://deri-srvgal36.nuigalway.ie:8080/wikitables-demo-0.1.0/.</p>
      <p>We are currently investigating methods to perform a high-quality \bulk"
tripli cation of all tables in English Wikipedia. We have used the architecture
of DRETa to extract 22 million triples from over one million tables (all tables)
in English Wikipedia. We have already estimated a 52% precision measure for
the raw candidate triples extracted by our methods and our next steps are to
evaluate the extent to which machine learning techniques and di erent classi ers
improve this baseline precision by ltering incorrect triples at various thresholds,
and we will identify a gold standard to be able to estimate recall. We also wish
generalize our methods with YAGO2 and Freebase as reference knowledge-bases,
towards a more ambitious generalisation that employs entity-recognition tools
(instead of wiki-links) for processing generic Web tables.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kobilarov</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Becker</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hellmann</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>DBpedia { a crystallization point for the Web of Data</article-title>
          .
          <source>JWS</source>
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <volume>154</volume>
          {
          <fpage>165</fpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bollacker</surname>
            ,
            <given-names>K.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evans</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paritosh</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sturge</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , J.:
          <article-title>Freebase: a collaboratively created graph database for structuring human knowledge</article-title>
          . In: Wang,
          <string-name>
            <surname>J.T.L</surname>
          </string-name>
          . (ed.) SIGMOD Conference. pp.
          <volume>1247</volume>
          {
          <fpage>1250</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Cafarella</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halevy</surname>
            ,
            <given-names>A.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>D.Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , Zhang, Y.:
          <article-title>Webtables: exploring the power of tables on the web</article-title>
          .
          <source>PVLDB</source>
          <volume>1</volume>
          (
          <issue>1</issue>
          ),
          <volume>538</volume>
          {
          <fpage>549</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Ho</surname>
            <given-names>art</given-names>
          </string-name>
          , J.,
          <string-name>
            <surname>Suchanek</surname>
            ,
            <given-names>F.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berberich</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>YAGO2: A spatially and temporally enhanced knowledge base from Wikipedia</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>194</volume>
          ,
          <issue>28</issue>
          {
          <fpage>61</fpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Mulwad</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finin</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Syed</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Joshi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Using linked data to interpret tables</article-title>
          .
          <source>In: COLD Workshop (November</source>
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>