<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualizing Semantic Table Annotations with TableMiner+</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Suvodeep Mazumdar</string-name>
          <email>s.mazumdar@sheffield.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ziqi Zhang</string-name>
          <email>ziqi.zhang@sheffield.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of She eld 211 Portobello</institution>
          ,
          <addr-line>She eld</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper describes an extension of the TableMiner+ system, an open source Semantic Table Interpretation system that annotates Web tables using Linked Data in an e ective and e cient approach. It adds a graphical user interface to TableMiner+, to facilitate the visualization and correction of automatically generated annotations. This makes TableMiner+ an ideal tool for the semi-automatic creation of high-quality semantic annotations on tabular data, which facilitates the publication of Linked Data on the Web.</p>
      </abstract>
      <kwd-group>
        <kwd>Web table</kwd>
        <kwd>Named Entity Disambiguation</kwd>
        <kwd>Semantic Table Interpretation</kwd>
        <kwd>table annotation</kwd>
        <kwd>Linked Data</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Recovering semantics from the growing amount of tabular data on the Web is
a crucial task in realizing the vision of the Semantic Web. Traditional search
engines perform poorly on such data, as they fail to recover the semantics of
tabular structures [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. Recent years have seen an increase in the research on
Semantic Table Interpretation [
        <xref ref-type="bibr" rid="ref1 ref2 ref4 ref5">1, 4, 2, 5</xref>
        ], which annotates relational tables using
schema and entities de ned in a reference knowledge base. The process (1) links
entity mentions in content cells to named entities; (2) annotates columns with
concepts if they contain entity mentions, or properties of concepts if they contain
data literals; and (3) identi es the semantic relations between columns.
      </p>
      <p>
        TableMiner+ [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] is such a method adopting an incremental, bootstrapping
approach that starts by creating preliminary and partial annotations of a table
using `sample' data, then using the outcome as `seed' to guide interpretation of
remaining contents. It has been implemented as open-source software (as part
of the STI library1), however, the system is lacking an intuitive user interface,
which has made it di cult to be used by an average person with limited technical
knowledge.
      </p>
      <p>This work implements a graphical user interface speci cally for TableMiner+,
to make it an easy-to-use tool for annotating Web tables using Linked Data, and</p>
      <sec id="sec-1-1">
        <title>1 https://github.com/ziqizhang/sti</title>
        <p>also extend it by enabling users to visualize and correct the generated
annotations and Linked Data triples. As a result, data publishers can use TableMiner+
for transforming tabular data on the Web into high-quality Linked Data, or
creating gold-standard for experiment purposes.
2</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Recent years have seen an increasing number of work on Semantic Table
Interpretation, such as Venetis et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] that uses a maximum likelihood model; Limaye
et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] that uses a joint inference model; Mulwad et al. [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] that uses joint
inference with semantic message passing; TableMiner [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and TableMiner+[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] that
adopt an bootstrapping approach starting by creating preliminary annotations
of a table using automatically selected `sample' data in the table, followed by a
message passing process that iteratively re nes the preliminary annotations to
create the nal optimal results. These methods di er in terms of the inference
models, features and background knowledge bases used. As discussed before,
existing tools remains di cult to use due to the lack of a user friendly interface.
3
      </p>
      <p>
        Description of the TableMiner+ Application Interface
We use the TableMiner+ implementation distributed as part of the STI library
as basis for this work. The STI library provides an implementation of the system
introduced in Zhang [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], and a few baseline systems. The library is implemented
in Java, and uses DBpedia as the knowledge base. Currently, a Web-based
interface consisting of two components are implemented: one that lets users to
de ne, con gure and start a table annotation task; and the other that lets users
to visualize and correct annotation results. In both cases, interaction is achieved
via a Web browser.
3.1
      </p>
      <sec id="sec-2-1">
        <title>Starting a table annotation process</title>
        <p>The interface for starting a Semantic Table Annotation task is illustrated in
Figure 3.1 (top)2. Users rstly select a Webpage containing relational tables that
are to be annotated. A preview of the Webpage is shown and the list of tables
potentially containing relational data is highlighted. The users then select the
tables they wish to annotate. They can also con gure the system to alter settings
such as feature weights and knowledge base query constraints. The users may
provide an email address to subscribe for automatic alert when the annotation
task completes. When the users are satis ed with the con guration and the
input, they click the button to start the task, which will create annotations in
JSON format. These will be interpreted and displayed using the visualization
component described below.</p>
        <sec id="sec-2-1-1">
          <title>2 Follow https://github.com/ziqizhang/sti/tree/master/ui for a demo and on how to</title>
          <p>use</p>
        </sec>
        <sec id="sec-2-1-2">
          <title>Visualizing Semantic Table Annotations with TableMiner+</title>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>Visualization and correction of annotations</title>
        <p>The JSON les are then passed onto the visualization component, which consists
of two interactive elements: an annotated table and a graph visualization module.</p>
        <p>The annotated table is the rst point of interaction with the user, and
presents the original table, annotated with the entities, concepts and relations
identi ed by TableMiner+. The rst step for the UI is to investigate the header
cells of the table - TableMiner+ creates a set of candidate concepts that best
describe the header and the data in the column. Each associated concept has a
score indicating the system's con dence. This set of candidate concepts is
presented as a dropdown with the scores (Figure 3.1 section B). Users can select
any of the concepts to indicate a more appropriate annotation by clicking on the
respective concept. Table cell annotations can be visualized in the same way. As
can be seen from the gure, some entities have already been recognized, while
some haven't. In case the user can provide a URI that is appropriate for any
missing annotation, this can be done by double clicking the relevant cell, which
will provide a prompt for a text input. Further SPARQL queries can be triggered
to the respective endpoints (based on the user customisations) that can identify
any missing annotations.</p>
        <p>The next aspect of the UI is the graph visualization, which is invoked from
the `inspect' button on the rst cell of each table row. As an example, the header
and it's relevant candidate concepts have been plotted as a graph in Figure 3.1.
Header cells are shown as nodes labelled with the header columns (0-3), while
the candidate classes are shown as nodes, linked with header elements. The
most relevant class is shown with a strong link, while the others are presented as
dashed lines. Clicking the dashed ones annotate the relevant header cell with the
respective concept, which will then con rm the change with a strong link (here,
a straight thick line). Header cells are also linked with each other with dashed
lines, which is interpreted as only an indicative relation. However, if TableMiner+
creates any relations between the columns, it is re ected as straight lines as can
be seen in Figure 3.1.</p>
        <p>The proposed demo will follow the process of identifying a web page,
downloading and extracting tables and then the annotation process itself. Finally,
the annotations will be visualized with the TableMiner+ UI, enabling users to
correct and provide any missing information.
4</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>This paper introduced a graphical user interface for TableMiner+ to facilitate the
semi-automatic creation of high quality Linked Data and annotations on Web
tables. Future work will extend the system to support, e.g., di erent knowledge
bases, other algorithms, ne-grained task de nition that enable batch processing
and zoning on tables (e.g., speci c columns).</p>
      <p>Acknowledgement Part of this work is funded by ADD PROJECT HERE.
We also thank the ADEQUATe3 project team under the lead of Dr Tomas Knap
for contributing valuable design ideas.</p>
      <sec id="sec-3-1">
        <title>3 http://www.adequate.at</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Girija</given-names>
            <surname>Limaye</surname>
          </string-name>
          , Sunita Sarawagi, and
          <string-name>
            <given-names>Soumen</given-names>
            <surname>Chakrabarti</surname>
          </string-name>
          .
          <article-title>Annotating and searching web tables using entities, types and relationships</article-title>
          .
          <source>Proceedings of the VLDB Endowment</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          -2):
          <volume>1338</volume>
          {
          <fpage>1347</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Varish</given-names>
            <surname>Mulwad</surname>
          </string-name>
          ,
          <string-name>
            <surname>Tim Finin</surname>
            , and
            <given-names>Anupam</given-names>
          </string-name>
          <string-name>
            <surname>Joshi</surname>
          </string-name>
          .
          <article-title>Semantic message passing for generating linked data from tables</article-title>
          .
          <source>In International Semantic Web Conference (1), Lecture Notes in Computer Science</source>
          , pages
          <volume>363</volume>
          {
          <fpage>378</fpage>
          . Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Petros</given-names>
            <surname>Venetis</surname>
          </string-name>
          , Alon Halevy, Jayant Madhavan, Marius Pasca, Warren Shen, Fei Wu, Gengxin Miao, and
          <string-name>
            <given-names>Chung</given-names>
            <surname>Wu</surname>
          </string-name>
          .
          <article-title>Recovering semantics of tables on the web</article-title>
          .
          <source>Proceedings of VLDB Endowment</source>
          ,
          <volume>4</volume>
          (
          <issue>9</issue>
          ):
          <volume>528</volume>
          {
          <fpage>538</fpage>
          ,
          <year>June 2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Jingjing</surname>
            <given-names>Wang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haixun</surname>
            <given-names>Wang</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Zhongyuan</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <surname>Kenny</surname>
            <given-names>Q.</given-names>
          </string-name>
          <string-name>
            <surname>Zhu</surname>
          </string-name>
          .
          <article-title>Understanding tables on the web</article-title>
          .
          <source>In Proceedings of the 31st international conference on Conceptual Modeling, ER'12</source>
          , pages
          <fpage>141</fpage>
          {
          <fpage>155</fpage>
          , Berlin, Heidelberg,
          <year>2012</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Ziqi</given-names>
            <surname>Zhang</surname>
          </string-name>
          .
          <article-title>Towards e ective and e cient semantic table interpretation</article-title>
          .
          <source>In Proceedings of the 13th International Semantic Web Conference</source>
          , pages
          <volume>487</volume>
          {
          <fpage>502</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Ziqi</given-names>
            <surname>Zhang</surname>
          </string-name>
          .
          <article-title>E ective and e cient semantic table interpretation using tableminer+</article-title>
          .
          <source>Semantic Web Journal</source>
          , under open review with Tracking:
          <fpage>1339</fpage>
          -
          <lpage>2551</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>