<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>XLore: A Large-scale English-Chinese Bilingual Knowledge Graph</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Zhigang Wangy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Juanzi Liy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zhichun Wangz</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Shuangjie Liy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mingyang Liy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dongsheng Zhangy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yao Shiy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yongbin Liuy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peng Zhangy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jie Tangy</string-name>
          <email>tangjieg@keg.cs.tsinghua.edu.cn</email>
        </contrib>
      </contrib-group>
      <abstract>
        <p>Current Wikipedia-based multilingual knowledge bases still suffer the following problems: (i) the scarcity of non-English knowledge, (ii) the noise in the semantic relations and (iii) the limited coverage of equivalent cross-lingual entities. In this demo, we present a large-scale bilingual knowledge graph named XLore, which has adequately solved the above problems.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>Multilingual knowledge bases are important for the globalization of knowledge
sharing. Knowledge bases such as DBpedia1, YAGO2, and BabelNet3 are
mainly built upon the multilingual Wikipedia. Some problems are to be addressed:
(i) The imbalanced sizes of different Wikipedia language versions lead to the
highly imbalanced knowledge distribution in different languages. Knowledge
encoded in non-English languages is much less than those in English. (ii) The
inconsistency of the large category system in Wikipedia causes incorrect
semantic relations between concepts that are defined based on categories. For
example, “Wikipedia-books-on-people is the subCategoryOf People” will lead to the
wrong “Wikipedia-books-on-people is subClassOf People” in DBpedia’s SKOS
schema. (iii) Integrated by directly using cross-lingual links in Wikipedia, the
amount of integrated multilingual knowledge totally depends on these existing
cross-lingual links.</p>
      <p>In this demo, we present an English-Chinese bilingual knowledge graph named
XLore to adequately solve the above problems. We use much larger
heterogenous online wikis to enrich the Chinese knowledge, utilize a classification-based
method to correctly semantify the wikis’ category systems, and employ a
crosslingual knowledge linking approach to find new cross-lingual links between
entities. Besides, we use a cross-lingual structured knowledge extraction method to
enrich the semantic relations.</p>
      <sec id="sec-1-1">
        <title>1 http://dbpedia.org/ 2 http://www.mpi-inf.mpg.de/yago-naga/yago/ 3 http://lcl.uniroma1.it/babelnet/</title>
        <p>To the best of our knowledge, XLore is the first large-scale cross-lingual
knowledge graph with balanced amount of Chinese-English knowledge. XLore
gives a new way for building such a knowledge graph across any two languages.
2</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Approach</title>
      <p>As shown in Figure 1, the building of XLore contains three stages: (1) Data
Preprocessing: First we collect and clean the data sets from four online wikis,
namely English Wikipedia, Chinese Wikipedia, Baidu Baike and Hudong Baike.
(2) Knowledge Graph Building : Next, we learn the cross-lingual ontology as
follows: semantify the online wikis to predict correct semantic relations, conduct
cross-lingual knowledge linking to integrate the heterogenous wikis together,
and extract the structured knowledge to enrich more relations in the graph.
(3) Knowledge Query: Finally, we construct an online system for knowledge
acquisition.</p>
      <p>Semantifying Online Wikis To semantify the online wikis, we are to
predict the correct subClassOf and instanceOf relations between two entities.
We view both the correct subClassOf and the instanceOf relations as is-a
relations. Table 1 shows some examples about the semantic relations.</p>
      <p>Entity 1 Relation Entity 2
European Microstates instanceOf Microstates</p>
      <p>European Microstates instanceOf Europe
教育人物(Educational Person) subClassOf 人物(Person)
教育人物(Educational Person) subClassOf 教育(Education)
Right or Wrong</p>
      <p>Right
Wrong
Right
Wrong</p>
      <p>Formally, we learn two series of functions g1 (for English) and g2 (for
Chinese) to predict the probabilities to be an is-a relation between two entities.
We define some literal and structural features and train the Logistic
Regression models. The most important features are the head words’ singular/plural
forms of English entities and the substring relationship between the labels of
Chinese entities. By iteratively expanding the training data sets, both the
functions achieve over 90.48% F1-score. To keep the semantic relatedness, we treat
the incorrect relations as the subTopicOf relations and import these relations
into the RDF database too.</p>
      <p>
        Cross-lingual Knowledge Linking via Concept Annotation To
integrate the knowledge in different languages, we proposed learning based
approaches for linking equivalent entities in different languages [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ][
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Several features are
defined based on the link structures in wikis to assess the similarities between
two different entities. Then learning models are trained based on the already
known cross-lingual links in Wikipedia, which afterward predict new
equivalent entity pairs. In order to find desired number of new cross-lingual links, we
use concept annotation to enrich the inner links within wikis, which improves
the knowledge linking approach considerably. The knowledge linking process as
a whole can execute iteratively, resulting in large number of new cross-lingual
links.
      </p>
      <p>
        Cross-lingual Structured Knowledge Extraction To enrich kinds of
relations in XLore, we apply our cross-lingual knowledge extraction framework
named WikiCiKE to complete the missing infoboxes [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. WikiCiKE is based on
the hypothesis: one can use the rich auxiliary (e.g. English) information to
assist the target (e.g. Chinese) infobox extraction. We treat this task as a transfer
learning-based binary classification problem. Given an attribute in the target
wiki, WikiCiKE automatically generates the cross-lingual training data and learns
the extractor using TrAdaBoost model. Finally, WikiCiKE uses the learned
extractor to extract the missing value from the unstructured article texts. Our
experiments in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] demonstrate that WikiCiKE significantly outperforms the
monolingual knowledge extraction method and the translation-based method.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>XLore System</title>
      <p>We construct a unified knowledge graph in the form of RDF and use the
OpenLink Virtuoso server4 for systematical data management. Using the proposed
approach, XLore harvests 856,146 classes , 71,596 properties and 7,854,301
instances across English and Chinese. Figure 2 gives a brief statistics the number
of linked entities from different online wikis.</p>
      <p>We also deploy an online system to illustrate our XLore. As shown in Figure 3,
the system supports the keyword-based or SPARQL queries, gives the statistical
information, offers visualization demonstrations, etc. A live demonstration of the
system can be found at http://www.youtube.com/watch?v=QKA-RYFfztA. We
invite the readers to try our XLore prototype at http://xlore.org.</p>
      <sec id="sec-3-1">
        <title>4 http://virtuoso.openlinksw.com/</title>
        <p>(a) Number of Linked Concepts
(b) Number of Linked Instances</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
          </string-name>
          , J.:
          <article-title>Cross-lingual knowledge linking across wiki knowledge bases</article-title>
          .
          <source>WWW'12</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
          </string-name>
          , J.:
          <article-title>Boosting cross-lingual knowledge linking via concept annotation</article-title>
          .
          <source>IJCAI'13</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
            , J.,
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Pan</surname>
          </string-name>
          , J.:
          <article-title>Transfer learning based cross-lingual knowledge extraction for wikipedia</article-title>
          .
          <source>ACL'13</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>