<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>CogNet2: A Multi-Level Frame Organized Knowledge Base Integrating Linguistic, World and Commonsense Knowledge</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Chenhao Wang</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Shaoru Guo</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zhitao He</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zhipeng Xue</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yubo Chen</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kang Liu</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jun Zhao</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Beijing Academy of Artificial Intelligence</institution>
          ,
          <addr-line>Beijing</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Artificial Intelligence, University of Chinese Academy of Sciences</institution>
          ,
          <addr-line>Beijing</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences</institution>
          ,
          <addr-line>Beijing</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper, we present CogNet2, an extension of the CogNet knowledge base, which combines the significant events form Wikidata, entities from YAGO4 and commonsense assertions from ATOMIC. It aims to unify knowledge of multiple levels of granularity. To eficiently integrate significant event and entity knowledge into CogNet, we construct significant event- and entity-centric frames, and then link them to the CogNet by automated labeling and crowd-sourced annotation. To enrich CogNet with more commonsense knowledge in social interaction, we construct frames with element restriction for fine-grained typical situations and integrate commonsense assertions about them. As a result, in comparison with CogNet1, CogNet2 increases 800+ new frames of significant events and entities, 30000+ new fine-grained frames with element restrictions, more than 204K new commonsense assertions. The scale of frame instances is up to 33.4M in total.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Knowledge Graph</kwd>
        <kwd>Commonsense Knowledge</kwd>
        <kwd>World Knowledge</kwd>
        <kwd>Linguistic Knowledge</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Recent years have seen a rise of large-scale knowledge bases (KBs): (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) linguistic knowledge such
as WordNet [1] and FrameNet [2] are mainly compiled by linguists to depict relations between
diferent semantic units (concept or frame); (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) world knowledge collects facts about the real
world, e.g., Wikidata [3] and DBpedia [4]; (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) commonsense knowledge aims to capture implicit
general facts and regular patterns in daily life, including ConceptNet [5] and ATOMIC [6].
      </p>
      <p>As data volume and variety have increased, it is challenging for systems to freely share
and use data across diferent sources. Unifying data from the greatest possible variety of
sources into a single data source has recently drawn growing attention from both academic
and industrial communities. YAGO [7] uses linguistic resources WordNet to organize world
knowledge from Wikipedia. FrameBase [8] integrates several world knowledge bases based
on the frames from FrameNet. CogNet (edition 1.0) 1 [9] further adopts a three-level unified
frame-styled representation architecture to bridge linguistic knowledge, world knowledge and
commonsense knowledge, with the aim of joint query and utilization. For example, world
knowledge of pacific war is represented as an instance of frame Hostile_encounter, and
commonsense knowledge assertion “buying book requires going to bookstore” is represented as
the relation between frame Commerce_buy and Motion with element restrictions.</p>
      <p>Although frame-styled representations enable CogNet to unify diferent kinds of knowledge,
current CogNet still has following limitations that can be further improved.</p>
      <p>Lacking specific frames to describe significant events . CogNet contains many
general frames to characterize events from the perspective of linguistics. For example, frame
Competition is utilized to describe the “sport” events at a high level. However, significant
“sport” events in world knowledge resources such as Wikidata are usually subdivided into
“running”, “cycling”, “ball game”, etc. Intuitively, dividing general frames into specific frames
will be better to describe the significant events.</p>
      <p>Neglecting entity-centric frames. CogNet mainly focuses on event-centric knowledge, but
neglects entity-centric semantic structures. For the event “Yao Ming won the FIBA Asia Cup MVP
Award in 2005”, CogNet has relevant frame Win_prize to describe this event, and takes entity
“Yao Ming” as one of its elements (i.e., Competitor). In fact, entity "Yao Ming" also has a frame
structure, including elements such as “name", “occupation” and “spouse”, which are critical for
semantic understanding but not well organized in CogNet.</p>
      <p>Lacking frames with element restrictions. Another important part of CogNet is
commonsense knowledge, which often describes the connections between fine-grained situations. For
example, “buying a bo− →o−− k−− − −  going to a bookstore” is a piece of commonsense
knowledge, where “going to a bookstore” and “buying a book” are fine-grained situations, which can be
described using specific frames with element restrictions. For example, “ buying a book” is a
specific version of Commerce_buy where the Goods element is restricted to “book” type. CogNet
has transformed event-related concepts from ConcpetNet into frame-with-element-restriction
(FER) representations to integrate commonsense knowledge, yet the coverage is still sparse.</p>
      <p>To address the aforementioned limitations, we propose CogNet2, a multi-level frame organized
knowledge base, which aims to extend CogNet with significant events from Wikidata, entities
from YAGO4 and commonsense assertions from ATOMIC.</p>
      <p>
        In summary, CogNet2 has three improvements as follows. (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) Structure. It increases specific
frames for significant events and entities. (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) Source. It incorporates two new knowledge
sources, YAGO4 and ATOMIC. (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) Scale. It consolidates a larger scale of world knowledge and
commonsense knowledge instances. Currently, CogNet2 increases 800+ new frames, 30000+
new frames with element restrictions and more than 204K new commonsense assertions, and
the scale of frame instances is up to 33.4M in total. The data and online demo is available at
http://cognet.top/v2/.
1In this paper, we use CogNet to refer the edition 1.0
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Method</title>
      <sec id="sec-2-1">
        <title>Knowledge Hierarchy We illustrate the</title>
        <p>kCnoogwNelet2dgine Fihgiuerrear1c.hFyramanesd codnasttaitumteotdheelfirstof Frame frame:Event frame:Entity
ltaaykeert(htheefrtaompmesosftrodmottFerdabmoexN)eint tahsethfiguerhei.gWheer- frame:Hiring H.a..s..E.lemferna.tm....e.:Building frame:R...o..a.dways
level types, which are connected with their el- fe:Agent fe:Time
ements and definition texts. We take the lexi- fe:Created_entity frame:Roadways.bridge.n
cal units and the extended specific frames from Frame with Element Restriciton (FER)
Wikidata and YAGO4 as the lower-level types
(hatched rectangle). Those frames constitute the fer:hiring_peoplepp:xNeed fer:build_bgripd:gCereated_entity
taxonomy of CogNet2. The second layer (the bridge
middle dotted box) in the figure consists of the
“frame with element restriction (FER)” nodes, "Joseph Strauss" fi:0f429c88
which are fine-grained frames that has type re- fi:E2712645 fe:Agent
strictions on some elements. We connect FER Frame Instance (FI)
nodes with their restriction statements, and
represent commonsense knowledge assertions as Figure 1: Illustration of the Data Model.
relations between FER nodes. At the third layer
(the bottom dotted box), the frame instances record world knowledge about specific events or
entities.</p>
        <p>fi:E546383
"Golden Gate Bridge"
fe:Created_entity
fe:Time
"1937"</p>
      </sec>
      <sec id="sec-2-2">
        <title>Significant Event-Centric Frame Construction We collect specific frames about significant</title>
        <p>events from Wikidata to elaborate the general frames in FrameNet. We select event classes
that have more than 10 direct instances as specific frames, and link specific frames regarding
to significant events to the corresponding general frames with automated labeling and
crowdsourced annotation. Finally, we extract event instances from Wikidata based on SPARQL rules,
and link them to corresponding specific frames.</p>
        <p>Entity-Centric Frame Construction CogNet usually takes entities as elements in an
eventcentric frame. We utilize YAGO schema to form the entity-centric frames where schema names
are frame names and properties are frame elements. Then human annotators link entity-centric
frames to CogNet. Finally,we enrich CogNet with entity instances from YAGO4 based on
SPARQL rules.</p>
        <p>Incorporating Commonsense Knowledge we consolidate CogNet with ATOMIC to enrich
more fine-grained situations and corresponding social commonsense knowledge. Since the nodes
in ATOMIC are freely expressed in natural language phrases, we first normalize the phrases to
remove duplicates, and then ask human workers to conduct frame semantics annotation, which
assigns each phrase with its frame type and elements. Finally, we use the annotation results to
construct FER nodes and automatically link them with frame instances.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Online Platform</title>
      <p>We provide an online platform to facilitate the query of CogNet2 (http://cognet.top/v2/) . The
data of CogNet2 are downloadable in RDF turtle format (under a CC-BY-SA 4.0 license) and can
be query with the online SPARQL service. In addition, we also provide a convenient browser. It
provides an easy-to-use key word query engine to access frames and instances. Each frame,
FER or frame instance has a corresponding information page to show their descriptions and
connections to other nodes. Besides, the platform enables to explore the knowledge taxonomy
from the top to bottom, traversing from abstract frames to concrete instances.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Related Work</title>
      <p>There are continuous eforts to integrate diferent linguistic knowledge resources [ 10, 11, 12],
commonsense knowledge resources CSKG [13]. And bridging knowledge resources at diferent
abstraction levels [7, 8]. Inspired by previous work, CogNet [9] explored to utilize semantic
frames to combine commonsense knowledge and world knowledge. To improve its coverage and
granularity, this paper further enriches semantic frames with significant and fine-grained event
and entity types from more sources, making better integration of diferent kinds of knowledge.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This work is supported by the National Key Research and Development Program of China (No.
2020AAA0106400), the National Natural Science Foundation of China (No. 61976211, 62176257
). This work is also supported by the Strategic Priority Research Program of Chinese Academy
of Sciences (Grant No.XDA27020100 ), the Youth Innovation Promotion Association CAS, and
Yunnan Provincial Major Science and Technology Special Plan Projects (No.202202AD080004).
[5] R. Speer, J. Chin, C. Havasi, Conceptnet 5.5: An open multilingual graph of general
knowledge, in: Proceedings of the AAAI conference on artificial intelligence, 2017. URL:
https://ojs.aaai.org/index.php/AAAI/article/view/11164.
[6] M. Sap, R. Le Bras, E. Allaway, C. Bhagavatula, N. Lourie, H. Rashkin, B. Roof, N. A.</p>
      <p>Smith, Y. Choi, Atomic: An atlas of machine commonsense for if-then reasoning, in:
Proceedings of the AAAI conference on artificial intelligence, 01, 2019, pp. 3027–3035.</p>
      <p>URL: https://ojs.aaai.org/index.php/AAAI/article/view/4160.
[7] M. Fabian, K. Gjergji, W. Gerhard, et al., Yago: A core of semantic knowledge unifying
wordnet and wikipedia, in: Proceedings of the 16th International World Wide Web, 2007,
pp. 697–706. URL: https://www2007.org/papers/paper391.pdf.
[8] J. Rouces, G. de Melo, K. Hose, Framebase: Representing n-ary relations using semantic
frames, in: Proceedings of the Semantic Web. Latest Advances and New Domains, 2015,
pp. 505–521. doi:10.1007/978-3-319-18818-8_31.
[9] C. Wang, Y. Chen, Z. Xue, Y. Zhou, J. Zhao, Cognet: Bridging linguistic knowledge, world
knowledge and commonsense knowledge, in: Proceedings of the AAAI Conference on
Artificial Intelligence, 2021, pp. 16114–16116. URL: https://ojs.aaai.org/index.php/AAAI/
article/view/18029.
[10] M. L. De Lacalle, E. Laparra, G. Rigau, Predicate Matrix: extending SemLink through
WordNet mappings, in: Proceedings of the Ninth International Conference on Language
Resources and Evaluation, 2014, pp. 903–909. URL: http://www.lrec-conf.org/proceedings/
lrec2014/pdf/589_Paper.pdf.
[11] F. Corcoglioniti, M. Rospocher, A. P. Aprosio, S. Tonelli, PreMOn: a Lemon Extension
for Exposing Predicate Models as Linked Data, in: N. Calzolari, K. Choukri, T. Declerck,
S. Goggi, M. Grobelnik, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, S. Piperidis
(Eds.), Proceedings of the Tenth International Conference on Language Resources and
Evaluation, 2016, pp. 877–884. URL: https://aclanthology.org/L16-1141.
[12] A. Gangemi, M. Alam, L. Asprino, V. Presutti, D. R. Recupero, Framester: A Wide Coverage
Linguistic Linked Data Hub, in: E. Blomqvist, P. Ciancarini, F. Poggi, F. Vitali (Eds.),
Proceedings of the Knowledge Engineering and Knowledge Management, Lecture Notes
in Computer Science, 2016, pp. 239–254. doi:10.1007/978-3-319-49004-5_16.
[13] F. Ilievski, P. Szekely, B. Zhang, Cskg: The commonsense knowledge graph, in: The
Semantic Web: 18th International Conference, ESWC 2021, 2021, pp. 680–696. doi:10.
1007/978-3-030-77385-4_41.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G. A.</given-names>
            <surname>Miller</surname>
          </string-name>
          ,
          <article-title>Wordnet: a lexical database for english</article-title>
          ,
          <source>Communications of the ACM</source>
          <volume>38</volume>
          (
          <year>1995</year>
          )
          <fpage>39</fpage>
          -
          <lpage>41</lpage>
          . URL: https://dl.acm.org/doi/abs/10.1145/219717.219748.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>C. F.</given-names>
            <surname>Baker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Fillmore</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. B.</given-names>
            <surname>Lowe</surname>
          </string-name>
          , The Berkeley FrameNet project,
          <source>in: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics</source>
          ,
          <year>1998</year>
          , pp.
          <fpage>86</fpage>
          -
          <lpage>90</lpage>
          . URL: https: //aclanthology.org/P98-1013.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Vrandečić</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Krötzsch</surname>
          </string-name>
          ,
          <article-title>Wikidata: a free collaborative knowledgebase</article-title>
          ,
          <source>Communications of the ACM</source>
          <volume>57</volume>
          (
          <year>2014</year>
          )
          <fpage>78</fpage>
          -
          <lpage>85</lpage>
          . URL: https://dl.acm.org/doi/10.1145/2629489.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Isele</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jakob</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jentzsch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kontokostas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. N.</given-names>
            <surname>Mendes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hellmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Morsey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Van Kleef</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Auer</surname>
          </string-name>
          , et al.,
          <article-title>Dbpedia-a large-scale, multilingual knowledge base extracted from wikipedia</article-title>
          ,
          <source>Semantic web 6</source>
          (
          <year>2015</year>
          )
          <fpage>167</fpage>
          -
          <lpage>195</lpage>
          . URL: https://content.iospress. com/articles/semantic-web/
          <year>sw134</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>