<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Dice: A Joint Reasoning Framework for Multi-Faceted Commonsense Knowledge?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Yohan Chalier</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Simon Razniewski</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gerhard Weikum</string-name>
          <email>weikumg@mpi-inf.mpg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Max Planck Institute for Informatics</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present a web prototype for the Dice framework for joint consolidation of noisy multi-faceted commonsense knowledge (CSK) [1]. In the demonstration session, participants will be familiarized with the multi-faceted knowledge representation formalism used in Dice, and get the opportunity to inspect grounded constraint systems and resulting inferences for two CSK collections, ConceptNet and Quasimodo. The web prototype is available at https://dice.mpi-inf.mpg.de.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Commonsense knowledge (CSK) is a potentially important asset towards
building versatile AI applications, such as visual understanding for describing images
or conversational agents like chatbots. In delineation from encyclopedic
knowledge on entities like Trump, Sydney, or FC Liverpool, CSK refers to properties,
traits and relations of everyday concepts, such as elephants, co ee mugs or school
buses. Prior works on acquiring CSK, such as ConceptNet [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], WebChild [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ],
TupleKB [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], Quasimodo [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and others [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], have compiled statements that
associate concepts with properties that hold for most or some of their instances.
      </p>
      <p>Yet they compute each concept and statement in isolation from others,
and the only quantitative measure (or ranking) is a con dence score
capturing whether the statement is valid. There is no information about whether a
property holds for all or for some of the instances of a concept, and there is
no awareness of which properties are typical and which ones are salient from a
human perspective.</p>
      <p>
        Dice overcomes these limitations by introducing a multi-faceted model of
CSK statements and methods for joint reasoning over sets of inter-related
statements [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Dice captures four di erent dimensions of CSK statements:
plausibility, typicality, remarkability and salience, with scoring and ranking along each
dimension. For reasoning and ranking, it relies on soft constraints, to couple the
inference over concepts that are related in a taxonomic hierarchy. The reasoning
is cast into an integer linear programming (ILP), and leverages the theory of
reduction costs of a relaxed LP to compute informative rankings. This
demonstration will showcase the Dice reasoning system. Participants will engage with
the multi-faceted knowledge representation, explore grounded constraint
systems, and inspect resulting statement sets.
      </p>
    </sec>
    <sec id="sec-2">
      <title>System Overview</title>
      <p>
        Knowledge representation. While binary truth assignments are sensible for
encyclopedic knowledge (e.g., Trump either was born in NY, or was not), they
fall much short of CSK, which generalizes across individuals and time. To model
re ned semantics of CSK statements, Dice captures four facets of concept
properties: (i) Plausibility indicates whether a statement makes sense at all (like the
established but overloaded notion of con dence scores). (ii) Typicality indicates
whether a property holds for most instances of a concept (e.g., not only for cubs).
(iii) Remarkability expresses that a property stands out by distinguishing the
concept from closely related concepts (like siblings in a taxonomy). (iv) Saliency
re ects that a property is characteristic for the concept, in the sense that most
humans would spontaneously list it in association with the concept. This way,
statements are better contextualized, loosely similar as by use of quali ers in
traditional entity-centric KBs [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        Joint reasoning framework. Dice identi es inter-related concepts by their
neighborhoods in the WebIsALOD [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] concept hierarchy or via embeddings, and
utilizes a set of weighted soft constraints that allows us to jointly reason over the
four dimensions for sets of candidate statements. The soft constraint reasoning
framework is then cast into an integer linear program (ILP), for which, by
harnessing the theory of reduced cost for LP relaxations, rankings for each of the
facets are computed. The constraint system is hereby bootstrapped with
unidimensional scores from existing CSK collections, probabilistic interpretations of
these scores [
        <xref ref-type="bibr" rid="ref7 ref8">8,7</xref>
        ], and scores based on textual entailment [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>Our constraint system includes logical clauses such as</p>
      <p>Plausible(s1; p) ^ Related(s1; s2) ^ :Plausible(s2; p) ^ : : : ) Remarkable(s1; p)
where : : : refers to enumerating all siblings of s1, or highly related concepts. The
constraint itself is weighted by the degree of relatedness; so it is a soft constraint
that does allow exceptions.</p>
      <p>
        For example, our framework can draw the following probabilistic inferences:
Macaques eating bananas makes it likely that also stump-tailed macaques
eat bananas (parent-child propagation)
Penguins not ying is remarkable when most taxonomical siblings do y
(sibling interdependencies)
Being able to swim correlates with being able to dive (statement similarity)
Lions attacking humans being salient implies the event being at least
plausible (dimension interrelation)
Implementation and web interface. The reasoning was performed using the
Gurobi math solver library. The solving of slices of the full constraint system
took several hours on a 500 GB RAM machine, we therefore computed the
results o ine on two existing unidimensional CSK collections, ConceptNet and
Quasimodo. Further details on Dice are in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and the code can be found at
https://github.com/ychalier/dice
      </p>
      <p>We now provide a web interface to explore the underlying constraint systems
and resulting statement sets. It is available at https://dice.mpi-inf.mpg.de.
(a) Demo landing page.</p>
      <p>(b) List of statements for subject band.
1. Inspecting multifaceted KR. At the start, attendees will be familiarized
with the multi-faceted KR used in Dice. From the landing page (Fig. 1 (a)),
they will be shown statements for arbitrary CSK subjects of their choice (see
Fig. 1 (b)), and get the chance to explore scores along the four facets, along with
initial scores from ConceptNet and Quasimodo. For example, the statements
for the subject band are available at https://dice.mpi-inf.mpg.de/subject/band.
This way, attendees will learn about the di erence of unidimensional and
multifaceted scoring.
2. Inspecting constraint systems. In the second part of the demonstration,
attendees will explore constraint systems for individual statements. From the
screen in (Fig. 1 (b)), attendees will already see taxonomic parents and
siblings as used for the constraint system. Upon selecting a speci c CSK statement
in that screen, a new interface ((Fig. 2) opens, which on the left side (Fig. 2
(a)) shows related statements, numeric statement features, and resulting
bootstrapping scores, and on the right side (Fig. 2 (b)) resulting constraint systems.
For example, the constraint systems for band: become famous is available at
https://dice.mpi-inf.mpg.de/fact/band/become-famous.
3. Chat templates In the third part, attendees will be shown a use case of
multi-faceted CSK, dialogue. Provided with some chat templates, which allow
to include CSK statements with high or low scores along the four dimensions,
attendees will be able to write their own dialogues, and explore the impact
of inserting statements of di erent types and scores into these (https://dice.
mpi-inf.mpg.de/dialogues).
(a) Scores and neighbourhood for
statement band: hold concert.
(b) Materialized clauses for statement
band: hold concert.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Chalier</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Razniewski</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>Joint reasoning for multi-faceted commonsense knowledge</article-title>
          .
          <source>AKBC</source>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Gardner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al.:
          <article-title>AllenNLP: A deep semantic natural language processing platform</article-title>
          . Workshop for NLP Open Source Software (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Hertling</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paulheim</surname>
          </string-name>
          , H.:
          <article-title>WebIsALOD: Providing hypernymy relations extracted from the web as linked open data</article-title>
          .
          <source>ISWC</source>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Jebbara</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Basile</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cabrio</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Extracting common sense knowledge via triple ranking using supervised and unsupervised distributional models</article-title>
          .
          <source>SWJ</source>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Mishra</surname>
            ,
            <given-names>B.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tandon</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Domain-targeted, high precision knowledge extraction</article-title>
          .
          <source>TACL</source>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          :
          <article-title>Contextualization via quali ers</article-title>
          .
          <source>Workshop on Contextualized Knowledge Graphs</source>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Romero</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Razniewski</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>: Inside Quasimodo: Exploring construction and usage of commonsense knowledge</article-title>
          .
          <source>CIKM</source>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Romero</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Razniewski</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pal</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pan</surname>
            ,
            <given-names>J.Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sakhadeo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>Commonsense properties from query logs and question answering forums</article-title>
          .
          <source>CIKM</source>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Speer</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Havasi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>ConceptNet 5: A large semantic network for relational knowledge</article-title>
          .
          <source>Theory and Applications of Natural Language Processing</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Tandon</surname>
          </string-name>
          , N.,
          <string-name>
            <surname>de Melo</surname>
          </string-name>
          , G.,
          <string-name>
            <surname>Suchanek</surname>
            ,
            <given-names>F.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>WebChild: harvesting and organizing commonsense knowledge from the web</article-title>
          .
          <source>WSDM</source>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>