<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Modeling and Contextualizing Claims</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Katarina Boland</string-name>
          <email>katarina.boland@gesis.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pavlos Fafalios</string-name>
          <email>fafalios@ics.forth.gr</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andon Tchechmedjiev</string-name>
          <email>andon.tchechmedjiev@mines-ales.fr</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Konstantin Todorov</string-name>
          <email>konstantin.todorov@lirmm.fr</email>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Dietze</string-name>
          <email>stefan.dietze@gesis.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>GESIS - Leibniz Institute for the Social Sciences</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Heinrich-Heine-University Dusseldorf</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Institute of Computer Science</institution>
          ,
          <addr-line>FORTH-ICS</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>LGI2P</institution>
          ,
          <addr-line>IMT Mines-Ales</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>LIRMM / University of Montpellier / CNRS</institution>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Understanding societal debates on the Web and how they are impacted by the spread of biased narratives and falsehoods are becoming increasingly important issues. The notion of a claim is central in a number of related studies into fake-news propagation or computational fact-checking. While the understanding of this notion varies from one eld to another, there are few studies that have focused on the conceptual modeling of claims and their context. We attempt to contribute to this area by proposing a novel conceptual model for claims and related notions, such as attitudes, reviews and annotations, that aims to take into consideration the claims inherent complexity, distinguishing between their meaning, linguistic representation and context. We provide an example of an implementation of this model by using established vocabularies, such as schema.org, Open Annotation and PROV-O, and discuss the challenges related to this work. 1</p>
      </abstract>
      <kwd-group>
        <kwd>Claims</kwd>
        <kwd>Conceptual Modeling</kwd>
        <kwd>Claim Context</kwd>
        <kwd>Societal Debates</kwd>
        <kwd>Fact-checking</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The spread of biased narratives and falsehoods on the Web and the analyses
of online discourse have become increasingly important issues [
        <xref ref-type="bibr" rid="ref1 ref13">1, 13</xref>
        ] that led to
a wide range of interdisciplinary research involving a variety of scienti c
disciplines. Such works include investigations, for instance, into the spreading pattern
of false claims on Twitter [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], or the development of computational methods,
such as pipelines for detecting the stance of claim-relevant Web documents [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
classifying sources of news, such as Web pages, PLDs, users or posts [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], or for
fake news detection [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and automatic fact-checking [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
1 Copyright c 2019 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
      </p>
      <p>
        Whereas techniques for knowledge graph construction and augmentation
often deploy methods strongly related to the aforementioned computational
methods related to claims, e.g., when aiming to verify facts from the Web for
augmenting knowledge bases [
        <xref ref-type="bibr" rid="ref15 ref2">2, 15</xref>
        ], the notion of a claim is fundamentally di erent
from the notion of a fact as an atomic assertion in the rst-order-logic sense.
This is due to the inherent complexity of a claim, where its interpretation
usually is strongly dependent on its context, such as its source, timing, or location.
Moreover, a claim often carries a variety of intentional or unintended meanings,
where subtle changes in the wording or context can have signi cant e ects on
its validity [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Ambiguity also arises with respect to claims involving quotations
(\X reported that Y said Z"), where often fact-checking results remain vague
about what part such a nested claim actually has been validated.
      </p>
      <p>In order to facilitate the advancement of tasks such as claim veri cation
or fact checking, it is crucial to capture the complexity of a claim in a way
which enables unambiguous interpretation by both humans and machines.
However, both the used terminology and the underlying conceptual models are still
strongly diverging in academic literature (Sect. 2) as well as in the conceptual
models deployed by fact-checking sites.</p>
      <p>Therefore, capturing the meaning of a claim requires both the preservation
of the actual claim utterance as natural language text, often carrying a range
of statements and sentiments embedded in complex sentences which are easy
to process by humans but hard to interpret by machines, as well as structured
knowledge about a claim, its context and constituents, which enables
machineinterpretation, discoverability and reuse of claims, for instance, to facilitate
research in the aforementioned areas.</p>
      <p>
        This paper makes the following main contributions: i) a conceptual model
and corresponding terminology of claims and their constituents and context,
grounded in both the scienti c state-of-the-art in related elds such as
argumentation mining as well as the actual practices of representing and sharing
claims on the Web, for instance, as part of fact-checking sites; ii) an RDF
implementation of the proposed conceptual model that uses W3C standards for data
sharing, namely RDFS, and is informed by established vocabularies, such as
schema.org, Open Annotation, and the PROV data model, in order to facilitate
Web-scale sharing, discovery and reuse of claims and their context, for instance
through semi-structured Web page markup or as part of dedicated knowledge
graphs such as ClaimsKG [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>While the analysis of claims plays a crucial role for a number of elds, the
de nition of the very concept of a claim is often left to the intuition of the reader.
Existing de nitions vary considerably across and also within elds.</p>
      <p>
        According to the Oxford English Dictionary, a claim is a statement or
assertion that something is the case, typically without providing evidence or proof.2
Platforms dedicated to journalistic fact-checking refer to claims as statements
supported by (a group of) people or organizations that appear newsworthy,
signi cant and veri able.3 An RDFS-based model for such fact-checked claims is
introduced in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        In argumentation mining, claims denominate the conclusion of an argument
or the assertion the argument aims to prove [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. A variety of additional de
nitions can be found for speci c tasks in other elds like information retrieval,
e.g. a statement formulating a problem together with a concrete solution [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] or
a sentence in a scienti c document that relates two entities given in a query [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>Thus, what is identi ed as \claim" in a particular work may or may not be
called \claim" in another. While it is the belief of a person about a fact that
is called \claim" in argumentation mining, it is the fact itself that is coined
\claim" in the fact-checking community. Similarly, the belief and opinion about
certain consequences are the argumentative \claim", while fact-checking may
verify whether the anticipated consequences would indeed follow an action.
Statements expressing the position of a person towards a proposition or target are not
susceptible to fact-checking (unless the correctness of the quotation is to be
veri ed) but are a prevalent claim type in argumentation mining. Moreover, what
is used as premise or evidence in an argument is often selected as check-worthy
\claim" by fact-checking sites. Generally, the distinction of argumentative units
such as claims and evidence is based on the statements' usage in an argument
while fact-checking classi es statements as claims depending primarily on
features inherent to the statement itself.</p>
      <p>
        In an e ort to reconcile these di erent understandings of the concept of a
\claim", we propose a model considering requirements from various research
elds. While in argumentation mining, the meaning of a claim in the context of
the current discourse is the signi cant part, many tasks from the fact-checking
community, e.g. those aiming at matching unchecked statements to fact-checked
claims [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], focus on the surface form. Thus, going beyond the model introduced
in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], we propose di erentiating between the meaning or proposition of a claim
and its utterance, representation and context.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Conceptual Model</title>
      <p>Overview. We distinguish three main components of a claim, represented by
three central classes: (1) claim proposition, (2) claim utterance, and (3) claim
context. A claim proposition is the meaning of a statement or assertion that
something is the case. It is usually related to a controversial topic and can be
2 https://www.lexico.com/en/definition/claim
3 https://www.truthorfiction.com/about/
https://checkyourfact.com/about-us
https://www.politifact.com/truth-o-meter/article/2018/feb/12/
principles-truth-o-meter-politifacts-methodology-i/
factual or subjective (expressing an opinion). A claim proposition can be
expressed in many di erent ways and in di erent contexts, thus it has one or more
claim utterances. For example, it may be expressed in di erent languages, using
di erent words in the same language, or uttered by di erent persons and/or in
di erent points in time. On the contrary, a speci c claim utterance can be
associated to only one proposition, i.e., it has a single meaning. The claim proposition
can be represented in di erent ways, for example, by selecting a representative
utterance or through a more formal model. Each claim utterance is related to
a speci c claim context, like the author of the claim or its date. It provides
the means to interpret the claim utterance and thus understand its proposition.
Below, we provide details and the main properties of each of these three main
classes (without repeating the associations among them).</p>
      <p>Claim Proposition. A claim proposition re ects the meaning of one or more
semantically equivalent claim utterances expressed in di erent linguistic forms
or contexts. A claim proposition is associated with i) one or more preferred
representations, ii) one or more reviews, and iii) one or more attitudes (Fig.
1). A representation can have the form of free text, e.g., a sentence that best
describes the proposition (like the text of one of the corresponding utterances),
or be more complex, e.g,. a rst-order logic model. A review is a resource (e.g.,
a document) that analyzes one or more check-worthy claim propositions and
provides a verdict about their veracity or trustworthiness. An example of such
a review is an article published by a fact-checking organization. Note that not
all claims have a review or verdict. For instance, the claim \the presence of
a gun makes a con ict more likely to become violent" represents a hypothesis
and is di cult to be associated with a correctness score (there may be mixed
evidence supporting and contradicting it). An attitude is an opinion on a given
topic (e.g., a viewpoint), which often underlies a set of speci c values, beliefs or
principles. For instance, pro-Brexit and pro-Remain are two di erent attitudes
for the Brexit topic. A claim proposition can be associated with several attitudes
for di erent topics. For example, the claim \immigrants are taking our jobs"
supports both the against immigration attitude (for the Immigration topic) and
the pro-Brexit attitude (for the Brexit topic).</p>
      <p>Claim Utterance. A claim utterance is the act of expressing a claim
proposition in a speci c natural language and form (like text or speech). Among other
things, it may be something said by a politician during an interview, a text within
a news article written by a journalist, or a tweet posted by a celebrity about a
controversial topic. It is associated with i) one or more linguistic representations
(subclass of representation in Fig. 1), and ii) one or more sources (Fig. 2). A
linguistic representation can be, for example, a text in a speci c language that
best imprints the claim as it was said/appeared, or a sound excerpt from
someone's speech. A source provides evidence of the claim existence. For instance, it
can be the URL of an interview video, a news article, or a tweet. A linguistic
representation can have one or more annotations which provide formal linguistic
characteristics, like an entity or date mentioned in the text of the claim
utterance, the polarity of this text (e.g., positive, negative, neutral), or the linguistic
tone of a speech (like irony). The annotation can enable advanced exploration of
the claims (e.g., based on mentioned entities) and can be manually provided by
a domain expert or automatically produced using a NLP or speech processing
tool (like an entity linking tool for the case of entity annotation in text).
Claim Context. The claim context provides background information about the
claim utterance (Fig. 3). Together with the linguistic representation of the claim
utterance, it can provide an answer to the Five W's : i) what was said (linguistic
representation of claim utterance), ii) who said it (author of the claim), iii) when
it was said (date the claim was said), iv) where it was said (location the claim
was said), and v) why it was said (event or activity in the context of which
the claim was said). The claim context provides the necessary information for
interpreting the claim utterance (and thus understanding its proposition), and
can be extended with more concepts that allow describing additional context
information about the claim utterance (like the topic of the underlying discourse
or the medium used for uttering the claim).
Instantiation Example. Fig. 4 depicts an instantiation example of the
proposed conceptual model. The example shows information for two claim
utterances (in pink background): i) one said by David Dimbleby during a topical
debate in Dover (\We are going to be paying until 2064, apparently"), and ii)
one extracted from a news article of The Independent (\UK will be paying Brexit
`divoce bill' until 2064"). Both utterances correspond to the same claim
proposition (in green background) and each one has its own context information (in
yellow background). The linguistic representation of the rst claim utterance has
been annotated with one date annotation (2064) and that of the second claim
utterance with one entity annotation (UK). The claim proposition has two
representations, a textual one (\Britain will be paying its Brexit bill for 45 years
after leaving the EU") and a formal one (\cost = fof=Brexit, for=UK amount=?,
until=2064g"), and supports the against-Brexit attitude for the Brexit topic. In
addition, there is a review of this claim proposition with verdict \true",
published by Full Fact (UK's independent fact-checking organisation). We can also
see the URL of the review article as well as a reference to a PDF le which
provides evidence for its correctness. The context of each claim utterance
provides additional metadata about the claim. For example, we see that the rst
utterance was said by David Dimbleby on 15.03.2018, in the context of a debate
about Brexit which took place in Dover.
4</p>
    </sec>
    <sec id="sec-4">
      <title>RDF Implementation</title>
      <p>We introduce an RDF/S implementation of the proposed conceptual model
using established vocabularies, in particular schema.org,4 the Open Annotation
(OA) Data Model,5 the Marl Ontology,6 the NLP Interchange Format (NIF),7
and the PROV Data Model.8 The selection of these vocabularies was based on
the following three main objectives: i) relying on stable term identi ers and
persistent hosting, ii) being supported by a community, iii) being extensible.</p>
      <p>Fig. 5 depicts the proposed schema. For representing the main concepts of
our conceptual model, we exploit classes and properties of schema.org, a
collaborative, community activity with a mission to maintain and promote a common
schema for structured data on the Web and beyond. We make use of the class
schema:Claim (currently under integration in schema.org) to describe a claim
utterance. According to schema.org, this class represents a speci c,
factuallyoriented claim. For the claim proposition, we use the class schema:Intangible,
a utility class that serves as the umbrella for a number of `intangible' things.
Although this class does not su ciently re ect the semantics of a claim
proposition, it appears to be the most reasonable term for representing a proposition.
For the same reason, we use schema:Intangible to describe a claim context.
4 https://schema.org/
5 http://www.openannotation.org/
6 http://www.gsi.dit.upm.es/ontologies/marl/
7 https://persistence.uni-leipzig.org/nlp2rdf/
8 https://www.w3.org/TR/prov-dm/</p>
      <p>&gt; )
6 &amp;
6 &amp;
6 &amp;
;
,&amp;
5
8
$ , &amp; - )
, %
# ) " 3 24
-&amp;
-&amp;
-&amp;
&amp;</p>
      <p>&lt;
? &amp;
#
#
!
,
=
-&amp;
&amp; ( " &amp;
&amp; '%</p>
      <p>" &amp;
"
1 ) 9 2
&lt; 6 # $ -&amp;
# $%!</p>
      <p>" # $
156 32 # " 18 8 2
" &amp; // . )/ &amp; /, 9 # 9, 9 /
" &amp; // . , . 0/3879: 6 "+ '!.&amp;
=
-&amp;
&gt; )
6 &amp;</p>
      <p>-&amp; #
1B ) ) ,
&amp; - )
&amp;&amp; -24
;
*
&amp;
((</p>
      <p>"
" &amp; //$$$.,, . . 0/
&amp; ) /, $
) + &amp; '
" )
&amp;
-&amp;
"
' (</p>
      <p>An alternative solution is to bypass the claim context class and directly link an
instance of schema:Claim to instances of the four classes connected to the claim
context (author, date, location, event ). These four classes are described through
corresponding schema.org classes: schema:Thing (e.g., a person, an
organization, a blog, etc.), schema:Date, schema:Place, schema:Event. For connecting a
schema:Claim to a schema:Intangible, we can use the property schema:about
or its inverse schema:subjectOf.</p>
      <p>For representing a source, we use the class schema:CreativeWork (or one of
its sub-classes). Thereby, we take advantage of its properties and can describe
additional information about the source, such as headline, language, keywords,
publisher, etc. The linguistic representation of a claim utterance, as well as the
(preferred) representation of a claim proposition, can be described through the
class schema:Text (for textual representations) or schema:MediaObject (for
image, audio or video representations). For describing annotations, we make use
of the widely-used OA and NIF data models, while provenance information is
represented though the PROV data model. NIF allows us to include detailed
information about the outcome of an NLP process on textual representations
(like begin/end indexes and con dence scores). The review of a claim proposition
is described through the class schema:ClaimReview, which in turn is connected
to a schema:Rating for assigning a rating score about the veracity of the claim
proposition. Finally, we exploit the Marl ontology to represent attitudes. Marl is a
data schema designed to annotate and describe subjective opinions, and provides
the attributes that enable to connect opinions with contextual information.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Concluding Remarks</title>
      <p>We propose a conceptual model and an implementation based on existing
RDF vocabularies to represent and contextualize claims and related entities.
Our work is meant to advance a shared understanding of claims and related
terminology across communities, and the semi-structured representation of claims
and their contexts to foster transparency, reproducibility and a joint
advancement of research in related elds.</p>
      <p>An open challenge is the detection and representation of the inherent
relations between claims as well as their relations to other entities or resources.
In particular, the semantic relatedness of claims is re ected by the relations
between their proposition components. Establishing relations across the model
classes, e.g., relating an utterance to a proposition, allows the uncovering of
paraphrased claims with identical meaning, while topical relations between claims are
of crucial importance to enable retrieval and search of claims.</p>
      <p>Other challenges concern information extraction techniques geared towards
the extraction of utterances from text or audio together with the attitude
towards a particular topic, as well as additional contextual information, such as
authors or sources. From a knowledge representation perspective, we emphasize
the need for a formal representation of propositions (e.g. by applying dynamic
predicate logics), or for extending the Marl model in order to represent speci
cally viewpoints instead of general opinions on objects. This reveals the need for
the development of a dedicated ontology for claims representation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Allcott</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gentzkow</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Social media and fake news in the 2016 election</article-title>
          .
          <source>Journal of Economic Perspectives</source>
          <volume>31</volume>
          (
          <issue>2</issue>
          ),
          <volume>211</volume>
          {
          <fpage>36</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Dong</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabrilovich</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heitz</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horn</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lao</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Murphy</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Strohmann</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Zhang, W.:
          <article-title>Knowledge vault: A web-scale approach to probabilistic knowledge fusion</article-title>
          .
          <source>In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining</source>
          . pp.
          <volume>601</volume>
          {
          <fpage>610</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Graves</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Understanding the promise and limits of automated fact-checking (</article-title>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Hassan</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adair</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hamilton</surname>
            ,
            <given-names>J.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tremayne</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The quest to automate fact-checking</article-title>
          .
          <source>In: Proceedings of the 2015 Computation+Journalism Symposium</source>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Hassan</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , G.,
          <string-name>
            <surname>Arslan</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Caraballo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jimenez</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gawsane</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hasan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Joseph</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kulkarni</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nayak</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          , et al.:
          <article-title>Claimbuster: The rst-ever endto-end fact-checking system</article-title>
          .
          <source>VLDB Endowment</source>
          <volume>10</volume>
          (
          <issue>12</issue>
          ),
          <year>1945</year>
          {
          <year>1948</year>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Levy</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bogin</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gretz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aharonov</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Slonim</surname>
          </string-name>
          , N.:
          <article-title>Towards an argumentative content search engine using weak supervision</article-title>
          .
          <source>In: 27th International Conference on Computational Linguistics</source>
          . pp.
          <year>2066</year>
          {
          <year>2081</year>
          . ACL (Aug
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Lippi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torroni</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Argument mining from speech: Detecting claims in political debates</article-title>
          .
          <source>In: Thirtieth AAAI Conference on Arti cial Intelligence</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Pinto</surname>
            ,
            <given-names>J.M.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balke</surname>
          </string-name>
          , W.T.:
          <article-title>O ering answers for claim-based queries: a new challenge for digital libraries</article-title>
          .
          <source>In: International Conference on Asian Digital Libraries</source>
          . pp.
          <volume>3</volume>
          {
          <fpage>13</fpage>
          . Springer (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Pinto</surname>
            ,
            <given-names>J.M.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wawrzinek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balke</surname>
          </string-name>
          , W.T.:
          <article-title>What drives research e orts? nd scienti c claims that count!</article-title>
          <source>In: 2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL)</source>
          . pp.
          <volume>217</volume>
          {
          <fpage>226</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Popat</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mukherjee</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Strotgen, J.,
          <string-name>
            <surname>Weikum</surname>
          </string-name>
          , G.:
          <article-title>Where the truth lies: Explaining the credibility of emerging claims on the web and social media</article-title>
          .
          <source>In: Proceedings of the 26th International Conference on World Wide Web Companion</source>
          . pp.
          <volume>1003</volume>
          {
          <fpage>1012</fpage>
          .
          <string-name>
            <surname>International World Wide Web Conferences Steering Committee</surname>
          </string-name>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Tchechmedjiev</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fafalios</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boland</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gasquet</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zloch</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zapilko</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dietze</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Todorov</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>ClaimsKG: A knowledge graph of fact-checked claims</article-title>
          .
          <source>In: International Semantic Web Conference</source>
          . pp.
          <volume>309</volume>
          {
          <fpage>324</fpage>
          . Springer (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Tschiatschek</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singla</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomez</surname>
            <given-names>Rodriguez</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Merchant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Krause</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          :
          <article-title>Fake news detection in social networks via crowd signals</article-title>
          .
          <source>In: Companion Proceedings of the The Web Conference</source>
          <year>2018</year>
          . pp.
          <volume>517</volume>
          {
          <fpage>524</fpage>
          .
          <string-name>
            <surname>International World Wide Web Conferences Steering Committee</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Vosoughi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roy</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aral</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The spread of true and false news online</article-title>
          .
          <source>Science</source>
          <volume>359</volume>
          (
          <issue>6380</issue>
          ),
          <volume>1146</volume>
          {
          <fpage>1151</fpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baumgartner</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Korn</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Relevant document discovery for factchecking articles</article-title>
          .
          <source>In: Companion Proceedings of the The Web Conference</source>
          <year>2018</year>
          . pp.
          <volume>525</volume>
          {
          <fpage>533</fpage>
          .
          <string-name>
            <surname>International World Wide Web Conferences Steering Committee</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gadiraju</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fetahu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehmberg</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ritze</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dietze</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>KnowMore{ knowledge base augmentation with structured web markup</article-title>
          .
          <source>Semantic</source>
          Web pp.
          <volume>1</volume>
          {
          <issue>22</issue>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>