<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards a Knowledge Diversity Model</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Rakebul Hasan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Katharina Siorpaes</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Reto Krummenacher</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fabian Flöck</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Applied Informatics and Formal Description Methods Karlsruhe Institute of Technology D-76131 Karlsruhe</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Semantic Technology Institute (STI) University of Innsbruck A-6020 Innsbruck</institution>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2011</year>
      </pub-date>
      <abstract>
        <p>The Web is an unprecedented enabler for publishing, using and exchanging information at global scale. Virtually any topic is covered by an amazing diversity of opinions, viewpoints, mind sets and backgrounds. The research project RENDER works on methods and techniques to leverage diversity as a crucial source of innovation and creativity, and designs novel algorithms that exploits diversity for ranking, aggregating and presenting Web content. Essential in this respect is a knowledge model that makes accessible | cognitively to human users as well as computationally to the machine | the diversity in content. In this paper, we present a glossary of relevant terms that serves as baseline to the speci cation of the Knowledge Diversity Model.</p>
      </abstract>
      <kwd-group>
        <kwd>Knowledge diversity</kwd>
        <kwd>Glossary</kwd>
        <kwd>Knowledge model</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>The Web is a tremendous facilitator and catalyst for the
publication, use and exchange of information, fostering a
global network of news, stories and statements which
represent an amazing diversity of opinions, viewpoints, mind sets
and backgrounds. Its design principles and core technology
have led to an unprecedented growth in mass collaboration;
a trend that is also increasingly impacting business
environments.</p>
      <p>The RENDER project1 aims at leveraging the diversity
inherently unfolding through world wide scale publishing and
collaboration by developing methods, techniques, software
and data sets that make diversity accessible as an important
source of innovation and creativity, and by designing novel
algorithms that re ect diversity in the ways information is
selected, ranked, aggregated, presented and used.</p>
      <p>An important component for the capturing of diversity in
online documents, is a comprehensive knowledge model for
representing diversity that re ects the plurality of opinions
and viewpoints on a particular topic. In a rst step, the
considered content such as articles, blog entries or news feeds
are transformed into a semantic representation according to
the knowledge model that is accessible both cognitively to
human users as well as computationally to the machine. The
semantic representation is then leveraged for improving the
selection and ranking of content, and the presentation to
users. In RENDER, selection and ranking will go beyond
widely adopted approaches based on popularity or
personalization, and take opinions and viewpoints into account when
computing the relevance of results.</p>
      <p>In this paper we present a glossary of terms relevant in the
scope of knowledge diversity. Creating a shared
understanding of terms and relationships between terms is an essential
rst step towards the speci cation of a conceptual model for
knowledge diversity. In that sense, this paper provides the
necessary baseline for the de nition of a knowledge diversity
ontology, which allows for formalizing, gathering, evaluating
and processing diversity in various (written) online medias.</p>
      <p>In a rst section (Section 2) we provide three motivating
scenarios for this work, which are derived from the project's
showcases that are brought to RENDER by Google,
Wikimedia, and Telefonica. Section 3 provides a glossary of terms
such as diversity, opinion, sentiment, bias and many more.
Section 4 presents a short overview of the related work. In
Section 5 we take a quick look at next steps, at how the
targeted knowledge model will be used and leveraged in the
given scenarios and throughout the project, and conclude
the paper.
2.</p>
    </sec>
    <sec id="sec-2">
      <title>MOTIVATING SCENARIOS</title>
      <p>In the following we present three motivating business
scenarios for the formalization of a knowledge diversity model.
2.1</p>
    </sec>
    <sec id="sec-3">
      <title>Wikipedia</title>
      <p>Despite e orts for a balanced coverage at Wikipedia,
systemic biases in uenced by the individual views of the more
than 100'000 volunteer contributors have been introduced.
The increasing complexity of the control processes for
creating and editing articles that are put in place to overcome
the problem of biases, negatively impacts the growth of
Wikipedia. Edit con ict resolution, arbitration committees,
banning policies, a complex hierarchy of contributors,
editors and administrators is not sustainable. E ectively,
recent statistics show that the number of new articles has been
decreasing dramatically over the past years, while the
number of edits is still growing steadily. Discovering missing
content from one language version of Wikipedia to another, or
the detection of diverse viewpoints within a topic or article
are urgently needed support to the editorial team for
managing and encouraging large-scale participation and
sustainable growth. Diversity-empowered services such as quality
or reliability assessment of an article or a speci c statement,
con ict resolution, anomaly detection, and cross-lingual
consistency checking are expected to considerably improve the
way information is currently managed in Wikipedia.
2.2</p>
    </sec>
    <sec id="sec-4">
      <title>Google News</title>
      <p>The news aggregator service of Google (Google News)
indexes several ten thousands of news Web sites which are
summaries into more than forty regional issues in more than
15 languages. The considered news content is created by
professional journalists and by Web users, and o ers as such
a rich diversity of information. Current ranking algorithms
result in news summaries that are dominated by popular
viewpoints or opinion holders such as large news agencies.
Alternative opinions, or arguments from smaller
publishers often disappear and do not reach the interested
audience. Consequently, even though Google aims for wide and
comprehensive news coverage, the presented view points are
highly biased. Manual processing is costly and impractical,
and techniques to automatically discover diverse opinions,
viewpoints and discussions surrounding a topic are required
to fully leverage the richness in news content.
Diversityaware ranking of news posts for covering the most diverse
view points on a particular topic, and enriching these with
data from other sources like blogs, tweets, and wiki pages
is expected to considerably increase the interconnection
between diversifying news and discussions on the Web.
2.3</p>
    </sec>
    <sec id="sec-5">
      <title>Customer Relationship Management</title>
      <p>Telefonica is one of the World's largest
telecommunications companies by market share, operating in 25 countries
with a global customer base exceeding 280 millions. The
company maintains various di erent communication
channels including call centers, Web sites and public forums
and blogs to collect customer feedback about their
products and services. This o ers a massive amount of valuable
user opinions coming from diverse sources, countries and
socio-demographic groups that are currently only marginally
exploited, as the technical support for automation is
missing and manual processing is not feasible to the desired
extent. Discovering and automatically evaluating customer
reactions and discussions are expected to allow Telefonica to
react more e ciently and e ectively to trends, to make more
precise forecasts, and to eventually improve future business
decisions.</p>
    </sec>
    <sec id="sec-6">
      <title>KNOWLEDGE DIVERSITY GLOSSARY</title>
      <p>The rst step towards our knowledge diversity model is
to create a shared understanding of the relevant terms and
relationships between them in the scope of knowledge
diversity. In this section, we present a summary of de nitions of
possibly relevant terms to get a rough understanding of the
key concepts in the scope of knowledge diversity. We do not
attempt to de ne these concepts in this paper; instead we
refer to the existing de nitions of these concepts.
Agent is described in DOLCE+DnS Ultralite as an
agentive object, either physical (e.g. a person), or social (e.g. a
corporation, an institution, a community).2 As an extension
of this concept, an agent expressing an opinion of his own
can be called an opinion holder.</p>
      <p>
        Belief is given by Wikipedia as \the psychological state in
which an individual holds a proposition or premise to be
true".3 WordNet de nes belief as \any cognitive content held
as true", or alternatively as \a vague idea in which some
condence is placed".4
Bias is de ned by Wikipedia as \an inclination to present or
hold a partial perspective at the expense of (possibly equally
valid) alternatives".5 The de nition of bias by Giunchiglia
et al. in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] states that \bias is the degree of correlation
between (a) the polarity of an opinion and (b) the context
of the opinion holder". The context can be a variety of
factors such as ideological, political, or educational background,
ethnicity, race, profession, age, location, or time.
Data is de nded by WordNet as \a collection of facts from
which conclusions may be drawn".6 Wikipedia states that
\the term data refers to qualitative or quantitative attributes
of a variable or set of variables". Furthermore, data is the
lowest level of abstraction from which rst information and
then knowledge are derived.7
Diversity is described in the philosophical sense, according
to [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], as \the relation that holds between two entities when
and only when they are not identical". In the Cambridge
Advanced Learner's Dictionary diversity is de ned as: \when
many di erent types of things or people are included in
something".8 In [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] diversity is given from a more knowledge
diversity focused point of view as \the co-existence of
contradictory opinions and/or statements (some typically
nonfactual or referring to opposing beliefs/opinions)". In the
same paper, di erent dimensions of diversity are described
such as: diversity of resources, diversity of topic, diversity
of viewpoint, diversity of genre, diversity of language,
geographical/spatial diversity, and temporal diversity.
Emotion is de ned by Liu as \subjective feelings and
thoughts" [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. As Liu discusses, people use language expressions
to describe their mental state (or feelings). According to
[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], there are a large number of language expressions to
depict the six types of emotions; i.e., love, joy, surprise, anger,
sadness and fear. Similarly, people use a large number of
opinion expressions to convey opinions with positive or
negative sentiment.
      </p>
      <p>Entity is described by Wikipedia as \something that has a
distinct, separate existence, although it need not be a
material existence".9 In entity-relationship modelling, an entity
is de ned as \a thing which is recognized as being capable of
an independent existence and which can be uniquely
identied".10
2ontologydesignpatterns.org/ont/dul/DUL.owl
3en.wikipedia.org/wiki/Belief
4wordnetweb.princeton.edu/perl/webwn?s=belief
5en.wikipedia.org/wiki/Bias
6wordnetweb.princeton.edu/perl/webwn?s=data
7en.wikipedia.org/wiki/Data
8dictionary.cambridge.org/dictionary/british/
diversity
9en.wikipedia.org/wiki/Entity
10en.wikipedia.org/wiki/Entity-relationship_model
Event is described in DOLCE+DnS Ultralite as \any
physical, social, or mental process, event, or state". DOLCE+DnS
Ultralite classi es events based on `aspect' (e.g., stative,
continuous, accomplishment, achievement, etc.), on `agentivity'
(e.g., intentional, natural, etc.), or on `typical participants'
(e.g., human, physical, abstract, food, etc.).</p>
      <p>
        Fact, according to Liu, is the \objective expressions about
entities, events and their properties" [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Wikipedia states
that facts \refer to veri ed information about past or present
circumstances or events which are presented as objective
reality".11 The Merriam-Webster Online Dictionary de nes
fact, inter alia, as 1) \the quality of being actual." 2)
\something that has actual existence." or \An actual occurrence",
3. \a piece of information presented as having objective
reality".12
Information is de ned in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] in terms of data + meaning:
is an instance of information, understood as semantic
content, if and only if:
i) consists of n data, for n &gt; 1;
ii) the data are well formed ;
iii) the well-formed data are meaningful.
      </p>
      <p>According to this de nition, information is made of data
and `well formed' here means that data are rightly put
together. Well formed and meaningful data are also known
as semantic content. Information, understood as semantic
content, has two major types: (a) instructional information,
conveying the need for a speci c action (b) factual
information.</p>
      <p>Information Object is described by DOLCE+DnS
Ultralite as \a piece of information, such as a musical composition,
a text, a word, a picture, independently from how it is
concretely realized".</p>
      <p>
        Knowledge is informally described in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In a sentence like
\John knows that Sara will come to the party", knowledge is
\a relation between a knower, like John, and a proposition,
that is, the idea expressed by a simple declarative sentence",
like \Sara will come to the party". The proposition here are
the abstract entities that can be true or false, right or wrong.
More speci cally, the sentences expressing the propositions,
which are factual or non-factual, are true or false. The
relationship between agents and propositions have di erent
propositional attitude denoted by verbs like \know", \hope",
\fear", \regret", and \doubt" etc. Brachman and Levesque do
not consider the sentences involving knowledge that do not
explicitly mention a proposition. For example, it is not clear
if there is any useful proposition involved in the sentences
like \John knows how to play guitar" or \John knows Bob
well". Brachman and Levesque also discuss that the notion
of belief is related to the notion of knowledge. People use
the notion of belief if they do not want to claim that the
judgement of an agent about the world is necessarily
accurate.
      </p>
      <p>
        Metadata is de ned by Wikipedia as the \data providing
information about one or more aspects of the data",13; e.g.,
means of creation of the data, purpose of the data, time and
date of creation, creator or author of data, placement on a
computer network where the data was created, or standards
11en.wikipedia.org/wiki/Fact
12www.merriam-webster.com/dictionary/fact
13en.wikipedia.org/wiki/Metadata
used. WordNet simpli es the meaning of metadata as \data
about data".14
Object is described in DOLCE+DnS Ultralite as \any
physical, social, or mental object, or a substance". The de nition
of objects by Liu states that \an object o is an entity which
can be a product, person, event, organization, or topic [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
It is associated with a pair, o: (T, A), where T is a
hierarchy of components (or parts), sub-components, and so on,
and A is a set of attributes of o. Each component has its
own set of sub-components and attributes".
      </p>
      <p>
        Objectivity is the expression of facts [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Wikipedia
moreover describes objectivity as \a proposition is generally
considered to be objectively true when its truth conditions are
mind-independent { that is, not the result of any judgements
made by a conscious entity or subject".15 WordNet de nes
it as the \judgment based on observable phenomena and
unin uenced by emotions or personal prejudices",16 while
according to [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] objective sentences express factual
information about the world.
      </p>
      <p>
        Object Feature represents the components and attributes
of objects [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The term object feature is also referred
simply as feature. Object features are used to simplify the
complexity of hierarchical representation of the components of
objects.
      </p>
      <p>
        Opinion is de ned by Wikipedia as \a subjective statement
or thought about an issue or topic, and is the result of
emotion or interpretation of facts".17 Furthermore, \an opinion
may be supported by an argument, although people may
draw opposing opinions from the same set of facts". In [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],
opinion is de ned as \a statement, i.e. a minimum
semantically self-contained linguistic unit, asserted by at least one
actor, called the opinion holder, at some point in time, but
which cannot be veri ed according to an established
standard of evaluation. It may express a view, attitude, or
appraisal on an entity. This view is subjective, with
positive/neutral/negative polarity (i.e. support for, or
opposition to, the statement)". Another de nition of opinion,
given by Liu [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], states that \an opinion on a feature f is a
positive or negative view, attitude, emotion or appraisal on
f from an opinion holder".
      </p>
      <p>
        Opinion Expression is given by Liu as subjective
expression that describes sentiments, appraisals or feeling toward
entities, events and their properties [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. More generally
speaking, it could be said that opinion expressions are
individual statements that contain an assessment of reality from
the point of view of the opinion holder.
      </p>
      <p>
        Opinion Holder, according to Liu [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], is \the person or
organization that expresses the opinion"; see Agent above.
Polarity of Opinion on a feature f indicates if the opinion
is positive, negative or neutral [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] describes polarity as
the degree to which a statement is positive, negative or
neutral. The polarity of an opinion is also known as sentiment
orientation or semantic orientation [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        Sentiment is de ned in the American Heritage Dictionary
14wordnetweb.princeton.edu/perl/webwn?s=metadata
15en.wikipedia.org/wiki/Objectivity_(philosophy)
16wordnetweb.princeton.edu/perl/webwn?s=objectivity
17en.wikipedia.org/wiki/Opinion
of the English Language as \a thought, view, or attitude,
especially one based mainly on emotion instead of reason".18
Sentiments can be seen as a way to express opinions. Hence,
sentiments, as much as opinions, can be negative, positive
or neutral [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        Subjectivity refers to the subject and the perspective,
feelings, beliefs, and desires of the subject [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Liu de nes
subjective sentences as the sentences which \express some
personal feelings or beliefs" [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>Text is de ned by Dictionary.com, in the linguistic sense, as
\a unit of connected speech or writing, especially composed
of more than one sentence, that forms a cohesive whole".19
The Free On-line Dictionary of Computing describes it as
the \textual material in the mainstream sense", and in the
computing sense as the \data in ordinary ASCII or EBCDIC
representation", where ASCII and EBCDIC are computer
codes for representing alphanumeric characters.20
Topic has three de nitions in Wikipedia: \a.) the phrase in
a clause that the rest of the clause is understood to be about,
b.) the phrase in a discourse that the rest of the discourse
is understood to be about, c.) a special position in a clause
(often at the right or left-edge of the clause) where topics
typically appear".21 WordNet de nes topic as \the subject
matter of a conversation or discussion".22</p>
    </sec>
    <sec id="sec-7">
      <title>RELATED WORK</title>
      <p>
        Giunchiglia et al. consider knowledge diversity as an asset
to improve navigation and search [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], however, they do not
provide a representation model to represent the knowledge
gathered using their technology. Liu introduces the core
topics in the eld of sentiment analysis and opinion mining,
such as sentiment and subjectivity classi cation,
featurebased sentiment analysis, sentiment analysis of comparative
sentences, opinion search and retrieval, opinion spam and
utility of opinions [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Liu provides de nitions of the
relevant concepts but the work is aimed at the processing of
opinions, and not at representing opinions. Balahur and
Steinberger provide their insight on sentiment analysis for
the news domain [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and as such argue the need for clearly
de ning the source and target of a sentiment. They provide
guidelines on annotating news contents with di erent
sentiments, however, they do neither discuss the representation
of the captured knowledge.
      </p>
      <p>The listed works present technologies and methodologies
to gather di erent aspects of diversity, but they do not
provide any representation model for this gathered knowledge.
In contrast, our aim is to work towards developing a
knowledge diversity model to represent the di erent aspects of
diversity.</p>
    </sec>
    <sec id="sec-8">
      <title>FUTURE WORK AND CONCLUSIONS</title>
      <p>The goal of this paper was to collect a comprehensive
glossary of terms that are relevant in the context of
knowledge diversity. Aspects such as opinion, sentiment or bias
are essential in understanding the diversity of news posts,
18www.houghtonmifflinbooks.com/ahd/
19dictionary.reference.com/browse/text
20foldoc.org/text
21en.wikipedia.org/wiki/Topic
22wordnetweb.princeton.edu/perl/webwn?s=topic
Wikipedia articles, or customer feedback. Only when
diversity can be computationally accessible to the machine, the
capturing and interpretation of opinions and sentiments can
be automated and results extracted at larger scale.</p>
      <p>The intention is to derive a knowledge diversity model
from the glossary presented in this paper. In the next step
it will be necessary to determine the concrete questions that
will have to be answered for the showcase scenarios, and
to extract the de nitions that cover these relevant aspects.
Another important future work would be to determine the
relationships among the aforementioned concepts. As an
example, based on the de nition presented in this paper we
can conclude that sentiments are a way to express opinions.
Subjectivity refers to the perspective, beliefs and feelings of
a person. Bias is in uenced by someone's personal opinion.
A particular bias can in uence the subjectivity of a
sentence when it contains an opinion. Opinions are expressed
by the opinion expressions. Opinion expressions are
subjective statements contained in the information objects. The
concepts and relationships can be seen as the baseline for the
speci cation of the knowledge diversity ontology that yields
the schema information for semantically capturing the
diversity and context of the textual content considered. Context,
also not part of the collected de nitions above, is
important to interpret diverse standpoints in view of their
sociodemographic, spatio-temporal and historic relationship to
each other. In many situation, taking the customer
relationship management as an example, it is not only relevant
to interpret diverging opinions and sentiments of customers
but also to understand the situation of the opinion holders
such as for example their country of residence. This allows
for drawing further conclusions relevant for shaping the
business.</p>
      <p>Acknowledgments: The work presented in this paper is
supported by the European Union's 7th Framework
Programme (FP7/2007-2013) under Grant Agreement 257790.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Balahur</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Steinberger</surname>
          </string-name>
          .
          <article-title>Rethinking Sentiment Analysis in the News: from Theory to Practice and back</article-title>
          .
          <source>In 1st Workshop on Opinion Mining and Sentiment Analysis</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Brachman</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Levesque</surname>
          </string-name>
          .
          <article-title>Knowledge representation and reasoning</article-title>
          . Morgan Kaufmann Publishers,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>J.</surname>
          </string-name>
          <article-title>Butter eld. Collins English dictionary: Complete and unabridged</article-title>
          .
          <source>HarperCollins Publishers</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L.</given-names>
            <surname>Floridi</surname>
          </string-name>
          . Information:
          <string-name>
            <given-names>A Very</given-names>
            <surname>Short Introduction</surname>
          </string-name>
          . Oxford University Press,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>F.</given-names>
            <surname>Giunchiglia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Maltese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Madalli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Baldry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Wallner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Lewis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Denecke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Skoutas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and I.</given-names>
            <surname>Marenzi</surname>
          </string-name>
          .
          <article-title>Foundations for the representation of diversity, evolution, opinion and bias</article-title>
          .
          <source>Technical Report DISI-09-063</source>
          , University of Trento,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>T.</given-names>
            <surname>Honderich</surname>
          </string-name>
          .
          <source>The Oxford Companion to Philosophy</source>
          . Oxford University Press,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.</given-names>
            <surname>Liu</surname>
          </string-name>
          .
          <source>Handbook of Natural Language Processing, chapter Sentiment Analysis and Subjectivity</source>
          , pages
          <volume>627</volume>
          {
          <fpage>666</fpage>
          . CRC Press,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>W.</given-names>
            <surname>Parrott</surname>
          </string-name>
          . Emotions in Social Psychology: Essential Readings. Psychology Press,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>