<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards the Definition of an Ontology for Trust in (Web) Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Davide Ceolin</string-name>
          <email>d.ceolin@vu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Archana Nottamkandath</string-name>
          <email>a.nottamkandath@vu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>VU University</institution>
          ,
          <addr-line>Amsterdam</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Wan Fokkink</institution>
          ,
          <addr-line>and Valentina Maccatrozzo</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper introduces an ontology for representing trust that extends existing ones by integrating them with recent trust theories. Then, we propose an extension of such an ontology, tailored for representing trust assessments of data, and we outline its specificity and its relevance. 1 Stephen Marsh, “Trust: Really, Really Trust”, IFIP Trust Management Conference 2014 Tutorial</p>
      </abstract>
      <kwd-group>
        <kwd>Trust</kwd>
        <kwd>Ontology</kwd>
        <kwd>Web Data</kwd>
        <kwd>Resource Definition Framework (RDF)</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In this paper we tackle the problem of modeling and representing trust
assertions, in particular about (Web) data. This is an important issue for a variety
of reasons. First, trust is an important aspect both of everyday life and of many
computational approaches, for similar reasons. In fact, trust is a “leap of faith” 1
that is necessary to be taken whenever we need to rely on third party agents or
information. We decide whether or not to take this leap of faith based on the
evaluation of the trustworthiness of the agent or information. In general, when
trusting, a risk is involved, i.e., the risk of relying on uncertain and possibly
unpredictable actions or information. We can soften such a risk, and one way
to achieve this result is to share trust and trustworthiness values, along with
their provenance, to allow their reuse and increase the probability to correctly
place trust thanks to the availability of this information. Therefore, an ontology
for trust assessments, in particular of Web data, can indicate the basic elements
that are necessary to define a trust value.</p>
      <p>This paper aims at introducing an ontology for trust representation, starting
from existing ones and extending them to cover aspects indicated by recent trust
theories. In Section 2 we present related work, in Section 3 we provide a summary
of the trust theory of O’Hara that we use in the rest of the paper, in Section 4
we propose an extended ontology for representing trust and in Section 5 we
expose our vision about the issues of trusting (Web) data. Lastly, we conclude
in Section 6.</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Trust is a widely explored topic within a variety of computer science areas.
Here, we focus on those works directly touching upon the intersection of trust,
reputation and the Web. We refer the reader to the work of Sabater and Sierra
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], Artz and Gil [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and Golbeck [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] for comprehensive reviews about trust
in artificial intelligence, Semantic Web and Web respectively. Trust has also
been widely addressed in the agent systems community. Pinyol and Sabater-Mir
provide an up-to-date review of the literature in this area [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>
        We extend the ontology proposed by Alnemr et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. We choose it because:
(1) it focuses on the computational part of trust, rather than on social and agent
aspects that are marginal to our scope, and (2) it already presents elements that
are useful to represent computational trust elements. Nevertheless, we propose
to extend it to cover at least the main elements of the trust theory of O’Hara,
that are missing from their original ontology, and we highlight how these
extensions can be beneficial to model trust in (Web) data. Viljanen [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] envisions
the possibility to define an ontology for trust, but puts a particular emphasis
on trust between people or agents. Heath and Motta [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] propose an ontology
for representing expertise, thus allowing us to represent an important aspect of
trust, but again posing more focus on the agents rather than on the data. A
different point of view is taken by Sherchan et al. [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], who propose an ontology
for modeling trust in services.
      </p>
      <p>
        Goldbeck at al. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], Cesare et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and Huang et al. [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] propose ontologies
for modeling trust in agents. Although these could be combined with the ontology
we propose (e.g., to model the trust in the author of a piece of data), for the
moment their focus falls outside of the scope of our work, that is trust in data.
      </p>
      <p>
        Trust has been modeled also in previous works of ours [
        <xref ref-type="bibr" rid="ref6 ref7 ref8 ref9">7,6,8,9</xref>
        ] using generic
models (e.g., the Open Annotation Model [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] or the RDF Data Cube
Vocabulary [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]). Here we aim at providing a specific model for representing trust.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>A Definition of Trust in Short</title>
      <p>
        We recall here the main elements of “A Definition of Trust” by O’Hara [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], that
provide the elements of trust we use to extend the ontology of Alnemr et al.
Tw&lt;Y,Z,R(A),C&gt; (Trustworthiness) agent Y is willing, able and
motivated to behave in such a way as to conform to behaviour R, to the benefit
of members of audience A, in context C, as claimed by agent Z.
Tr&lt;X,Y,Z,I(R(A),c),Deg,Warr&gt; (Trust attitude) X believes, with
confidence Deg on the basis of warrant Warr, that Y’s intentions, capacities and
motivations conform to I(R[A],c), which X also believes is entailed by R(A),
a claim about how Y will pursue the interests of members of A, made about
Y by a suitably authorised Z.
      </p>
      <p>X places trust in Y (Trust Action) X performs some action which
introduces a vulnerability for X, and which is inexplicable without the truth of
Trust attitude.</p>
    </sec>
    <sec id="sec-4">
      <title>Extending a Trust Ontology</title>
      <p>
        We are interested in enabling the sharing of the trust values regarding both
trust attitude and actions, along with their provenance. The ontology proposed
by Alnemr et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] captures the basic computational aspects of these trust
values. However we believe that it lacks some peculiar trust elements that are
present in the theory of O’Hara, and thus we extend that ontology as shown
in Figure 12. Compared with the ontology of Alnemr et al., we provide some
important additions. We clearly identify the parts involved in the trust relation:
Trustor (source): every trust assessment is made by an agent (human or not),
that takes his decision based on his policy and on the evidence at his disposal;
Trustee (target): the agent or piece of information that is actually being
trusted or not trusted. This class replaces the generic “Entity” class, as it
emphasizes its role in the trust relation.
      </p>
      <p>We also distinguish between the attitude and the act of trusting.
Trust Attitude Object: it represents the graded belief held by the trustor in
the trustworthiness of the trustee and it is treated as a quality attribute
when deciding if to place trust in the trustee or not. It replaces the
reputation object defined by Alnemr et al. because it has a similar function to
it (quantifying the trust in something), but implements the trust attitude
relation defined by O’Hara that is more precise and complete (e.g. warranties
are not explicitly modeled by the reputation object);
Trust Action Object: the result of the action of placing trust. Placing trust
is an instantaneous action based on an “outright” belief. Therefore the trust
value is likely to be a Boolean value.</p>
      <p>Role, Context and Warranty: in the original ontology, the criterion is a
generic class that contextualizes the trust value. We specialize it, to be able to
model the role and the context indicated in the theory of O’Hara, as well as
the evidence on which the trust value is based, by means of the warranty.</p>
      <p>The trustworthiness relation is not explicitly modeled, since it falls outside
our current focus. We discuss this further in the following section. The remaining
elements of the model shown in Figure 1 are part of the original trust ontology.
These include a criterion for the trust value, and an algorithm that allows
combining observations (warranties) into a trust value (an algorithm is used also to
determine the value of the trust action). The trust attitude value corresponds
to the Deg element of the theory of O’Hara. We model the action both when it
is performed and when it is not. Both trust values are modeled uniformly.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Modeling Trust in Data</title>
      <p>In the previous section we provided an extended ontology that aims at capturing
the basic elements that are involved in the process of taking trust decisions. Here
we focus on the specificity of trusting (Web) data.
2 The ontology is available at http://trustingwebdata.org/ontology
Role</p>
      <p>*
collectedBy
1</p>
      <p>Warranty</p>
      <p>*
hasWarranty
hasRole1</p>
      <p>*
hasCriteria 1...*</p>
      <p>Context</p>
      <p>*
hasContext rdfs:subClassof</p>
      <p>1 1
Criterion
1</p>
      <p>Description</p>
      <p>Name
* 1...*
CalculatedBy</p>
      <p>rdfs:subClassof
hasValue
part of
1...*</p>
      <p>1 *
Trust Attitude Value</p>
      <p>1
Computation</p>
      <p>Algorithm
1 1
hasCriteria
Collection Algorithm 1</p>
      <p>Assessment
rdf:type rdf:type</p>
      <p>Rating</p>
      <p>
        Data are used as information carriers, so actually trusting data does not mean
to place trust in a sequence of symbols. It rather means to place trust in the
interpretation of such a sequence of symbols and on the basis of its trustworthiness.
For instance, consider a painting reproducing the city “Paris” and its annotation
“Paris”. To trust the annotation, we must have evidence that the painting
actually corresponds to the city Paris. But, to do so, we must: (1) give the right
interpretation to the word “Paris” (e.g., there are 26 US cities and towns named
“Paris”), and (2) check if one of the possible interpretations is correct. Both in
the case the picture represents another city or in the case the picture represents
a town named Paris which existence we ignored, we would not place trust in the
data, but for completely different reasons. One possible RDF representation of
the above example is: exMuseum:ParisPainting ex:depicts dbpedia:Paris,
where we take for granted the correctness of the subject and of the property
and, if we accept the triple, we do so because we believe in the correctness of the
object in that context (represented by the subject), and role (represented by the
property). We make use of the semantics of RDF 1.1 [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], from which we recall
the elements of a simple interpretation I of an RDF graph:
1. A non-empty set IR of resources, called the domain or universe of I.
2. A set IP, called the set of properties of I.
3. A mapping IEXT : IP ! P (IR IR).
4. A mapping IS: IRIs ! (IR [ IP). An IRI (Internationalized Resource
Identifier [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]) is a generalization of a URI [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
5. A partial mapping IL from literals into IR
Also, the following semantic conditions for ground graphs hold:
a. if E is a literal then I(E) = IL(E)
b. if E is an IRI then I(E) = IS(E)
c. if E is a ground triple s p o. then I(E) = true if I(p) 2 IP and the pair
&lt;I(s),I(o)&gt; 2 IEXT(I(p)) otherwise I(E) = false.
d. if E is a ground RDF graph then I(E) = false if I(E’) = false for some triple
E’ 2 E, otherwise I(E) = true.
      </p>
      <p>Items 1, 2, 4 and 5 map the URIs, literals and the RDF triples to real-world
objects. We are particularly interested in Item 3, that maps the property of an
RDF triple to the corresponding real-world relation between subject and object.
Trusting a piece of data means to place trust in the information it carries, in a
given context. The trust context can be represented by means of the subject and
object of an RDF triple, so their semantic interpretation is assumed to be known
by the trustor. If the trustor trusts the triple, he believes that the interpretation
of the object o makes the interpretation of the triple s p o true:
TrustAttitudetrustor(ojs; p) = Belief trustor(9I(o) : &lt;I(s),I(o)&gt; 2 IEXT (I(p))</p>
      <p>
        Belief is an operator that maps logical propositions to values that quantify
their believed truth, e.g., by means of subjective opinions [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] quantified in the
Deg value of the theory of O’Hara and based on evidence expressed by Warranty.
      </p>
      <p>By virtue of items c and d, we do not model explicitly the trustworthiness
relation defined by O’Hara: we consider an object o to be trustworthy by virtue
of the fact that it is part of an RDF triple that is asserted.</p>
      <p>Criterion</p>
      <p>Trustor (Source)
rdf:type
ex:me</p>
      <p>Trustworthiness Object
exMuseum:ParisPainting
ex:depicts
rdf:type
hasContext
hasRole
rdf:object</p>
      <p>CO
Trustee (Target)
rdf:type
dbpedia:Paris</p>
      <p>hasSource rdf:type
hasContext TO1
hasTarget hasTrustAttitudeValues
0.8 calculatedBy</p>
      <p>Computation</p>
      <p>Algorithm
rdf:type
TrustAlgorithm
In this paper we introduce an ontology for trust representation that extends
an existing model with recent trust theories. We specialize it in order to model
data-related trust aspects, and we motivate our design choices based on standard
RDF 1.1 semantics. This model is still at a very early stage, but it emerges from
previous research and from standard trust theories. In the future, it will be
extended, and evaluated in depth, also by means of concrete applications.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>R.</given-names>
            <surname>Alnemr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Paschke</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Meinel</surname>
          </string-name>
          .
          <article-title>Enabling reputation interoperability through semantic technologies</article-title>
          .
          <source>In I-SEMANTICS</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          . ACM,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>D.</given-names>
            <surname>Artz</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gil</surname>
          </string-name>
          .
          <article-title>A survey of trust in computer science and the semantic web</article-title>
          .
          <source>Journal of Semantic Web</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Fielding</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Masinter. Uniform Resource</surname>
          </string-name>
          <article-title>Identifier (URI): Generic Syntax (RFC 3986)</article-title>
          .
          <source>Technical report, IETF</source>
          ,
          <year>2005</year>
          . http://www.ietf. org/rfc/rfc3986.txt.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>S.</given-names>
            <surname>Bradshaw</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Brickley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. J. G.</given-names>
            <surname>Castro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Clark</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Cole</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Desenne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gerber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Isaac</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Jett</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Habing</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Haslhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hellmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hunter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Leeds</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Magliozzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Morris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Morris</surname>
          </string-name>
          , J. van Ossenbruggen,
          <string-name>
            <surname>S. SoilandReyes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and D.</given-names>
            <surname>Whaley</surname>
          </string-name>
          .
          <article-title>Open Annotation Core Data Model</article-title>
          . http: //www.openannotation.org/spec/core,
          <year>2012</year>
          . W3C Community Draft.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Casare</surname>
          </string-name>
          and
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Sichman</surname>
          </string-name>
          .
          <article-title>Towards a functional ontology of reputation</article-title>
          .
          <source>In AAMAS</source>
          , pages
          <fpage>505</fpage>
          -
          <lpage>511</lpage>
          . ACM,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>D.</given-names>
            <surname>Ceolin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nottamkandath</surname>
          </string-name>
          , and
          <string-name>
            <given-names>W.</given-names>
            <surname>Fokkink</surname>
          </string-name>
          .
          <article-title>Automated Evaluation of Annotators for Museum Collections using Subjective Logic</article-title>
          .
          <source>In IFIPTM 2012</source>
          , pages
          <fpage>232</fpage>
          -
          <lpage>239</lpage>
          . Springer, May
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>D.</given-names>
            <surname>Ceolin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nottamkandath</surname>
          </string-name>
          , and
          <string-name>
            <given-names>W.</given-names>
            <surname>Fokkink</surname>
          </string-name>
          .
          <article-title>Semi-automated Assessment of Annotation Trustworthiness</article-title>
          .
          <source>In PST 2013. IEEE</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>D.</given-names>
            <surname>Ceolin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nottamkandath</surname>
          </string-name>
          , and
          <string-name>
            <given-names>W.</given-names>
            <surname>Fokkink</surname>
          </string-name>
          .
          <article-title>Efficient semi-automated assessment of annotations trustworthiness</article-title>
          .
          <source>Journal of Trust Management</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ):
          <fpage>3</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>D.</given-names>
            <surname>Ceolin</surname>
          </string-name>
          ,
          <string-name>
            <surname>W. R. van Hage</surname>
          </string-name>
          , and
          <string-name>
            <given-names>W.</given-names>
            <surname>Fokkink</surname>
          </string-name>
          .
          <article-title>A Trust Model to Estimate the Quality of Annotations using the Web</article-title>
          .
          <source>In WebSci 2010. Web Science Trust</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>R.</given-names>
            <surname>Cyganiak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Reynolds</surname>
          </string-name>
          , and
          <string-name>
            <surname>J. Tennison.</surname>
          </string-name>
          <article-title>The rdf data cube vocabulary</article-title>
          .
          <source>Technical report, W3C</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>M.</given-names>
            <surname>Dürst</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Suignard. Internationalized Resource</surname>
          </string-name>
          <article-title>Identifiers (IRIs) (RFC 3987)</article-title>
          .
          <source>Technical report, IETF</source>
          ,
          <year>2005</year>
          . http://www.ietf.org/rfc/rfc3987.txt.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>J.</given-names>
            <surname>Golbeck</surname>
          </string-name>
          .
          <source>Trust on the World Wide Web: A Survey. Foundations and Trends in Web Science</source>
          ,
          <volume>1</volume>
          (
          <issue>2</issue>
          ):
          <fpage>131</fpage>
          -
          <lpage>197</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>J. Golbeck</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Parsia</surname>
            , and
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>Trust networks on the semantic web</article-title>
          .
          <source>In CIA</source>
          , pages
          <fpage>238</fpage>
          -
          <lpage>249</lpage>
          . Springer,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>T.</given-names>
            <surname>Heath</surname>
          </string-name>
          and
          <string-name>
            <surname>E. Motta.</surname>
          </string-name>
          <article-title>The Hoonoh Ontology for describing Trust Relationships in Information Seeking</article-title>
          .
          <source>In PICKME 2008</source>
          .
          <article-title>CEUR-WS</article-title>
          .org,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>J.</given-names>
            <surname>Huang</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Fox</surname>
          </string-name>
          .
          <article-title>An ontology of trust: Formal semantics and transitivity</article-title>
          .
          <source>In ICEC '06</source>
          , pages
          <fpage>259</fpage>
          -
          <lpage>270</lpage>
          . ACM,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>A.</given-names>
            <surname>Jøsang</surname>
          </string-name>
          .
          <article-title>A logic for uncertain probabilities</article-title>
          .
          <source>Intl. Journal of Uncertainty, Fuzziness and Knowledge-Based Systems</source>
          ,
          <volume>9</volume>
          (
          <issue>3</issue>
          ):
          <fpage>279</fpage>
          -
          <lpage>212</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>K. O'Hara. A General</surname>
          </string-name>
          <article-title>Definition of Trust</article-title>
          .
          <source>Technical report</source>
          , University of Southampton,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18. I. Pinyol and
          <string-name>
            <given-names>J.</given-names>
            <surname>Sabater-Mir</surname>
          </string-name>
          .
          <article-title>Computational trust and reputation models for open multi-agent systems: A review</article-title>
          .
          <source>Artif. Intell. Rev.</source>
          ,
          <volume>40</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>25</lpage>
          ,
          <year>June 2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>J.</given-names>
            <surname>Sabater</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          .
          <article-title>Review on computational trust and reputation models</article-title>
          .
          <source>Artificial Intelligence Review</source>
          ,
          <volume>24</volume>
          :
          <fpage>33</fpage>
          -
          <lpage>60</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20. W. Sherchan,
          <string-name>
            <given-names>S.</given-names>
            <surname>Nepal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hunklinger</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Bouguettaya</surname>
          </string-name>
          .
          <article-title>A trust ontology for semantic services</article-title>
          .
          <source>In IEEE SCC</source>
          , pages
          <fpage>313</fpage>
          -
          <lpage>320</lpage>
          . IEEE Computer Society,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>L.</given-names>
            <surname>Viljanen</surname>
          </string-name>
          .
          <article-title>Towards an ontology of trust</article-title>
          . In Trust, Privacy, and Security in Digital Business, pages
          <fpage>175</fpage>
          -
          <lpage>184</lpage>
          . Springer,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <source>W3C. RDF 1</source>
          .1 Semantics. http://www.w3.org/TR/2014/ REC-rdf11
          <string-name>
            <surname>-</surname>
          </string-name>
          mt-20140225/,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>