<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Generating Trust-Based Recommendations for Social Networks organized by Groups</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>DIIES, University Mediterranea of Reggio Calabria, Via Graziella, Localita` Feo di Vito</institution>
          ,
          <addr-line>89122 Reggio Calabria</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <fpage>49</fpage>
      <lpage>54</lpage>
      <abstract>
        <p>-Evidence suggests that people often waver to buy trust is represented by a number of models that rely on global from online vendors because of uncertainty about vendor behav- reputation [4]-[6]: they are based on the evaluation of the ior or the risk of having wrong information about the products. behaviors of the users, that is shared across the entire commupTerrucsetptpi olanyss oaf rcisekn.trMalorreooleveri,nthheemlpaitnicg gcroonuspusmaerres goavienricnogmae nity. These models, however, show an evident limitation due lot of attention and high centrality in online community, as users to the difficulty of taking the effects of malicious or fraudulent share opinions and/or mutually collaborate for reaching their behaviors into account, thus making the feedback themselves. targets. The users can be helped by personal software agents Other approaches, that consider also a local perspective of able to perform activities aimed at supporting the purchase of the trust, are limited by the fact they are supervised, i.e. nperotwduorcktss. Torhgisanpizaepderbpyrogproosuepss.a Innewpatrrtuicsutlamr,eawsuereprinesesnotciaal they need a training phase in generating recommendations. model to represent this scenario, and we introduce an algorithm In [7], we proposed to integrate the traditional use of the for detecting trust recommendations in virtual communities in global reputation with the local reputation, that is based on presence of groups. We technically formalize our idea and show the recommendations coming by the entourage of the user a complete example of how our approach works. (friends, friends of friends and so on). But this proposal was Index Terms-Recommendation, Online Communities, Trust, limited because it does not consider a group-based structure Group. [8]-[10]. In this paper, we define a new model to represent the I. INTRODUCTION groups of users linked by trust relationships. Such a model depends on three main parameters: the relevance given to the reliability with respect to the reputation, the threshold of recommendation under which a product can be considered as not interesting and the number of the groups in online communities. We propose an algorithm for detecting trust recommendations for a user considering the recommendations that come from users within his own group and those of other groups weighted with the global reputation. We technically formalize our idea and algorithm, and we present a complete example of how our approach works. The paper is organized as follows: in Section II we deal with some related work. Section III provides technical details about our approach for finding trust recommendations about products, while Section IV describes a concrete example of application. Finally, in Section V we draw our conclusions and illustrate some possible future works.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        An important issue in Online Social Networks (OSNs) is
that of designing recommender systems capable to provide
OSN users with useful suggestions regarding other potentially
promising OSN users to contact as interlocutors or interesting
content to access. Such an issue leads to the necessity of
considering the opinions that different users express about other
users or OSN content [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]–[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. However, recommender systems
have to face with the general problem of malicious or even
fraudulent behaviors of some users, that results in unreliable
opinions which can negatively affect the effectiveness of the
generated recommendations.
      </p>
      <p>The issue of trusting own interlocutors widely emerged in
large online e-Commerce communities as, for instance eBay,
and now it is largely discussed in many OSNs which allow
their users to create and share contents with other users as well
as opinions. This is the case, for example, of well-focused
OSNs like EPINIONS1 and CIAO2, in which users provide
reviews concerning commercial products falling in different
categories. Almost all of these platforms face this issue by
adopting a reputation system. Reputation is a form of indirect
trust, where a user takes advantage from the opinions coming
from other users for evaluating the probable trustworthiness of
an interlocutor. Commonly, in the traditional OSN contexts,
the reputation of a user is evaluated by averaging feedbacks
provided by all the other users belonging to the same
community. In the past literature, a common approach for predicting</p>
    </sec>
    <sec id="sec-2">
      <title>II. RELATED WORK</title>
      <p>A large number of papers in the literature investigated on
the topic we deal with here, therefore, in this section we cite
only those approaches which we consider comparable with
that discussed in this paper.</p>
      <p>
        Concerning the concept of trust, there exist in the literature
several proposals. Sherchan et al. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] present an important
review of trust, in which they comprehensively examine trust
definitions and measurements, from multiple fields including
sociology, psychology, and computer science. Trust models
[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]–[
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] allow to exploit information derived by direct
experiences and/or opinions of others to trust potential partners by
1www.epinions.com
2www.ciao.it
means of a single measure [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Xia et al. [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] build a
subjective trust management model AFStrust, which considers
multiple factors including direct trust, recommendation trust,
incentive function and active degree, and treats those factors
based on the analytic hierarchy process (AHP) theory and the
fuzzy logic rule. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] describes how to build robust reputation
systems using machine learning techniques, and defines a
framework for translating a trust modeling problem into a
learning problem.
      </p>
      <p>
        In many disciplines, there is a population of people which
should be optimally divided into multiple groups based on
certain attributes to collaboratively perform a particular task
[
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. The problem becomes more complex when some
other requirements are also added: homogeneity,
heterogeneity or a mixture of teams, amount of consideration to the
preferences of individuals, variability or invariability of group
size, having moderators, aggregation or distribution of persons,
overlapping level of teams, and so forth [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]–[
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. Basu
et al. [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] consider the problem of how to form groups such
that the users in the formed groups are most satisfied with
the suggested top-k recommendations. They assume that the
recommendations will be generated according to one of the
two group recommendation semantics, called Least Misery and
Aggregate Voting. Rather than assuming groups are given, or
rely on ad hoc group formation dynamics, their framework
allows a strategic approach for forming groups of users in
order to maximize satisfaction. In [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], the authors reveal how
these problems can be mathematically formulated through a
binary integer programming approach to construct an effective
model which is solvable by exact methods in an acceptable
time.
      </p>
    </sec>
    <sec id="sec-3">
      <title>III. OUR SCENARIO</title>
      <p>
        Our scenario is represented by a virtual community S,
formally denoted as S = ⟨A, G⟩, where A is the set of agents
joined with S and G is the set of groups contained in S. We
also assume that each group g is managed by an administrator
agent ag. Generally, all such communities are organized in
social structures based on social relationship (like, Facebook
[
        <xref ref-type="bibr" rid="ref28">28</xref>
        ], [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] or Twitter [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]). The formation of a group is a
process based on two main events: a user asks for joining
with a group and the administrator of the group accepts or
refuses the request.
      </p>
      <sec id="sec-3-1">
        <title>A. Trust</title>
        <p>The trust measure tu,v is a mapping that receives as input
two agents u and v and yields as output a boolean value
representing the degree of trust between two agents u and
v: tu,v = 0 (resp. tu,v = 1) means that u assigns the minimum
(resp. maximum) trustworthiness to v. The trust measure is
asymmetric, in the sense that we do not automatically expect
that v trusts u at the same level.</p>
        <p>As a theoretical proposal, we had introduced a more general
trust measure, by combining two components relu,v and
repu, where (i) relu,v is the direct reliability of u, i.e. the
trustworthiness that v has in u based on the past interactions
between u and v while (ii) repu is the global reputation of
(1)
(2)
(3)
u, i.e. the trustworthiness that all the community has in u.
The reason of this choice, was due to the necessity, when
v does not have a sufficient direct knowledge of u, to use
the recommendations coming from the other agents of the
community.</p>
        <p>1) Reliability: As for the reliability, we denote it by
the mapping relu,v, assuming values ranging in the domain
[0 · · · 1] ∪ N U LL, while relu,v = NULL means that v did
not have past interactions with u and thus it is not able to
evaluate us’ trustworthiness.</p>
        <p>2) Reputation: As for the reputation of u, we denote it
by repu in the interval [0 · · · 1]ϵR. In order to compute the
reputation, we adopt the notion of
repu =
1</p>
        <p>∑
hmax| REVu| ρ∈REVu
hρ
where | REVu| is the set of the reviews made by the user u
and h is the helpfulness, i.e., it is associated with each review
that represents the level of satisfaction of the other users for
that review. To normalize repu, we divide it by the maximum
value of the helpfulness hmax.</p>
        <p>The two trust components reliability and reputation are
integrated in a unique value to compute the mapping trust
tu,v of u about v, producing a input ranging in [0 · · · 1] as
follows:</p>
        <p>tu,v = α · relu,v + (1 − α) · repv
where α is a real number, ranging in [0...1], which is set
by u to weight the relevance he/she assigns to the reliability
with respect to the reputation.</p>
      </sec>
      <sec id="sec-3-2">
        <title>B. Product recommendation</title>
        <p>The user receives, at the current step, some
recommendations about the products present in the community. In other
words, recpu is the recommendation that the user u receives
about the product p. It is calculated as follows:
recpu =
∑v∈ρ,v̸=u tu,v · ratevp</p>
        <p>∑v∈ρ,v̸=u tu,v</p>
        <p>where ratevp is the review of the the user v about the
product p (a number between 1 and 6), weighed by the trust
of v. This means that his/her opinion about a product is taken
into account if his/her trustworthiness is high. The weighted
average allows us to identify an average value in which the
starting numerical values have their own importance, specified
by its weight. In particular, we can identify the center of
gravity of the rate. In this way, we give more importance to
the rate from users that the user u trusts. With a normal mean
we would lose significant information.</p>
      </sec>
      <sec id="sec-3-3">
        <title>C. Groups</title>
        <p>At this point, we introduce the groups’ concept in the
community. In this context, we define trust t∗u,v in two different
ways. We suppose that the trust perceived by an agent u with
respect to the component of his/her group is equal to 1 (i.e,
t∗u,v=1), instead the agent u considers the trust that user has in
the whole community (see Equation 2). In this way, we define
recg∗p that is the recommendation that the user u receives about
the product p in presence of the groups:
rec∗up =
∑v∈gu ratevp + ∑v∈/gu tu,v · ratevp
∑v∈| REVp| t∗u,v
(4)
where gu is the group to which the agent u belongs
and | REVp| is the set of the agents who have purchased
the product p. It is calculated as the combination of two
contribution: the average rating of the users that belong to
the group of the user u and the score that the other groups
give to the product multiplied by the trust that u assign to its
agents.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>IV. AN EXAMPLE OF SCENARIO: E-C OMMERCE</title>
      <p>Now, we explain how it is possible to use groups to generate
the recommendations of products for the users inserted into an
online e-Commerce communities. As an example, we propose
to model each user by a node (see Figure 1).</p>
      <p>We assume that all the elements of a group are trust-related,
a trust group g determined into G represents a mutual trust
relationship between its elements. In our case, there are four
groups of users called g1, g2, g3 and g4. All the users in the
same group are mutually linked by a trust relationship with
the value 1; while the values of the reliability are shown in
the Table I.</p>
      <p>In particular, in our example, there are nine products that are
divided in three main categories called Electronics, Informatics
and Software (see Table II). In the Table III, we show an
example of datasets.</p>
      <p>In our model, we have associated with each agent a
profile contained, as unique feature, the reputation to review
the products. This reputation has been computed by
averaging, on all the reviews posted by the agent, the
helpfulness associated with each review, where the helpfulness
is an information available on the dataset and obtained
by the opinions expressed by the users of the
community. We obtain that the reputation values (see Equation
1) of the agents belonging to our scenario are as
follows: rep1=0.83; rep2=0.75; rep3=0.66; rep4=0.41; rep5=1;
rep6=0.62; rep7=0.45; rep8=0.5; rep9=0.79; rep10=0 and
rep11=0.58. At this point, we introduce a new value of trust
tu,v that is the combination of the reliability and the reputation.
Fixed the agent a1, we compute the opinion (i.e., trust) that a1
has with regard to other agents. Recall that this value changes
with α. We consider three values of α. In particular, α=1
means that the agent a1 considers only the opinions of the
agents with whom he/she interacted in the past (contrariwise,
α=0). Finally, α=0.5 means that the agent a1 considers in
the same way both the opinions of the agents with whom
he/she interacted both others. For detail, see Tables V- VII.
Let ξ be a threshold fixed by the agent a1, we suggest only
those products that have recpu greater than ξ (in our case, we
fix ξ &gt; 4). In particular, we note that the agent a5 that has
a high value of reliability for the agent a1 buys the products
p8 and p9. Also, u5 assigns to them a high rate while the
rest of the community gives a very low rate. Surely a1 would
be very interested in these products, because he/she trusts a5
with a high value. At this point, we see how the algorithm
behaves. The agent a1 receives, at the current step, some
recommendations by the other agents, in response to previous
recommendation requests (see Table IV). If α=1, we suggest
to a1 the products p6, p8 and p9. In this case, we consider
the recommendations that come from agents that have a high
reliability. In fact, these products were acquired and evaluated
good by agents a5 and a2. Comparing these results with truly
user-purchased products, it is visible that three out of three
products were actually purchased by u1. If α=0, we suggest
to a1 the products p1, p4 and p5. This is correct because they
are products purchased by agents who have a high reputation
in the community. But, these agents did not interact directly
with a1 therefore they do not know his/her preferences. Indeed,
only the product p1 is of interest to a1. If α=0.5, we suggest
to a1 the products p4, p5, p8 and p9. This choice is a good
compromise, since three of the four products are of liking for
the agent a1.</p>
      <p>With the introduction of the groups in the community, we
can consider the assumption made in the Section III. Recall
that, for the agents that are in the same group, the trust is
equal to 1. In our case, a1 is in the group g1 with the agents</p>
      <p>TABLE VI
SIMULATION PARAMETERS FOR α=0.5
a3 and a7, therefore t1∗3 and t1∗7 are always equal to 1. Now,
we can calculate the recommendations (see Equation 4) to the
agent a1 for all the products in the community in presence of
the groups. The table VIII shows the results obtained.</p>
      <p>The results in the presence of the groups are best, because
a3 and a7 know better a1 and consequently are able to make
targeted recommendations.</p>
      <sec id="sec-4-1">
        <title>A. The Performance Recommendation Measure</title>
        <p>In order to model the process of evaluating the performance
of recommendation provided by learning agents, we defined
two indexes. Let be Ri the set of recommendations provided
to the agents ai, and Ri ⊂ Ri the set of recommendations
relating to the products which ai purchased. Besides, let be
Γi∗ the set of purchases made by ai, where Γi is the set of all
actions executed within the context of agent ai.</p>
        <p>To provide a performance measure we defined two indexes,
called Precision and Recall, as follows:</p>
        <p>P re(Ri) = | Γi∗ ∩ Ri|</p>
        <p>| Ri|
Rec(Ri) = | Γi∗ ∩ Ri|
| Γi∗|
(5)
(6)</p>
        <p>By the definition of P re(Ri), it follows that a high value
does not mean to be a good recommender agent. Indeed, it
is possible that the overall performances of provided
recommendations are not the greatest possible. Rec(Ri), which is
the fraction of recommendations successfully suggested by the
agent ai, allows us to consider the aspect above. In our case,
we have different values of Precision and Recall to vary by α
(see Table IX). It is clear that when ai takes into account only
the opinion of the whole community, we have relatively low
performances. Instead, combining the opinion of the whole
community with that of the agents who had direct interactions
with ai, we obtain high values of Precision and Recall. In
particular, when α=0.5 in the absence of the groups we have
a higher value of Recall because the agents who belong to
the community but had no interactions with ai bought many
products and then their evaluations are appreciated in the
community. This situation allows to advise the products that
are of interest for ai. However, when α=1 in the presence
of the groups, we obtain Rec(Ri)=0.8 that is the highest
value. This means that the recommendations of agents within
the group joined to those of the agents with which ai has
interacted in the past, allow us to suggest the products of
his/her interest with very high accuracy (88%).</p>
        <p>In this paper, we propose a model capable to integrate
reliability and reputation in an OSN organized by groups.
In particular, we considered three important parameters in
order to characterize the model: the relevance given to the
reliability with respect to the reputation, the threshold of
recommendation under which a product can be considered
as not interesting and the number of the groups. We have
presented a realistic example and the results have shown that
when the agent takes into account only the reputation, we
have low performances. Instead, combining the opinion of the
whole community (reputation) with that of the agents who had
direct interactions with her/him (reliability), we obtain high
values of Precision and Recall. However, in the presence of
the groups, we obtain that Recall has the highest value. In
other words, in this letter case, our model allows to suggest
the products with very high accuracy (88%). In this paper,
we limited ourselves to introduce and formalize the idea, and
we present an example of how the presented approach can
found product recommendations in an online e-Commerce
communities. Our ongoing research is currently devoted to
apply the approach to real social networks, in which the
advantages and limitations introduced by our proposal can be
quantitatively and effectively evaluated.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>F.</given-names>
            <surname>Buccafurri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          , and G. Lax, “
          <article-title>Allowing continuous evaluation of citizen opinions through social networks</article-title>
          ,
          <source>” in International Conference on Electronic Government and the Information Systems Perspective</source>
          . Springer,
          <year>2012</year>
          , pp.
          <fpage>242</fpage>
          -
          <lpage>253</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2] --, “
          <article-title>Allowing privacy-preserving analysis of social network likes,” in Privacy, Security and Trust (PST</article-title>
          ),
          <source>2013 Eleventh Annual International Conference on. IEEE</source>
          ,
          <year>2013</year>
          , pp.
          <fpage>36</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>F.</given-names>
            <surname>Buccafurri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          , G. Lax, and
          <string-name>
            <given-names>V.</given-names>
            <surname>Saraswat</surname>
          </string-name>
          , “
          <article-title>Analysis-preserving protection of user privacy against information leakage of social-network likes,”</article-title>
          <source>Information Sciences</source>
          , vol.
          <volume>328</volume>
          , pp.
          <fpage>340</fpage>
          -
          <lpage>358</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P.</given-names>
            <surname>De Meo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nocera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Ursino</surname>
          </string-name>
          , “
          <article-title>Recommendation of reliable users, social networks and high-quality resources in a social internetworking system</article-title>
          ,”
          <source>Ai Communications</source>
          , vol.
          <volume>24</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>31</fpage>
          -
          <lpage>50</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M.</surname>
          </string-name>
          <article-title>Sarne´, “An evolutionary approach for cloud learning agents in multicloud distributed contexts,” in 2015 IEEE 24th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises</article-title>
          . IEEE,
          <year>2015</year>
          , pp.
          <fpage>99</fpage>
          -
          <lpage>104</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>P. D.</given-names>
            <surname>Meo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Musial-Gabrys</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , G. M. Sarn e`, and
          <string-name>
            <given-names>L.</given-names>
            <surname>Aroyo</surname>
          </string-name>
          , “
          <article-title>Using centrality measures to predict helpfulness-based reputation in trust networks</article-title>
          ,
          <source>” ACM Transactions on Internet Technology (TOIT)</source>
          , vol.
          <volume>17</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>8</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>De Meo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Recommending users in social networks by integrating local and global reputation</article-title>
          ,
          <source>” in International Conference on Internet and Distributed Computing Systems</source>
          . Springer,
          <year>2014</year>
          , pp.
          <fpage>437</fpage>
          -
          <lpage>446</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P.</given-names>
            <surname>De Meo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Forming classes in an e-learning social network scenario,”</article-title>
          <source>in International Symposium on Intelligent and Distributed Computing</source>
          . Springer,
          <year>2016</year>
          , pp.
          <fpage>173</fpage>
          -
          <lpage>182</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , “
          <article-title>Finding semantic associations in hierarchically structured groups of web data</article-title>
          ,
          <source>” Formal Aspects of Computing</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>5-6</issue>
          , pp.
          <fpage>867</fpage>
          -
          <lpage>884</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>P. De Meo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Ferrara</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Rosaci</surname>
            , and
            <given-names>G. M.</given-names>
          </string-name>
          <article-title>Sarne´, “Trust and compactness in social network groups,” IEEE transactions on cybernetics</article-title>
          , vol.
          <volume>45</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>216</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>W.</given-names>
            <surname>Sherchan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Nepal</surname>
          </string-name>
          , and C. Paris, “
          <article-title>A survey of trust in social networks</article-title>
          ,
          <source>” ACM Computing Surveys (CSUR)</source>
          , vol.
          <volume>45</volume>
          , no.
          <issue>4</issue>
          , p.
          <fpage>47</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E.</given-names>
            <surname>Majd</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.</given-names>
            <surname>Balakrishnan</surname>
          </string-name>
          , “
          <article-title>A trust model for recommender agent systems</article-title>
          ,” Soft Computing, pp.
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>S.</given-names>
            <surname>Tadelis</surname>
          </string-name>
          , “
          <article-title>Reputation and feedback systems in online platform markets</article-title>
          ,
          <source>” Annual Review of Economics</source>
          , vol.
          <volume>8</volume>
          , no.
          <issue>1</issue>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M.</surname>
          </string-name>
          <article-title>Sarne´, “A partnership-based approach to improve qos on federated computing infrastructures,”</article-title>
          <source>Information Sciences</source>
          , vol.
          <volume>367</volume>
          , pp.
          <fpage>246</fpage>
          -
          <lpage>258</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M.</surname>
          </string-name>
          <article-title>Sarne´, “A reputation-based approach to improve qos in cloud service composition,” in Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE</article-title>
          ),
          <source>2015 IEEE 24th International Conference on. IEEE</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>108</fpage>
          -
          <lpage>113</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. M.</surname>
          </string-name>
          <article-title>Sarne´, and</article-title>
          <string-name>
            <given-names>S.</given-names>
            <surname>Garruzzo</surname>
          </string-name>
          , “
          <article-title>Integrating trust measures in multiagent systems</article-title>
          ,”
          <source>International Journal of Intelligent Systems</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>15</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>L.</given-names>
            <surname>Xiong</surname>
          </string-name>
          and L. Liu, “Peertrust:
          <article-title>Supporting reputation-based trust for peer-to-peer electronic communities,” Knowledge and Data Engineering, IEEE Transactions on</article-title>
          , vol.
          <volume>16</volume>
          , no.
          <issue>7</issue>
          , pp.
          <fpage>843</fpage>
          -
          <lpage>857</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>H.</given-names>
            <surname>Xia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Jia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Ju</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Li</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zhu</surname>
          </string-name>
          , “
          <article-title>A subjective trust management model with multiple decision factors for manet based on ahp and fuzzy logic rules</article-title>
          ,
          <source>” in Green Computing and Communications (GreenCom)</source>
          ,
          <source>2011 IEEE/ACM International Conference on. IEEE</source>
          ,
          <year>2011</year>
          , pp.
          <fpage>124</fpage>
          -
          <lpage>130</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>X.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Datta</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.-P.</given-names>
            <surname>Lim</surname>
          </string-name>
          ,
          <article-title>Computational Trust Models and Machine Learning</article-title>
          . CRC Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>M.</given-names>
            <surname>Wessner and H.-R. Pfister</surname>
          </string-name>
          , “
          <article-title>Group formation in computer-supported collaborative learning,” in Proceedings of the 2001 international ACM SIGGROUP conference on supporting group work</article-title>
          .
          <source>ACM</source>
          ,
          <year>2001</year>
          , pp.
          <fpage>24</fpage>
          -
          <lpage>31</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “Grouptrust:
          <article-title>Finding trust-based group structures in social communities</article-title>
          ,” in
          <source>International Symposium on Intelligent and Distributed Computing</source>
          . Springer,
          <year>2016</year>
          , pp.
          <fpage>143</fpage>
          -
          <lpage>152</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>L. R.</given-names>
            <surname>Hoffman</surname>
          </string-name>
          and
          <string-name>
            <given-names>N. R.</given-names>
            <surname>Maier</surname>
          </string-name>
          , “
          <article-title>Quality and acceptance of problem solutions by members of homogeneous and heterogeneous groups</article-title>
          .”
          <source>The Journal of Abnormal and Social Psychology</source>
          , vol.
          <volume>62</volume>
          , no.
          <issue>2</issue>
          , p.
          <fpage>401</fpage>
          ,
          <year>1961</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Forming homogeneous classes for e-learning in a social network scenario,” in Intelligent Distributed Computing IX</article-title>
          . Springer,
          <year>2016</year>
          , pp.
          <fpage>131</fpage>
          -
          <lpage>141</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24] --, “
          <article-title>Using semantic negotiation for ontology enrichment in e-learning multi-agent systems</article-title>
          ,” in Complex,
          <source>Intelligent, and Software Intensive Systems (CISIS)</source>
          ,
          <source>2015 Ninth International Conference on. IEEE</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>474</fpage>
          -
          <lpage>479</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>F.</given-names>
            <surname>Buccafurri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Furfaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Garro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Giacalone</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Tundis</surname>
          </string-name>
          , “
          <article-title>An analytical processing approach to supporting cyber security compliance assessment</article-title>
          ,”
          <source>in Proceedings of the 8th International Conference on Security of Information and Networks. ACM</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>46</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>S.</given-names>
            <surname>Basu Roy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. V.</given-names>
            <surname>Lakshmanan</surname>
          </string-name>
          , and R. Liu, “From group recommendations to group formation,”
          <source>in Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data. ACM</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>1603</fpage>
          -
          <lpage>1616</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Kardan</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Sadeghi</surname>
          </string-name>
          , “
          <article-title>An efficacious dynamic mathematical modelling approach for creation of best collaborative groups</article-title>
          ,
          <source>” Mathematical and Computer Modelling of Dynamical Systems</source>
          , vol.
          <volume>22</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>39</fpage>
          -
          <lpage>53</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>F.</given-names>
            <surname>Buccafurri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          , and G. Lax, “
          <article-title>Privacy-preserving resource evaluation in social networks,” in Privacy, Security and Trust (PST</article-title>
          ),
          <source>2012 Tenth Annual International Conference on. IEEE</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>51</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29] --, “
          <article-title>Allowing non-identifying information disclosure in citizen opinion evaluation,”</article-title>
          <source>in International Conference on Electronic Government and the Information Systems Perspective</source>
          . Springer,
          <year>2013</year>
          , pp.
          <fpage>241</fpage>
          -
          <lpage>254</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30] --, “
          <article-title>Social signature: Signing by tweeting</article-title>
          ,
          <source>” in International Conference on Electronic Government and the Information Systems Perspective</source>
          . Springer,
          <year>2014</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>