<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Supporting Learners-to-Lerners Interactions Basing on Online Social Networks Information</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Pasquale De Meo</string-name>
          <email>p.demeo@dmi.un</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fabrizio Messina</string-name>
          <email>messina@dmi.un</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Domenico Rosaci</string-name>
          <email>domenico.rosaci@unirc.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Giuseppe M. L. Sarne´</string-name>
          <email>sarne@unirc.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Pasquale De Meo is with the Dept. DICAM, University of Messina</institution>
          ,
          <addr-line>Viale Andrea Doria, 6 - 01010 Messina</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <fpage>56</fpage>
      <lpage>61</lpage>
      <abstract>
        <p>-E-Learning students can benefit from proper class formation process based on the student needs. In particular, Online Social Networks make available data concerning users' interactions, as skills and trust relationships, that are behind the dynamics of thematic social network groups, and can be explouted to form e-Learning classes. To this aim, we propose a model based on such information, which are properly combined to support the dynamics of e-Learning classes on Online Social Networks. The approach provide a way to give suggestions to users about the best classes to join with and to class adminastrors the best students to accept. The proposed approach has been tested by simulating an e-Learning scenario within a large social network by showing its capability to satisfy all the actors.</p>
      </abstract>
      <kwd-group>
        <kwd>Social Networks</kwd>
        <kwd>Software Agents</kwd>
        <kwd>Thematic Groups</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. INTRODUCTION</title>
      <p>
        E-Learning (EL) represents a good solution for courses, as
it provides time and location flexibility, low costs and
information sharing [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In this context, among the factors affecting
learners progresses there are personal attitudes, initial skills
and the level of mutual trust, which influences the attitudes
of peers to start interactions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and minimizes the cold start
effect. Given that those information are widely available in
Online Social Networks (OSNs), EL activities can benefit from
synergies with OSNs. Besides, many OSN platforms [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
support thematic groups that, for their relevance, have been
largely investigated [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]–[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        In addition, software agents can support EL class formation
processes by suggesting to students (classes) about the best
classes (students) to join with (to accept) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]–[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Studies
confirmed that, within social communities, users start to
interact and share information with other peers also based on the
level of mutual trust existing among users [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]–[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Besides,
also in forming OSN groups existing trust relationships can
give a significant contribution, in addition to a similarity
criterion [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
      <p>
        It is obvious that, due to the huge amount of data of OSNs
and the huge number of thematics groups, examining the
entire space of data to suggest suitable solutions for learners’
needs is impracticable. Therefore, based on previous research
experiences [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]–[
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] we designed a model to manage
formation and evolution of e-Learning classes by using user
information available on OSNs. These information are linearly
combined in a measure, named convenience, used to suggest
the best class (student) to join with or leave (to accept or
remove) to a user (to the class itself). First of all, the skills of
a student with respect to a set of topics of interest represent
the basic aspect we considered to give teaching-homogeneit y
to the class [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], in order to balance “supply” and “offer” of
support requests (i.e. interactions). Trust represents the second
component, which is computed by combining several specific
factors – which are related to specific e-Learning concerns –
giving a complete trust model based on reliability and
reputation criteria and on some countermeasures for erroneous or
malicious opinions. The model is designed to assists students
and classes by means of personal software agents delegated
to create, manage and update the profiles of their owners on
the basis of information found on the OSNs. The convenience
measure is exploited by a distributed procedure, named Class
Formation (CF), that allows learner/class software agents to
appropriately cooperate to form classes.
      </p>
      <p>The experimental trials have shown that running the CF
algorithm allows students and class administrators to improve
the average value of the convenience within classes.</p>
      <p>The rest of the paper is organized as follows: Section II
introduces the context and the Expertize, Trust and
Advantage measures. The proposed architecture is described in
Section III, while Section IV discusses the GF algorithm.
Section V presents the experiments we carried out, Section VI
examines related literature and, finally, in Section VII we draw
our conclusions.</p>
    </sec>
    <sec id="sec-2">
      <title>II. E-L EARNING INTERACTIONS AND MEASURES</title>
      <p>
        Let be N the set of OSN members, (|N | = N ), C the set
of classes (|C| = C), with each class c ∈ C consisting of a
number of learners and at least a teacher. We also suppose that
each user ui ∈ N is associated with a software agent [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] ai
able to obtain a view on the ui background and attitudes and
to assist him/her in joining with or leaving classes. Similarly,
each manager is assisted by a software agent, denoted as Ai,
in deciding whether a new member can be accepted in the
class.
      </p>
      <p>We also define a behavioral measure, which is related to the
interactions carried out by a learner (see Section II-A) and a
trust measure, which considers the level of mutual trust among
OSN members (see Section II-B).</p>
      <sec id="sec-2-1">
        <title>A. Behavioral Measures</title>
        <p>The principle behind the definition of the behavioral
measures is that, in order to form classes, a balance between
required and/or offered skills should be desirable, as each learner
is interested to improve his/her knowledge by joining with
classes where the other members have suitable capabilities
and managers of classes are interested to include users holding
skills and attitude to interact.</p>
        <p>
          Classes. Lets’ define a class c as a tuple hS, W, Vc, oi where:
(i) S = { s1, s2, . . . , sm} is the skill set required by the class
manager of c; (ii) W = { w1, w2, . . . , wm} is the weight set
used to evaluate the students’ skills; ( iii) Vc is the minimum
overall skill grade, computed over the specific skill set S,
required to join with c; (iv) o is the reference topic or subject or
goal of c. More formally, for an OSN user uk and a skill set S,
m
V (k, S) = P wi · g(k, si), where g(k, si) ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R is the
i=1
knowledge grade of uk for the skill si, while wmi ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R
is set by the class manager to weight gi with P wi = 1.
i=1
        </p>
        <p>The User attitude H. The attitude of the user uk to require
and/or offer interactions for his/her skills is computed as:</p>
        <p>
          H(k) = α · H(k) + (1 − α) · H(k)
where the new value of H ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R combines, weighted
by a system parameter α ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R, the previous value and
a contribution H for the new interactions computed as:
| h(k)req−h(k)off |
H(k) = 1 − h(k)rec+h(k)off
if
h(k)req + h(k)off 6= 0
or H(k) = 0.5 otherwise, and where h(k)req and h(k)off ,
with respect to uk, respectively are the evaluation of the
interactions for a number Nreq and Noff of skills subset
Si ⊂ S requested and offered at the new step obtained by:
h(k)req = Nr1eq PiN=r1eq g(k, Sreq,i)
h(k)off = No1ff PiN=o1ff g(k, Soff,i)
Therefore, when h(k)req ≈ h(k)off , then H ≈ 1, i.e. the
user uk asks and provides interactions to the same extent.
Vice versa, his/her attitude is mainly to offer (or require)
interactions, i.e. H ≈ 0.
        </p>
        <p>
          Class Behavior. The class behavior for the class cj , denoted
as B(j) ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] characterizes its tendency to offer or require
interactions and it is defined as B(j) = | c1j| P|k=cj1| H(k).
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>B. Trust Measure</title>
        <p>
          The second measure is based on the concept of trust [
          <xref ref-type="bibr" rid="ref29">29</xref>
          ]
and it is computed by combining two factors, namely
reliability and reputation. The former measure derives by the direct
knowledge between truster and trustee due to their interactions
occurred in the past, while reputation is an indirect knowledge
derived by the past interactions occurred among the trustee
with other counterparts different from the current truster [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ].
        </p>
        <p>An interaction between two generic OSN learners up and ur
consists of a process where up starts with one or more learning
tasks with ur. Consequently, their software agents ap and ar
observe the interactions of their owners to register the
interaction features (type, topic, duration) and collect feedbacks about
other OSN users to compute their respective reputations. Such
feedbacks refer to the quality of these interactions (remember
that users’ skills are evaluated by the Behavioral measures).</p>
        <p>
          Let ηp,r and ρp,r be respectively the measures of reliability
and reputation that the OSN user up (i.e. agent ap) computes
for the OSN user ur (i.e. agent ar). The trust measure τp,r is
obtained by combining the reliability (ηp,r) and the reputation
(ρp,r) weighted by means a coefficient βp,r ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R:
τp,r =
0.5 if Ip,r = 0
βp,r · ηp,r + (1 − βp,r) · ρp,r if Ip,r &gt; 0
where Ip,r is the number of interactions occurred
between the two actors. Note that for new learners the initial
trust/reputation is set to 0.5 to contrast whitewashing
strategies [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. For computing βp,r, we consider that its value
increases with the number of interactions occurred between
the two learners because their direct knowledge improves
over time and decreases when the reliability in providing
recommendations decreases (the reputation or some peers may
be affected by malicious behaviors); Therefore, the coefficient
βp,r is computed as:
        </p>
        <p>βp,r = M ax(β1, β2)
where β1 = min</p>
        <p>IImp,arx , 1 and β2 = 1 − Ω(pt,)r. The parameter
Ω(pt,)r is the average confidence at time t for the current set of
recommenders that provided at least a recommendation to ap
about ar computed as Ω(pt,)r = 1 PiR=p1,r | σp(t,r−1) −τq,r| and
where Rp,r is the set of agents | pRrop,vri|ded an opinion about ar. It
minimizes the effect of untrustworthy opinions by giving more
relevance to those mentors evaluated by ap as the most similar
to it. Ip,r is the number of interaction that is incremented at
each step and when it is greater than the threshold Imax then
the “knowledge” between two users is considered maximum.
As a result, the contribute of the reputation in computing trust
decreases as much as the number of the interactions occurred
between the two involved learners constantly increases.</p>
        <p>
          1) Computation of Reliability: The reliability measure,
ηp,r ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R, is computed by up (i.e. ap) about ur
(i.e. ar) as ηp,r = ϑp,r · σp,r + (1 − ϑp,r) · ηp,r, where the
parameter ϑp,r weights in a complementary way the feedback
parameter σp,r ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R computed on the last interaction
occurred between up and ur at time-step t and the value of
ηp,r computed at time-step (t − 1).
        </p>
        <p>The parameter ϑp,r considers the relevance assigned to the
interaction between up and ur, let it be Ψp,r. In principle,
malicious behaviors aimed to gain good reputation with low
value interactions (Ψ ≪ 0.5) but high reliability (σ ≫ 0.5)
can start on interactions of high relevance (Ψ ∼ 1) (due to
a good reputation) but providing poor performance (σ ∼ 0).
Therefore, the closer the ratio Ψ/σ to 1, the higher the value
of ϑ; the farther the value Ψ/σ from 1, the lower the value of
ϑ. A possible choice for ϑ is represented by the adoption of
the Gaussian centered in 1, as ϑ = e−(Ψ/σ−1)2/v2 . ϑ acts as
a “filter” for those values of σ which, for the correspondent
values of Ψ, may reflect a malicious behavior, while large
values of v will select only those values of σ for which σ/ϑ
is close to 0 by ensuring that almost the whole history of
feedbacks σ is considered in computing η.</p>
        <p>
          2) Computation of Reputation: The reputation measure
ρp,r ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R is computed by up (i.e., ap) with respect
to ur (i.e. ar) as a value ranging in [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] ∈ R:
ρp,r = | Rp1,r|
| Rp,r|
        </p>
        <p>X
q=1
τq,r
Through the usual meaning of these indexes, 0/1 means that
ur is totally unreliable/reliable.</p>
      </sec>
      <sec id="sec-2-3">
        <title>C. Convenience Measure</title>
        <p>Behavioral and trust measures are combined to measure the
convenience, for a user, to join with the class cj . The
asymmetric nature of the trust measure implies also the asymmetry of
the convenience. In particular, let φ be a parameter computed
as φ = (1−| H(k)−B(j)| ) , where | c| is the number of users
| cj|
(i.e. agents) affiliated with c. Then the convenience (γu,c) for
the user u to join with the class c, and that (ηc,u) of the class
c to accept the affiliation request of a user u are computed as:
γk,j = φ X</p>
        <p>τk,i
ai∈cj
ηj,k = φ X</p>
        <p>τi,k
ai∈cj</p>
        <p>
          Both measures increase with the difference between the
behaviors of ak and cj . As a consequence of the asymmetric
nature of trust, the procedure described in Section IV is
distributed among the agents assisting learners and those assisting
class managers. As it will be discussed in the experimental
Section, the aim of the distributed procedure is to let the
system to reach a balance in terms of convenience among all
the considered actors of the proposed OSN EL scenario. [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]
III. THE MULTI- AGENT E-L EARNING ARCHITECTURE
In the proposed approach, OSN users (i.e. learners) are
supported by intelligent software agents [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ] capable to perform
all the activities aimed at organizing classes basing on the
measures presented in Section II. All the agents execute a set
of tasks which are briefly summarized below, and categorized
as Learner Agent Behavior and Class Agent Behavior.
        </p>
        <p>The Learner Agent Behavior. The behavior of a learner
agent consists of several tasks periodically executed to
maintain data useful to run the CF algorithm (see Section IV). Let
uk be the generic learner and ak his/her agent, the following
tasks are triggered by the learner and executed by the agent
as: (i) Any interaction of learner uk with one or more peers
will trigger agent ak to update Behavioral measures; (ii) Any
reliability change of a user uj that interacted with a peer,
will trigger ak to update the Reliability measure; (iii) The
Convenience measure will be updated for any change in the
Reliability measure; (iv) Behavioral and Trust measures are
periodically sent to the class agent once and if they have been
recalculated; (v) The generic software agent ak will assist user
uk to take decision about joining with or leaving classes.</p>
        <p>The Class Agent Behavior. The behavior of a Class Agent
consists of several tasks executed periodically to maintain data
useful to run the CF algorithm (see Section IV). Let cj be a
class and Aj the associated software agent, the following tasks
are triggered by the interactions among software learner agents
ak and the class agent Aj as: (i) Any message of ak containing
updated Behavioral and/or Convenience measure will trigger
agent Ak to update Behavioral and/or Convenience measures
for the whole class; (ii) Whenever the Behavioral measure of
the class cj has changed, Aj will send the updated measure
to all the learner agents of the class cj ; (iii) Ak will assist
the class manager of cj to take decision about the requests
coming from agents ak to join with or leave classes.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>IV. THE DISTRIBUTED PROCEDURE FOR CLASS</title>
      <p>FORMATION (CF)</p>
      <p>In our approach, each Learner Agent has: (i) to update
all the proposed measures whenever one or more interaction
occurred, (ii) to send the new values to its class agents and (iii)
to assist its own user to take decision about joining with or
leaving classes by executing the CF algorithm (For this aim, it
will receive behavioral and trust measures from its own class
agents).</p>
      <p>Each class agent has (i) to wait for learner agents messages
in order to update the proposed measures of the entire class,
(ii) to send updated behavioral measure for allowing learner
agents to update their own convenience measures and (iii) to
assist its own class manager to take decision about the requests
coming from learner agents to join with or leave classes.</p>
      <sec id="sec-3-1">
        <title>A. The distributed CF procedure.</title>
        <p>Let T be the time between two consecutive steps of the CF
procedure executed by the generic learner agent, in order to
join with a set of classes of the same topic. We also suppose
that agents can query a distributed database named CR (Class
Repository) on which the list of the classes is stored.</p>
        <p>
          The CF procedure performed by the learner agents (See
Fig. 1(a)). Let Xn be the set of the classes the agent an is
affiliated to, and NMAX the maximum number of classes an
agent can analyze at time t, with NMAX ≥ | Xn| . Besides,
suppose that an stores into a cache the class profile of each
class contacted in the past and the timestamp d of the last
run of the CF procedure for that class. Let the timestamp
ξn and χn ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] be two thresholds fixed by the agent an.
The ratio of the procedure for the learner agent is to improve
the convenience in joining with a class. Therefore, firstly the
values of convenience are recalculated if older than ξn (lines
1-4). Then, candidate classes are sorted in a decreasing ord er
based on their Convenience value (line 5). In the loop in lines
7-16 the NMax classes are selected. If the classes in the set
Lgood are not in the set Xn, then agent an could improve the
convenience of the owner if the classes accept the user for
joining with.
        </p>
        <p>The CF procedure performed by the class agent - Fig. 1(b).
Let Kc be the set of the agents affiliated to the class c, and
KMAX the maximum number of learners allowed to be within
the class c 1 with | Kc| ≤ KMAX . Suppose that the class
agent Ac stores into a cache the profile P of each user u
1For convenience it is assumed the same for all the classes and topics
Input:</p>
        <p>Xn, NMAX , ξn, χn;
Y = { c ∈ C} a random class set : | Y | ≤ NMAX , Xn T Y = { 0} ,
Z = (Xn S Y )
1: for c ∈ Z : dc &gt; ξn do
2: Send a message to Ac to retrieve the profile Pc.
3: Compute γun,c
4: end for
5: Let be Lgood = { ci ∈ Z : i ≤ j → γun,ci ≥ χn} , with
| Lgood| = NMAX
6: j → 0
7: for c ∈ Lgood ∧ c 6∈ Xn do
8: send a join request to Ac
9: if Ac accepts the request then
10: j → j + 1
11: end if
12: end for
13: for c ∈ { Xn − Lgood} ∧ j &gt; 0 do
14: Sends a leave message to c
15: j → j − 1
16: end for
Input:</p>
        <p>
          Kc, KMAX , ωc, πn, ar, Z = Kc S{ ar} ;
1: if (V (r, Sc) &lt; Vc ∨ | Kc| ≥ KMAX ) then
2: Send a reject message to ar
3: else
4: for a ∈ Kc do
5: if du ≥ ωc then
6: ask to a its updated profile
7: end if
8: end for
9: for a ∈ Z do
10: compute ηc,a
11: end for
12: Let be Kgood = { a ∈ Z : γc,a ≥ πc}
13: for a ∈ Kc − Kgood do
14: send a leave message to a.
15: end for
16: if ar ∈ Kgood then
17: the request of ar is accepted
18: end if
19: end if
Fig. 1. CF algorithm. Top (a): Learner Agent. Bottom (b): Class Agent
managed by his/her learner agent a ∈ Kc and the timestamp
du of its acquisition. The procedure run by Ac is triggered
whenever a join request by a learner agent ar (in the interest of
ur) is received by Ac (with the profile Pr). Let the timestamp
ωc and πn ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] be two thresholds fixed by the agent Ac.
If the class has reached this maximum, no more students will
be accepted. By lines 4-8 the class agent asks the updated
profile of its students to update their convenience γc,a (lines
9-11) so that a new sorted set Kgood ⊂ { Kc S ar} is built
(line 12). Then, the class agent (i) will send a leave message
to all the learner agents a having a convenience γc,a or (ii) if
ar ∈ Kgood (line 16), the agent request is accepted.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>V. EXPERIMENTS</title>
      <p>In order to evaluate the described approach, we performed
some experiments to investigate on the convergence of the
CF algorithm described in Section IV. As a measure of
the internal convenience for a class cj , we introduced the
concept of Average Convenience (AC), computed as the
average of all the measures of convenience ηj,i computed
by cj ∈ C for all its students ui ∈ cj . To measure the
global convenience of all the classes of N , we computed the
mean M AC = Pcj∈C ACj /|C| and the standard deviation
DAC = qPcj∈C (ACj − M AC)2/|C| .</p>
      <p>
        A first test involved three scenarios consisting of 50, 100,
and 200 e-Learning classes, as summarized in Table I. To
compute the convenience, we assumed that 20% of OSN
members is unreliable. Behavioral coefficients hreq and hoff
and the values of trust (τ ), have been sampled from a normal
distribution [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ] around specific mean and standard deviation
(stdev), see Table I. In particular, τr is the mean of generated
trust values for reliable users, while τu is the mean for
unreliable users. Moreover, for this set of experiments, the ratio
r = KNmmaaxx·|·| UC| was set to 1. Besides, the starting composition of
classes is ra n|dom. Table II shows the results of the execution
of the CF algorithm for the three scenarios reported in Table I,
that shows the initial value of MAC/DAC (epoch T0 = 0) and
the final one (epoch Te = 20). Indeed, we have verified that
after 20 epochs of executions, the M AC has reached a very
stable value. It can be observed that, the improvement, in terms
of MAC, at the end of the experiments, is about the 8% for all
tthhee cthornefiegsucreantiaorniossawndit,hsoinucteretlheevaranttiovaKNrimmataaixxo·|·| nUCs|,| tihsethseubsasemqeuefonrt
were driven by r.
      </p>
      <p>
        For the second set of experiments we assumed a variable
v0a.1luteo o0f.9r. A=vKaNlmmueaaxxr·|·| UC&lt;|| ,1assayshuoswtnhaitnusTearbsl,einIIoI,verraanlgl,incganfrjooimn
more places (Nmax · | U | ), than the total allowed (Kmax · | C| ).
In particular, the best improvement, in terms of M AC, is for
r = 0.4 (+20%), r = 0.5 (+16%) and r = 0.6 (+20%).
It means that, from one hand, finding a class to improve the
personal convenience γ is a bit more difficult for the user
when r &lt; 1, therefore the CF algorithm helps to improve
the MAC with respect to the random composition of classes.
Nevertheless, the algorithm clearly needs a certain degree of
freedom to give some benefits. Therefore, when r is very
small, the improvements, in terms of M AC are comparable to
those given for values of r close to 1. In overall, these results
point out that the CF algorithm gives, on average, a relevant
improvement of the convenience for the classes. [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ]
      </p>
      <p>In order to test the effectiveness of the trust model we have
verified, by simulations, that the class formation algorithm
will lead to high and stable values of average convenience.
Simulations have shown that the CF algorithm will lead
significant benefits in terms of average quality of interactions.</p>
    </sec>
    <sec id="sec-5">
      <title>VI. RELATED WORK</title>
      <p>
        Group/class formation is an important task to promote EL
activities and obtain effective results [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. In particular,
forming random groups/classes may cause absence of participation
and motivation [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ]. A recent survey on group/class
formation [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ] analyzes about 250 works. The authors discovered
that the 20% of studies on group formation in collaborative
EL and a 20% of them adopt probabilistic models, while
the remaining studies rely on various AI techniques. Among
them, an interesting work deals with strategies for group
formation based on individual behaviors [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ] obtained by
monitoring communication data. The results show that the
students participation in small groups is correlated with their
behavior in the class. Therefore, authors suggest to use these
information to allocate heterogeneously initial classes into
small groups. It partially differ from our approach that is
aimed at grouping individuals with similar behaviors, in terms
of “positive” and “negative” interactions. Besides, a relevant
component in our proposal are the trust relationships from
OSN data that in [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ] is neglected.
      </p>
      <p>
        A recent survey [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ] dealt with the recommender systems
for Technology Enhanced Learning (TEL). These systems
recommend a wide variety of EL resources but their basic
requirements are different from other domains and, therefore,
specific methods must be adopted to evaluate them. Our
work includes a recommender system for learners focused
on the interactions occurring among them. In [
        <xref ref-type="bibr" rid="ref41">41</xref>
        ], two new
collaborative team leadership and operational models for EL
including indexes of trust, reflexivity and shared procedural
knowledge are proposed. They attempt to improve practice
in EL in team-based lifelong learning projects. The authors
stated that EL teams take benefit from collegian participation
in a trusted environment. Also, social skills and knowledge
sharing are considered key aspects that, through collegiality
and mutual trust, will enable to build innovative, fast-mov ing
EL projects.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref42">42</xref>
        ] is analyzed the state-of-the-art of the “socializat ion”
of EL activities and an automated approach to find proper
people to form EL groups in OSN is described. As in our work,
it is considered that, in addition to the common criteria to form
groups, OSNs allow the access at a myriad of relationship data.
By means of these data, suitable metrics can be created to
weight the “edges” between users. The proposed algorithm to
form groups simply explores the whole OSN to find a minimal
number of proper candidates to form a group able to optimize
a group EL experience. Differently, we exploit the concept of
trust by combining reliability and reputation. Finally, in [
        <xref ref-type="bibr" rid="ref43">43</xref>
        ]
the student use of Facebook at the University of Cape Town
is analyzed by showing positive benefits to build EL
microcommunities on Facebook but certain existing challenges, as
including ICT literacy and uneven access, remain opened.
      </p>
    </sec>
    <sec id="sec-6">
      <title>VII. CONCLUSIONS AND FUTURE WORK</title>
      <p>Class formation in e-Learning is a critical task for the
quality of such activities. In this work we focused on a
distributed algorithm supported by a trust model and some
behavioral measures based on information coming from the
OSN (i.e. users trust relationships, interaction quality,
historical attitude to interact with peers) to improve the metrics
for dynamic class composition in OSNs. This flexibility is
aimed at improving the quality of learning experiences and it
is obtained by combining information about trust and previous
interactions in a unique measure named “convenience”. In this
work we have shown a first set of experimental results obtained
by simulating an artificial scenario with a variable number
of users and groups. The results have shown that the class
formation algorithm will lead to high and stable values of
average convenience.</p>
      <p>As future work, we will perform a further experimental
campaign in order to verify that the convergence to high values
of convenience leads to significant benefits in terms of average
quality of interactions. Moreover, a further set of experiments
is needed to verify the effectiveness of the trust model to
limit malicious behaviors, in order to give trust values which
reflect the actual behavior, in terms of overall reliability, of
the students.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Moore</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dickson-Deane</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          K. Galyen, “
          <article-title>e-learnin g, online learning, and distance learning environments: Are they the same?” The Internet and Higher Education</article-title>
          , vol.
          <volume>14</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>129</fpage>
          -
          <lpage>135</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Mason</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lefrere</surname>
          </string-name>
          , “Trust, collaboration, e
          <article-title>-learn ing and organisational transformation</article-title>
          ,
          <source>” Int.l J. of Training and Development</source>
          , vol.
          <volume>7</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>259</fpage>
          -
          <lpage>270</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3] https://www.facebook.com,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4] https://www.twitter.com,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Grabowicz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Aiello</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Eguiluz</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Jaimes</surname>
          </string-name>
          , “
          <article-title>Distinguishing topical and social groups based on common identity and bond theory,”</article-title>
          <source>in Proc. of the ACM Int. Conf. WSDM 2013. ACM</source>
          ,
          <year>2013</year>
          , pp.
          <fpage>627</fpage>
          -
          <lpage>636</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>L.</given-names>
            <surname>Backstrom</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Huttenlocher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kleinberg</surname>
          </string-name>
          , and
          <string-name>
            <given-names>X.</given-names>
            <surname>Lan</surname>
          </string-name>
          , “Group Formation in Large Social Networks: Membership, Growth, and Evolution,”
          <source>in Proc. of the 12th ACM SIGKDD Int. Conf. ACM</source>
          ,
          <year>2006</year>
          , pp.
          <fpage>44</fpage>
          -
          <lpage>54</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Kairam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Leskovec</surname>
          </string-name>
          , “
          <article-title>The life and death of online groups: Predicting group growth and longevity,” in 5th ACM int</article-title>
          .
          <source>conf. on Web search and data mining Proc. of. ACM</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>673</fpage>
          -
          <lpage>682</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Santoro</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Hyson: A distributed agent-based protocol for group format ion in online social networks,” in Multiagent System Technologies</article-title>
          . Springer Berlin Heidelberg,
          <year>2013</year>
          , pp.
          <fpage>320</fpage>
          -
          <lpage>333</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>P.</given-names>
            <surname>De Meo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M. L.</surname>
          </string-name>
          <article-title>Sarne´, “Improving the compactness in social network thematic groups by exploiting a multidimensional user-to-group matching algorithm,” in Intelligent Networking and Collaborative Systems (INCoS</article-title>
          ),
          <source>2014 International Conference on. IEEE</source>
          ,
          <year>2014</year>
          , pp.
          <fpage>57</fpage>
          -
          <lpage>64</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>V.</given-names>
            <surname>Vasuki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Natarajan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Savas</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Dhillon</surname>
          </string-name>
          , “
          <article-title>Scalable affiliation recommendation using auxiliary networks</article-title>
          ,
          <source>” ACM Trans. on Intelligent Systems and Technology</source>
          , vol.
          <volume>3</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>3</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>J.</given-names>
            <surname>Gorla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Lathia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Robertson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Wang</surname>
          </string-name>
          , “
          <article-title>Probabilistic group recommendation via information iatching</article-title>
          ,”
          <source>in Proc. of the Int. World Wide Web Conf. (WWW '13)</source>
          . ACM Press,
          <year>2013</year>
          , pp.
          <fpage>495</fpage>
          -
          <lpage>504</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Santoro</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M. L.</surname>
          </string-name>
          <article-title>Sarne´, “A distributed agent-based approach for supporting group f ormation in p2p e-learning,”</article-title>
          <source>in AI* IA 2013: Advances in Artificial Intelligence</source>
          . Springer International Publishing,
          <year>2013</year>
          , pp.
          <fpage>312</fpage>
          -
          <lpage>323</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>P. De Meo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Ferrara</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Rosaci</surname>
            , and
            <given-names>G. M. L.</given-names>
          </string-name>
          <string-name>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Trust and compactness in social network groups,” Cybernetics</article-title>
          , IEEE Transactions on, vol.
          <volume>45</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>216</lpage>
          ,
          <year>Feb 2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>W.</given-names>
            <surname>Tan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>X.</given-names>
            <surname>Hu</surname>
          </string-name>
          , “
          <article-title>A trust evaluation model for e-learning systems</article-title>
          <source>,” Systems Research and Behavioral Science</source>
          , vol.
          <volume>31</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>353</fpage>
          -
          <lpage>365</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Forming homogeneous classes for e-learning in a social net work scenario,” in Intelligent Distributed Computing IX</article-title>
          . Springer International Publishing,
          <year>2016</year>
          , pp.
          <fpage>131</fpage>
          -
          <lpage>141</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Santoro</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>A trust model for competitive cloud federations</article-title>
          ,
          <source>” Complex, Intelligent, and Software Intensive Systems (CISIS)</source>
          , pp.
          <fpage>469</fpage>
          -
          <lpage>474</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>A trustbased, multi-agent architecture supporting inter-cloud vm migration in iaas federations,” in Internet and Distributed Computing Systems</article-title>
          . Springer International Publishing,
          <year>2014</year>
          , pp.
          <fpage>74</fpage>
          -
          <lpage>83</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          `, “
          <article-title>A qosaware, trust-based aggregation model for grid federations, ” in On the Move to Meaningful Internet Systems: OTM 2014 Conferences</article-title>
          . Springer Berlin Heidelberg,
          <year>2014</year>
          , pp.
          <fpage>277</fpage>
          -
          <lpage>294</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>T.</given-names>
            <surname>Snijders</surname>
          </string-name>
          , “
          <article-title>Network dynamics,” The Handbook of Rational Choice Social Research</article-title>
          . Stanford University Press, pp.
          <fpage>252</fpage>
          -
          <lpage>279</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci and G. M. L. Sarne</surname>
          </string-name>
          ´, “
          <article-title>Matching users with groups in social networks,” in Intelligent Distributed Computing VII</article-title>
          . Springer,
          <year>2013</year>
          , pp.
          <fpage>45</fpage>
          -
          <lpage>54</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Using semantic negotiation for ontology enrichment in elearning multi-agent systems</article-title>
          ,” in Complex,
          <source>Intelligent, and Software Intensive Systems (CISIS)</source>
          ,
          <source>2015 Ninth International Conference on. IEEE</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>474</fpage>
          -
          <lpage>479</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22] --, “
          <article-title>Supporting knowledge sharing in heterogeneous social network thematic groups,” in Complex, Intelligent,</article-title>
          and
          <source>Software Intensive Systems (CISIS)</source>
          ,
          <source>2015 Ninth International Conference on. IEEE</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>480</fpage>
          -
          <lpage>485</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>P. De Meo</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Messina</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Pappalardo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Rosaci</surname>
            , and
            <given-names>G. M. L.</given-names>
          </string-name>
          <string-name>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Similarity and trust to form groups in online social networks,” in On the Move to Meaningful Internet Systems: OTM 2015 Conferences</article-title>
          . Springer International Publishing,
          <year>2015</year>
          , pp.
          <fpage>57</fpage>
          -
          <lpage>75</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>An evolutionary approach for cloud learning agents in multicloud distributed contexts,” in Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE</article-title>
          ),
          <source>2015 IEEE 24th International Conference on. IEEE</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>99</fpage>
          -
          <lpage>104</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>P. De Meo</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Messina</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Rosaci</surname>
            , and
            <given-names>G. M. L.</given-names>
          </string-name>
          <string-name>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Recommending users in social networks by integrating local and global reputation,” in Internet and Distributed Computing Systems</article-title>
          . Springer International Publishing,
          <year>2014</year>
          , pp.
          <fpage>437</fpage>
          -
          <lpage>446</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fotia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Pappalardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <surname>G. M. L.</surname>
          </string-name>
          <article-title>Sarne´, “A distributed reputation-based framework to support commu - nication resources sharing,” in Intelligent Distributed Computing IX</article-title>
          . Springer International Publishing,
          <year>2016</year>
          , pp.
          <fpage>211</fpage>
          -
          <lpage>221</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>H.</given-names>
            <surname>Songhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Kenji</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Takara</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Takashi</surname>
          </string-name>
          , “
          <article-title>Towards new collaborative e-learning and learning community using portfolio as sessment</article-title>
          ,” in World Conf. on E-Learning in Corporate, Government,
          <source>Health care, and Higher Education</source>
          , vol.
          <year>2008</year>
          , no.
          <issue>1</issue>
          ,
          <issue>2008</issue>
          , pp.
          <fpage>1270</fpage>
          -
          <lpage>1275</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>S.</given-names>
            <surname>Franklin</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Graesser</surname>
          </string-name>
          , “
          <article-title>Is it an agent, or just a program?: A taxonomy for autonomous agents,” in Intelligent agents III Agent Theories</article-title>
          , Architectures, and Languages. Springer,
          <year>1997</year>
          , pp.
          <fpage>21</fpage>
          -
          <lpage>35</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>T.</given-names>
            <surname>Grandison</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Sloman</surname>
          </string-name>
          , “
          <article-title>Trust management tools for internet applications</article-title>
          ,” in Trust Management. Springer,
          <year>2003</year>
          , pp.
          <fpage>91</fpage>
          -
          <lpage>107</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>A.</given-names>
            <surname>Abdul-Rahman</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Hailes</surname>
          </string-name>
          , “
          <article-title>Supporting trust in virt ual communities,”</article-title>
          <source>in HICSS '00: Proc. of the 33rd Hawaii Int. Conf. on System Sciences, vol. 6</source>
          . IEEE Computer Society.,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>G.</given-names>
            <surname>Zacharia</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Maes</surname>
          </string-name>
          , “
          <article-title>Trust management through reputation mechanisms</article-title>
          ,
          <source>” Applied Artificial Intell.</source>
          , vol.
          <volume>14</volume>
          , no.
          <issue>9</issue>
          , pp.
          <fpage>881</fpage>
          -
          <lpage>907</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>S.</given-names>
            <surname>Garruzzo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Masha-el: A multiagent system for supporting adaptive e-learning,”</article-title>
          <source>in Tools with Artificial Intelligence</source>
          ,
          <year>2007</year>
          .
          <source>ICTAI</source>
          <year>2007</year>
          . 19th IEEE International Conference on, vol.
          <volume>2</volume>
          . IEEE,
          <year>2007</year>
          , pp.
          <fpage>103</fpage>
          -
          <lpage>110</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>M.</given-names>
            <surname>Wooldridge</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Jennings</surname>
          </string-name>
          , “
          <article-title>Intelligent agents: Theory and practice,” The knowledge eng</article-title>
          .
          <source>review</source>
          , vol.
          <volume>10</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>115</fpage>
          -
          <lpage>152</lpage>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>K.</given-names>
            <surname>Hopkins</surname>
          </string-name>
          , G. Glass, and
          <string-name>
            <given-names>B.</given-names>
            <surname>Hopkins</surname>
          </string-name>
          ,
          <article-title>Basic statistics for the behavioral sciences</article-title>
          .
          <source>Prentice-Hall</source>
          ,
          <year>1987</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>S.</given-names>
            <surname>Garruzzo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rosaci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. M. L.</given-names>
            <surname>Sarne</surname>
          </string-name>
          ´, “
          <article-title>Isabel: A multi agent e-learning system</article-title>
          ,
          <source>” in Intelligent Agent Technology</source>
          ,
          <year>2007</year>
          . IAT'07. IEEE/WIC/ACM International Conference on. IEEE,
          <year>2007</year>
          , pp.
          <fpage>485</fpage>
          -
          <lpage>488</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>F.</given-names>
            <surname>Rennie</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Morrison</surname>
          </string-name>
          ,
          <article-title>E-learning and social networking handbook: Resources for higher education</article-title>
          .
          <source>Routledge</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>P.</given-names>
            <surname>Dillenbourg</surname>
          </string-name>
          , “
          <article-title>Over-scripting cscl: The risks of ble nding collaborative learning with instructional design.” Three worlds of CSCL. Can we support CSCL?</article-title>
          , pp.
          <fpage>61</fpage>
          -
          <lpage>91</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>W.</given-names>
            <surname>Cruz</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Isotani</surname>
          </string-name>
          , “
          <article-title>Group formation algorithms in collaborative learning contexts: A systematic mapping of the literature,” in Collaboration and Technology</article-title>
          . Springer,
          <year>2014</year>
          , pp.
          <fpage>199</fpage>
          -
          <lpage>214</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>N.</given-names>
            <surname>Jahng</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Bullen</surname>
          </string-name>
          , “
          <article-title>Exploring group forming strategies by examining participation behaviours during whole class discussions</article-title>
          .
          <source>” European J. of Open</source>
          , Distance and E-Learning ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>M.</given-names>
            <surname>Erdt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fernandez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Rensing</surname>
          </string-name>
          , “
          <article-title>Evaluating recommender systems for technology enhanced learning: A quantitative survey,” Learning Technologies</article-title>
          ,
          <source>IEEE Trans.</source>
          , vol.
          <volume>8</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>326</fpage>
          -
          <lpage>344</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [41]
          <string-name>
            <given-names>J.</given-names>
            <surname>Jameson</surname>
          </string-name>
          , G. Ferrell,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kelly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Walker</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ryan</surname>
          </string-name>
          , “
          <article-title>Building trust and shared knowledge in communities of e-learning pract ice: collaborative leadership in the jisc elisa and camel lifelong learning projects,”</article-title>
          <source>British J. Educat. Tech.</source>
          , vol.
          <volume>37</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>949</fpage>
          -
          <lpage>967</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [42]
          <string-name>
            <given-names>S.</given-names>
            <surname>Brauer</surname>
          </string-name>
          and
          <string-name>
            <given-names>T. C.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          , “
          <article-title>Group formation in elearning-enabled online social networks,” in Interactive Collaborative Learning (ICL), 2012 15th Int</article-title>
          .
          <source>Conf. on. IEEE</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [43]
          <string-name>
            <given-names>T. E.</given-names>
            <surname>Bosch</surname>
          </string-name>
          , “
          <article-title>Using online social networking for teaching and learning: Facebook use at the university of cape town</article-title>
          ,” Comm.: South African J.
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          <source>for Comm. Theory and Research</source>
          , vol.
          <volume>35</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>185</fpage>
          -
          <lpage>200</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>