<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Adapting Online Group Formation to Learners' Conscientiousness, Agreeableness and Ability</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Chinasa Odo∗</string-name>
          <email>r01cro17@abdn.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Judith Mastho</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nigel Beacham</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Aberdeen</institution>
          ,
          <addr-line>Aberdeen</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Utrecht University and, University of Aberdeen</institution>
          ,
          <addr-line>Utrecht</addr-line>
          ,
          <country country="NL">the Netherlands</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <abstract>
        <p>This paper focuses on the impact of conscientiousness, agreeableness, and ability for the formation of heterogeneous learning groups in supporting lifelong learning. It presents a study in which participants assigned learners to groups to investigate whether these, and more importantly, how they use learner personality and ability in group formation and inspire future algorithms.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Human-centered computing → Collaborative and social
computing.</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        Learning is seen as a continuous process which starts from birth
and terminates at death. According to the Commission of the
European Communities [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], lifelong learning is de ned as all forms
of voluntary or self-motivated learning undertaken by adults after
their initial education and training. Lifelong learning encompasses
continuing education and professional development programs for
self-sustainability, competitiveness and employability. The aim is
to support individuals to remain relevant in the eld, since it is
not possible to acquire all the required knowledge during the
traditional school years. With the emergence of technology, lifelong
learning has no barrier on how we receive and gather information,
collaborate and communicate with others. According to Laal [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ],
lifelong learning is diverse, adapted to individuals and available
throughout life unlike traditional learning. Lifelong learning is
often not teacher lead in contrast to traditional classroom learning,
but individual learners can collaborate with others to enhance their
understanding and skills.
      </p>
      <p>Traditionally, teachers have been the leading source of
knowledge transmissions in the learning environment. As technology
becomes more advanced, the opportunity provided by e-learning
Permission to make digital or hard copies of all or part of this work for personal or
claCssorpooymriguhset ihseglrdanbteydtwheithaouutthfeoer(psr)o.viUdesdethpaetrcmopititeesdaruenndotemrathdeeoCrdCis-tBriYbuted
folricperonsteorCcoremamtievrceiCaloadmvmanotangse.aonrdgt/hliactecnopsieess/bbeyar/4th.0is/notice and the full citation
on the rst page. Copyrights for components of this work owned by others than the
author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or
republish, to post on servers or to redistribute to lists, requires prior speci c permission
and/or a fee. Request permissions from permissions@acm.org.</p>
      <p>
        AIED 2019, Chicago, USA, 10.1145/1122445.1122456
© 2018 Copyright held by the owner/author(s). Publication rights licensed to ACM.
ACM ISBN 978-1-4503-9999-9/18/06. . . $15.00
https://doi.org/10.1145/nnnnnnn.nnnnnnn
becomes a factor in facilitating collaborative learning. These
opportunities are accompanied by approaches that emphasize the
learner as the main agent of learning. Learners in this situation
come together to make learning socially interactive rather than a
transmission of pre-packaged lectures [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. When learners engage
in online collaborative learning, it may help to induce positive a ect
by providing an opportunity for active participation in achieving
the learning objectives within the group [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Collaborative learning
is a situation where two or more learners come together to facilitate
learning [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The aim is to provide learning activities that give
learners opportunities to interact, share and process information. A
collaboration paradigm promotes problem-solving, critical thinking
and facilitates the development of interaction between learners [
        <xref ref-type="bibr" rid="ref49">49</xref>
        ]
and promotes an overall participation of all learners [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        The collaborative environment enables teachers to be
facilitators who assist in generating and sharing learning content, and
not to control the delivery and pace of learning [
        <xref ref-type="bibr" rid="ref42">42</xref>
        ]. Teachers
ensure that the core concepts and practices of the subject domain are
fully integrated, and are also responsible for creating the
environment through which e ective collaboration can be possible [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ].
A learner can engage in discussions in which they construct and
share the understanding of content through di erent methods [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
This is inspired by the Zone of Proximal Development by
Vygotsky [
        <xref ref-type="bibr" rid="ref47">47</xref>
        ]. Vygotsky believes that any learning encounters have a
previous history, and he emphasized the importance of learning
through interactions with others rather than individual work.
Supporting Vygotsky is the cognitive developmental theory of Piaget
[
        <xref ref-type="bibr" rid="ref41">41</xref>
        ] which noted that the cognitive development is a progressive
transformation of mental developments caused by biological
advancement and those acquired within the environment. In a social
learning system also, Bandura [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] noted that new patterns of
behaviour can be acquired through direct experience or by observing
the behaviour of others. The interaction within the online learning
environment may induce positive changes in learners’ a ective
state.
      </p>
      <p>
        This paper investigates automatic group formation, to improve
the e ectiveness of collaboration in supporting the learning process
within and beyond the walls of educational system. In particular
it investigates to what extent learners’ conscientiousness,
agreeableness and ability should inform group formation and in which
way.
Online collaboration, just like a conventional group, is formed when
two or more people interact and in uence each other’s discussion
for the purpose of learning and understanding learning contents
completely [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ]. In an online collaboration, the discussion is
central to learning. It operates in an environment that may be
asynchronous and is independent of place. Through collaborations,
learning is simpli ed, because members will strive to motivate
and support one another through discussion and elaboration on
learning activities. The theory of online collaborative learning by
Harasim [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] believed that learners solve problems collaboratively
through discourse rather than recite what they think is the right
answer. The social environment in uences the learning process
[
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] and enables learning to be achieved through the process of
observational learning [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The social learning theory of Bandura
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] emphasizes the role of environmental in uence in learning. It
is imperative that learners with the same cognitive characteristics
be matched together to promote learning and foster e ective team
performance [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
2.2
      </p>
    </sec>
    <sec id="sec-3">
      <title>Group Formation</title>
      <p>
        Bringing learners together to form a group in terms of ability and
experience has been found to have a positive e ect on performance
[
        <xref ref-type="bibr" rid="ref33">33</xref>
        ]. Group roles are largely dependent on learner’s personality and
experience [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. Nazzaro and Strazzabosco [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ] observed that some
learners are shy, some are impatient while some are con dent, but
what matters in a group is communication among members of the
group. According to Sherif and Sherif [
        <xref ref-type="bibr" rid="ref43">43</xref>
        ], groups are constituted
to provide individuals with mutual support and the opportunity to
solve di cult problems. Groups are also formed to bring together
di erent characteristics of individuals [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The aim is to have a
good blend of learners who would share ideas to achieve optimal
learning outcomes [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Moreland et al. [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ] regard group
composition as a cause that can in uence other aspects of group life, for
instance, group structure, dynamics and performance. The study by
Vrioni [
        <xref ref-type="bibr" rid="ref46">46</xref>
        ] shows that group learning provides an opportunity for
negotiation which creates an environment necessary for learning.
Moreland et al. [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ] believe that if a group is e ectively created, an
ideal group can be formed where learners can work together for
the optimal satisfaction of a set of learning objectives. A study by
Odo et al. [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ] advocated for learners’ a ective state being taking
into account when forming collaborative groups.
2.3
      </p>
    </sec>
    <sec id="sec-4">
      <title>Heterogeneous Groups</title>
      <p>
        For groups to be heterogeneous, a distribution is needed of learners
over the groups which provides diversity, for example in age, gender,
abilities, skills, cultural background, personality traits, etc, rather
than the same characteristics being together in one group [
        <xref ref-type="bibr" rid="ref48">48</xref>
        ].
According to Houldsworth and Mathews [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], group performance
is in uenced by the degree of heterogeneity in formation. They
found that diverse groups perform more consistently. However,
they noted that most groups possess certain elements of process
loss as well as aspects of process gain which often tend to balance
each other out as the group progresses. Considering the
heterogeneous aspect of group composition, a study by Moreland [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]
suggested that age, gender, and cultural background should be
considered as the most important demographic factors for group
formation. Supporting [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ] are studies by Jackson et al. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] and
Lai [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ], which maintained that group composition, with respect
to gender and ability, is an important factor. Also, a study by Davis
[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] suggested a random selection to exploit heterogeneity, to have a
mix of males and females, verbal and quiet, the cynical and the
optimistic learners in a group. Cen et al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] found that heterogeneous
groups with a diversity of skills and genders bene t more from
collaborative learning than homogeneous groups. Several studies
have been conducted on personality in group formation [
        <xref ref-type="bibr" rid="ref15 ref45">15, 45</xref>
        ].
      </p>
      <p>
        Learners felt that in addition to ability, other learner
characteristics such as personality needed to be considered. Based on this work,
we decided to investigate alternative solutions to group formation
using computational methods. We conducted a systematic literature
review on group formation for collaborative learning [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ] which
investigated which learner characteristics are used in (automatic)
group formation, and what algorithms are used to do the group
formation. We found that the reviewed papers did not speci cally
consider which learner characteristics are important when forming
a group, but tended to focus on a particular characteristic for group
formation. Learning characteristics used included gender, learning
style, interests, ability, knowledge, and personality. A variety of
methods were used for automatic group formation (see [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ] for
details). The reviewed papers did not base their algorithms on studies
with humans, nor did they evaluate the algorithms with humans.
The work in this paper extends the related work by investigating
in more detail which combinations of learner characteristics to use,
and in which way, based on a study with learners.
2.4
      </p>
    </sec>
    <sec id="sec-5">
      <title>Personality and Collaboration</title>
      <p>
        Personality traits are habitual patterns of behavior, thought, and
emotion that are relatively stable over time, di er across
individuals, are consistent over situations, and in uence behavior [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
A good combination of personality traits may harness individual
strengths and manage the weaknesses toward a common goal. Good
and bad personality traits within a team may o set one another
and build on each other and lead to synergies. Personality traits
are an important aspect in group formation because, when
personality di erences are ignored, a team may not perform e ectively.
The theory in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] supported team formation and describes how
individual personalities interact at the group level. Individuals that
di er in their personality traits exert various in uences on group
behaviour. This is supported by Lykourentzou et al. [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] who
dened balanced groups as consisting of individuals with compatible
personalities. The Myers Briggs Type Indicator is one tool to
identify individual personality type, related to the communication and
interaction within a group [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Personality traits in uence the way
individuals perceive, plan, and execute any activities [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Another
type of personality model that exists is the so-called Big- ve. This
model distinguishes ve distinct personality dimensions:
agreeableness, conscientiousness, extroversion, neuroticism and openness to
experience [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Understanding personality types when forming a
collaborative group may be helpful to appreciate that people are
di erent, with values, special strengths and qualities, and should
be treated with care and respect. Personality traits are important
determinants of human behaviour [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] and may therefore impact
collaboration. McGivney et al. [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] noted that a combination of
di erent personalities impacts group performance and interaction.
      </p>
    </sec>
    <sec id="sec-6">
      <title>3 STUDY: USER-AS-WIZARD</title>
      <p>
        The related work and our own earlier qualitative work [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ] (we
conducted a survey and focus groups) indicated that teachers and
students felt personality traits and ability need to be considered
in group formation. However, these studies only provide peoples
perceptions on what they consider important, and do not show
what people actually do when forming groups, assuming that the
learner characteristics are known to them. This study investigates
actual group formation. Many personality traits exist; here we focus
on just two of these, namely conscientiousness and agreeableness,
both of which seem relevant to collaboration. The intention is to
repeat the study with other personality traits in future.
      </p>
    </sec>
    <sec id="sec-7">
      <title>3.1 Design</title>
      <p>
        This study used the user-as-wizard method [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], in which
participants took the part of the adaptive system and had to assign learners
to groups1. Twenty four participants took part in the study, all were
students with experience of group learning (10 undergraduates
and 14 postgraduates; 6 of the postgraduates had also worked as
teaching assistants and been involved in forming groups of
students to work together in a project). They were presented with 12
learners and their individual learner characteristics and told that
these learners di ered in personality and ability. They were asked
to put these learners into groups, in such a way that the groups
would work well together2.
      </p>
      <p>
        All learners had common English male names, selected to avoid
any in uence of gender, ethnicity or religion. Three learner
characteristics were used: ability (high, low, average), conscientiousness
(high, low, and average), and agreeableness (high, low, average).
Validated stories of personality traits of ctitious learners [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] were
used to illustrate the personality traits (four stories depicting high
and low levels of conscientiousness and agreeableness). These
stories were shown by Smith et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] to reliably convey personality
types, so we can be con dent that the participants will interpret
the personality traits correctly.
      </p>
      <p>Table 1 shows the learner characteristics and personality stories
used and ability levels. We will use the following abbreviations:
ABLE = ability, CONS = conscientiousness, AGR = agreeableness.
Each participant rst assigned the 12 learners to 3 groups of 4
learners, next to 4 groups of 3 learners, and nally to 2 groups of 6
learners.</p>
      <p>Whilst the literature and our previous work indicates that
personality and ability are perceived to matter when forming groups,
we wanted to better understand how these characteristics are used
when forming groups, in order to be able to produce an algorithm
for doing this automatically. So, we were not just interested in
whether learner characteristics matter, but particularly in how they
matter. Hence, we investigated the following overarching research
questions:
RQ1 Is conscientiousness considered in group formation, and if
so how?
1Using this method for this purpose has limitations. These and the rationale for doing
this anyway will be discussed in the paper conclusions.
2The instruction to participants was generic on purpose. We did not ask them to make
a high performing group, as they may have disregarded the learning outcomes for the
other groups. We did not ask them to make well-balanced groups with approximately
equal conditions
RQ2 Is agreeableness considered in group formation, and if so
how?
RQ3 Is ability considered in group formation, and if so how?</p>
      <p>For each of these three learner characteristics (CHAR), we are
interested to know:
(1) Are high CHAR learners distributed evenly across the groups?
(2) Are low CHAR learners distributed evenly across the groups?
(3) Are individual groups balanced on CHAR, so is the number
of low and high CHAR learners the same?
(4) Is CHAR cohesion in individual groups considered?
This results in research questions RQ1.1 RQ1.4, RQ2.1 RQ2.4, and
RQ3.1 RQ3.4.</p>
      <p>Regarding even distributions, given there are 3 high CONS and 4
high ABLE learners, an even distribution for high CONS and high
ABLE means when creating:
• 3 groups of 4: 1 high CONS learner per group; at least 1 high</p>
      <p>ABLE learner per group
• 4 groups of 3: 1 high ABLE learner per group; no more than
1 high CONS learner per group
• 2 groups of 6: 2 high ABLE learner per group; no more than
2 high CONS learners per group
The high CONS case is similar for low CONS, high AGR, and low
AGR; and the high ABLE case is similar to the low ABLE case.</p>
      <p>Regarding cohesiveness, we believe that a group has better
cohesion when the standard deviation of the group’s CHAR is smaller.
We calculate the standard deviation by coding high CHAR as 2,
medium 1, and low 0. This for example means that a group of 3
high and 1 low CHAR learners has worse cohesion than a group of
2 high, 1 medium, and 1 low CHAR learners, which has worse
cohesion than a group of 1 high, 1 low, and 2 medium CHAR learners.
3.2</p>
    </sec>
    <sec id="sec-8">
      <title>Results</title>
      <p>RQ1 Is conscientiousness considered in group formation?
Participants clearly took CONS into account.</p>
      <p>
        (1) 3 groups of 4. Regarding RQ1.1, only 3 groups (out of 72)
were created that did not contain a high CONS learner,
showing participants distributed the 3 high CONS learners quite
evenly over the groups. Regarding RQ1.2, only 10 groups did
not contain a low CONS learner, so also low CONS learners
tended to be distributed, but given the higher number of
groups without a low CONS learner, it seems participants
felt it was more important that a group contained a high
CONS learner than that the low CONS learners were evenly
distributed. Regarding RQ1.3, there was no balance of CONS
in 26 groups, so balance does not seem to be an important
consideration for CONS. Regarding RQ1.4, all groups created
had good CONS cohesion; there were no groups combining
3 high with 1 low CONS, or 2 high with 2 low CONS.
(2) 4 groups of 3. Regarding RQ1.1, only 4 groups (out of 96) were
created that contained more than one high CONS learner,
again showing that participants tried to distribute these
evenly. Regarding RQ1.2, there were 11 groups with more
than one low CONS, again showing that high CONS was
deemed more important than low CONS when balancing
groups. Regarding RQ1.3, only 27 groups were balanced, so
balance does not seem an important consideration for CONS.
Regarding RQ1.4, with a group of 3, the worst cohesiveness
is when 2 high CONS are combined with 1 low CONS, or
the other way around. This only happened in 7 groups, so
cohesiveness was ne.
(3) 2 groups of 6. Regarding RQ1.1 and RQ1.2, only groups were
created that contained at least one high and one low CONS
learner. This con rms that high and low CONS learners
were distributed evenly over the groups. Regarding RQ1.3
and RQ1.4, half the participants allocated 2 high and 2 low
CONS to the same group, seemingly trying to fully balance
out the CONS levels across groups, now this now longer had
a big impact on CONS cohesion (as the group size meant
there were 2 medium CONS learners in those groups as well).
So overall, CONS was considered, and in particular high CONS
learners are distributed evenly. CONS cohesion is important, and
CONS balance is only considered when it does not impact CONS
cohesion. The impact of CONS on group formation is not surprising,
because as noted by [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ], conscientiousness helps one to ensure
and maintain harmonious relationships with others in the group.
This is because conscientious people are usually well organized,
prudent, thorough, neat and achievement oriented [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
      </p>
      <p>RQ2 Is agreeableness considered in group formation? AGR is clearly
less considered than CONS when forming groups.</p>
      <p>(1) 3 groups of 4. Regarding RQ2.1, 13 groups (out of 72) did
not contain a high AGR learner, showing that participants
paid more attention to evenly distributing high CONS across
groups than high AGR. Regarding RQ2.2, 16 groups did not
contain a low AGR learner. Regarding RQ2.3, only 31 groups
were balanced on AGR. Regarding RQ2.4, all groups created
had good AGR cohesion; there were no groups combining 3
high with 1 low AGR, or 2 high with 2 low AGR.
(2) 4 groups of 3. Regarding RQ2.1, despite there not being enough
high AGR learners to allocate even one to each group, in 13
groups more than one high AGR leaner was allocated. This
provides evidence that many participants were not trying
to evenly distribute high AGR learners across groups.
Regarding RQ2.3, they were also not trying to balance out AGR
within groups, as none of these groups with two high AGR
learners was allocated two low AGR learners. Regarding
RQ2.2, 9 groups contained more than one low AGR leaner,
so low AGR learners were slightly more evenly distributed
than high AGR ones. Regarding RQ2.4, there were 10 groups
combining 2 high AGR with 1 low AGR or the other way
around, so cohesion is not as good as for CONS, but still ne.
(3) 2 groups of 6. Regarding RQ2.1 and RQ2.2, all groups
contained at least one high AGR learner, and only 3 groups (out
of 48) did not contain a low AGR learner. So, in this case,
there is more evidence of evenly distributing high AGR
learners than low AGR ones. Regarding RQ2.3, only 18 groups
contained the same number of high and low AGR learners, so
there is less evidence of balancing than for CONS. Regarding
RQ2.4, only 3 groups had bad cohesion, combining 3 low
with 1 high AGR learners.</p>
      <p>
        Overall, there is some evidence of AGR being considered, but clearly
it is considered less than CONS. Balancing the AGR in a group does
not seem to be a consideration, but there is some evidence that
ARG cohesion matters. For AGR, cohesion seems to matter more
than evenly distributing high and low AGR learners, though there
is some evidence of the latter as well. Considering AGR in group
formation is supported by the result of Lun and Bond [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] who
noted that agreeable persons are more socially accommodating and
thus achieve a higher level of relationship harmony with the others
in the group.
      </p>
      <p>RQ3 Is ability considered in group formation? ABLE is considered
when forming groups, but less so than one may have expected.
(1) 3 groups of 4. Regarding RQ3.1, despite there being more high
ABLE learners than groups, there were still 6 groups without
a high ABLE leaner. Similarly, regarding RQ3.2, there were
still 4 groups that did not contain a low ABLE learner and
many groups with 2 low ABLE learners. So, participants
did not tend to evenly divide high and low ABLE learners
across groups. Regarding RQ3.3, most groups tended to be
as balanced on ability as possible (given there are 4 high and
4 low ABLE learners and only 3 groups, many groups had to
have 2 of one type and 1 of the other). Regarding RQ3.4, there
were no groups containing 3 high or 3 low ABLE learners,
and cohesiveness was generally ne.
(2) 4 groups of 3. Regarding RQ3.1, given there were 4 high ABLE
learners, one could have been allocated to each group. In 16
groups (out of 96) this did not happen. Comparing this to
the results for CONS, in the case when there were as many
high CONS learners as groups (3 groups of 4), clearly more
e ort was taken to evenly divide the high CONS learners.
Regarding RQ3.2, 18 groups did not contain a low ABLE
learner. This result is quite similar to that for CONS.
Regarding RQ3.3, only about half the groups (47) were balanced on
ABLE, so this was less of a concern than it seems to have
been for the smaller groups. Regarding RQ3.4, there were
19 groups containing 2 low and 1 high ABLE learner or the
other way around, so cohesiveness was not that good.
(3) 2 groups of 6. Regarding RQ3.1, only 4 groups did not contain
exactly two high ABLE learners, showing that participants
allocated the high ABLE learners evenly over the groups. In
contrast, regarding RQ3.2, 22 groups did not contain exactly
two low ABLE learners, showing that evenly distributing
low ABLE learners was deemed less important. Regarding
RQ3.3, most people (13 out of 24) balanced ABLE, allocated
2 low and 2 high ABLE learners to each group. Regarding
RQ3.4, only 2 groups had very bad cohesiveness, containing
4 low, 1 high and 1 average ABLE learners.</p>
      <p>
        Overall, there is evidence of ABLE being taken into account, but
not necessarily as expected. High and low ABLE learners were not
distributed as evenly as could have been possible, and participants
seem to have cared more about evenly distributing the high CONS
learners than the high ABLE learners. However, the groups were
quite similar in average ability, and the most frequently created
groups were balanced on ability. Cohesiveness was an issue for the
smallest (size 3) groups, where balance seems to have been more
important, but was good for the larger groups. Most groups created
combined low, average and high ABLE learners, which is in line
with a study of Kardanova and Ivanova [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] who suggested that
there needs to be a combination of low, average and high learners’
ability to maintain good performance.
4
      </p>
    </sec>
    <sec id="sec-9">
      <title>CONCLUSIONS</title>
      <p>The success or failure of group collaboration depends on how well
individual learners can work together toward a common goals. This
paper has investigated the impact of personality (conscientiousness
and agreeableness) and ability on actual behaviour when forming
groups. The study showed that personality and ability are taken
into account for group formation and, most importantly, provided
insights on how they should be taken into account, which can be
used in the design of an algorithm that adapts group formation to
learner characteristics. Automated group formation is important
particularly in a setting where there is no human teacher involved or
where one human teacher is dealing with many learners. With the
advance of lifelong learning, there is a move away from traditional
classrooms and from teacher-led learning. Lifelong learners are
motivated to keep learning and keep collaborating with others
in order to be current in their professional lives. This continuous
collaborative learning process will be easier when there is e ective
automatic group formation.</p>
      <p>One limitation of this work is that participants were asked to
form ctional groups, so did not get feedback on how well these
groups ended up performing. The work in this paper provides
initial insights for the algorithm, but further studies are needed
to investigate the impact of adaptive group formation on learner
motivation and achievement.</p>
      <p>A second limitation is that the use of the User-as-Wizard
approach presumes that participants are good at the task the system
is supposed to perform, so that the behaviour of participants can
be used as a basis for an algorithm. Our participants were students,
and one could query whether they have enough experience to be
able to make good groups, and whether it would have been better to
use teachers (though some of our sample were in fact also teaching
assistants). Our earlier qualitative studies had shown that students
and teachers had very similar views on group formation. There
is also not much evidence that teachers are better at this task (in
fact in our earlier focus groups, students complained that teachers
often got groupings wrong). The learners used in this study had
more recent experience of what it is like to work in groups than
teachers would have3. However, this does not mean the learners
are necessarily good at this task. We did make the task easier for
the participants than it normally would be for teachers, in that we
provided detailed information on each learner in terms of their
ability and personality, whilst teachers often may lack in particular
the latter.</p>
      <p>Whilst the User-as-Wizard method has this limitation, it was
hard to conceive of a better way of gaining the insights we needed.
An alternative method would have been to assign real learners to
groups, and measure group collaboration and learning outcomes.
However, this would be extremely di cult to do in a controlled way.
Learners vary on many di erent characteristics (even in personality,
the most popular Five Factor Model distinguishes ve traits), so
trying to investigate the in uence of individual traits as well as
other characteristics (e.g. ability, gender, ethnicity) with real
learners is di cult. One possibility would be to nd 12 learners who
varied in exactly the way required for the study, whilst being equal
on all other characteristics (such as gender, ethnicity, and other
personality traits), which would be hard. We would also require
multiple sets of such learners, to investigate the impact of di erent
groupings. Another possibility would be use a very large set of
learners, allocate them to groups randomly, and use data analytics
to determine the characteristics of the groups that performed best.
However, the quantity of learners required would be enormous, and
there could also be an in uence of the learning task. On balance,
using the User-as-Wizard seems a good approach to investigate
which learner characteristics learners feel matter, and in which
way. This narrows down the learner characteristics we ought to
consider in future studies with real learners, making it more feasible
to conduct such studies. Based on the results of this study improved
hypotheses can be formulated, and tested with more participants
including teachers.</p>
      <p>
        Another possible limitation is the potential task complexity for
study participants. The algorithms previously used for group
formation are commonly based on nding constraint satisfaction
solutions [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ], which can be considered as a complex task even for
computers. When letting this task be performed by humans, it
is possible that they found it too hard to focus on multiple
characteristics (constraints) at once, which may result in them only
3We did not measure the extent of this experience, which would be good to do in
future studies of this kind. However, collaborative group work is used a lot in UK
computing science programmes, including the classes the students were enrolled in,
so the students would have had plenty of experience.
considering other characteristics as secondary or not at all.
However, participants did not complain about the task being too di cult,
and the characteristics participants focused on, and the
commonalities in their approaches, still provide valuable insights. The concern
about task complexity is the reason why we only considered two
personality traits in this study.
      </p>
      <p>Future work will also include studies on other personality traits,
more detailed analysis on the interaction between characteristics,
and studies evaluating the impact of an adaptive group formation
algorithm on the motivation and performance of learner groups
and individual learners.</p>
      <p>
        A system that performs automated group formation will also
require the relevant learner characteristics, such as learner
personality. This paper did not discuss how such characteristics can
be obtained. For example, there are many ways to detect learner
personality; see [
        <xref ref-type="bibr" rid="ref44">44</xref>
        ] for a review and for a very easy method to
obtain learner personality using personality scales.
      </p>
    </sec>
    <sec id="sec-10">
      <title>ACKNOWLEDGEMENT</title>
      <p>The rst author’s PhD is supported by TETFund, Federal Republic
of Nigeria.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>W</given-names>
            <surname>Allinson and John Hayes</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>The Cognitive Style Index</article-title>
          .
          <source>In Technical Manual and User Guide</source>
          . Vol.
          <volume>33</volume>
          .
          <article-title>Pearson Education Ltd or its a liate</article-title>
          ,
          <source>United Kingdom, Chapter</source>
          <volume>8</volume>
          ,
          <fpage>119</fpage>
          -
          <lpage>135</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Albert</given-names>
            <surname>Bandura</surname>
          </string-name>
          .
          <year>1977</year>
          .
          <article-title>Self-e cacy: Toward a unifying theory of behavioral change</article-title>
          .
          <source>Psychological Review</source>
          <volume>84</volume>
          ,
          <issue>2</issue>
          (
          <year>1977</year>
          ),
          <fpage>191</fpage>
          -
          <lpage>215</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Albert</surname>
            <given-names>Bandura</given-names>
          </string-name>
          , Gian Vittorio Caprara, Claudio Barbaranelli, Maria Gerbino, and
          <string-name>
            <given-names>Concetta</given-names>
            <surname>Pastorelli</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Role of A ective Self-Regulatory E cacy in Diverse Spheres of Psychosocial Functioning</article-title>
          .
          <source>Child Development</source>
          <volume>74</volume>
          ,
          <issue>3</issue>
          (
          <year>2003</year>
          ),
          <fpage>769</fpage>
          -
          <lpage>780</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Nigel</given-names>
            <surname>Beacham</surname>
          </string-name>
          and
          <string-name>
            <given-names>Bob</given-names>
            <surname>Duncan</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Development of a Secure Cloud Based Learning Environment for Inclusive Practice in Mainstream Education</article-title>
          .
          <source>Cloud Computing</source>
          <year>2017</year>
          : The Eighth International Conference on Cloud Computing,
          <source>GRIDs, and Virtualization 2</source>
          ,
          <issue>1</issue>
          (
          <year>2017</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Nigel</given-names>
            <surname>Beacham</surname>
          </string-name>
          and
          <string-name>
            <given-names>Martyn</given-names>
            <surname>Rouse</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Student teachers' attitudes and beliefs about inclusion and inclusive practice</article-title>
          .
          <source>Journal of Research in Special Educational Needs</source>
          <volume>12</volume>
          ,
          <issue>1</issue>
          (jan
          <year>2012</year>
          ),
          <fpage>3</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Luiz</given-names>
            <surname>Fernando</surname>
          </string-name>
          Capretz and
          <string-name>
            <given-names>Faheem</given-names>
            <surname>Ahmed</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Why Do We Need Personality Diversity in Software Engineering? SIGSOFT Softw</article-title>
          .
          <source>Eng. Notes 35, 2 (March</source>
          <year>2010</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Ling</given-names>
            <surname>Cen</surname>
          </string-name>
          , Dymitr Ruta, Leigh Powell, Benjamin Hirsch, and
          <string-name>
            <given-names>Jason</given-names>
            <surname>Ng</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Quantitative approach to collaborative learning: performance prediction, individual assessment</article-title>
          , and group composition.
          <source>International Journal of Computer-Supported Collaborative Learning</source>
          <volume>11</volume>
          , 2 (jun
          <year>2016</year>
          ),
          <fpage>187</fpage>
          -
          <lpage>225</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <source>[8] Commission of the European Communities</source>
          .
          <year>2009</year>
          .
          <article-title>Adult learning: It is never too late to learn</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Barbara</given-names>
            <surname>Gross Davis</surname>
          </string-name>
          .
          <year>1993</year>
          .
          <article-title>Tools for Teaching (2nd ed</article-title>
          .). jossey - Bass Inc., Publishers, 350 Sansome Street, San Francisco, California.
          <fpage>1</fpage>
          -449 pages.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Matt</given-names>
            <surname>Dennis</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Adapting Feedback to Personality to Increase Motivation</article-title>
          .
          <source>Technical Report. 7-9</source>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Pierre</given-names>
            <surname>Dillenbourg</surname>
          </string-name>
          .
          <year>1999</year>
          .
          <article-title>What do you mean by 'collaborative learning'</article-title>
          <source>? Americas Conference on Information Systems 12</source>
          ,
          <issue>1</issue>
          (
          <year>1999</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Gloria</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Galanes</surname>
          </string-name>
          and
          <string-name>
            <surname>Katherine (Katherine L.) Adams</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>E ective group discussion : theory and practice</article-title>
          .
          <source>McGraw-Hill</source>
          .
          <volume>443</volume>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Jerry</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Gilley</surname>
            ,
            <given-names>M. Lane</given-names>
          </string-name>
          <string-name>
            <surname>Morris</surname>
          </string-name>
          ,
          <string-name>
            <surname>Alina M. Waite</surname>
            , Tabitha Coates, and
            <given-names>Abigail</given-names>
          </string-name>
          <string-name>
            <surname>Veliquette</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Integrated Theoretical Model for Building E ective Teams</article-title>
          .
          <source>Advances in Developing Human Resources</source>
          <volume>12</volume>
          ,
          <issue>1</issue>
          (
          <year>2010</year>
          ),
          <fpage>7</fpage>
          -
          <lpage>28</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Hackman</surname>
            and
            <given-names>R</given-names>
          </string-name>
          <string-name>
            <surname>Wageman</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>When and how team leaders matter</article-title>
          .
          <source>Research in organizational behavior 26</source>
          (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Terry</surname>
            <given-names>Halfhill</given-names>
          </string-name>
          , Eric Sundstrom, Jessica Lahner, Wilma Calderone, and
          <string-name>
            <surname>Tjai M Nielsen</surname>
          </string-name>
          .
          <year>2005</year>
          . Group Personality Composition and
          <article-title>Group E ectiveness An Integrative Review of Empirical Research</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Edmund</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Hansen</surname>
            and
            <given-names>James A.</given-names>
          </string-name>
          <string-name>
            <surname>Stephens</surname>
          </string-name>
          .
          <year>2000</year>
          .
          <article-title>The Ethics of Learner Centered Education: Dynamics that Impede the Process</article-title>
          .
          <source>Technical Report</source>
          . Emporia State University of Kansas, Kansas. 1-8 pages.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Linda</given-names>
            <surname>Harasim</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Learning Theory and Online Technologies</article-title>
          .
          <source>In Learning Theory and Online Technologies</source>
          . Routledge Taylor &amp; Francis.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>Chris</given-names>
            <surname>Houldsworth</surname>
          </string-name>
          and
          <string-name>
            <given-names>Brian P.</given-names>
            <surname>Mathews</surname>
          </string-name>
          .
          <year>2000</year>
          .
          <article-title>Group composition, performance and educational attainment</article-title>
          .
          <source>Education + Training</source>
          <volume>42</volume>
          ,
          <issue>1</issue>
          (feb
          <year>2000</year>
          ),
          <fpage>40</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Susan</surname>
            <given-names>E</given-names>
          </string-name>
          <string-name>
            <surname>Jackson</surname>
          </string-name>
          ,
          <article-title>Joan F Brett, Valerie I Sessa, Dawn M Cooper,</article-title>
          and Et Al.
          <year>1991</year>
          .
          <article-title>Some di erences make a di erence: Individual dissimilarity and group heterogeneity as correlates of recruitment, promotions, and turnover</article-title>
          .
          <source>Journal of Applied Psychology</source>
          <volume>76</volume>
          ,
          <issue>5</issue>
          (
          <year>1991</year>
          ),
          <fpage>675</fpage>
          -
          <lpage>689</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>David</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Johnson</surname>
          </string-name>
          and Roger T. Johnson.
          <year>2004</year>
          .
          <article-title>Assessing students in groups : promoting group responsibility and individual accountability</article-title>
          . Corwin Press. 206 pages.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>David</surname>
            <given-names>W Johnson</given-names>
          </string-name>
          , Roger T Johnson,
          <article-title>Karl A Smith,</article-title>
          and
          <string-name>
            <given-names>Karl</given-names>
            <surname>Smith</surname>
          </string-name>
          .
          <year>2013</year>
          . Cooperative Learning: Improving University Instruction By Basing
          <source>Practice On Validated Theory. Journal on Excellence in Universityn Teaching</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>M.</given-names>
            <surname>KankaraÅą</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Personality matters</article-title>
          .
          <source>Organisation for Economic Co-Operation and Development (OECD)</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>Elena</given-names>
            <surname>Kardanova</surname>
          </string-name>
          and
          <string-name>
            <given-names>Alina</given-names>
            <surname>Ivanova</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Heterogeneity of the Educational System: an Introduction. (</article-title>
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Saul</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Kassin</surname>
          </string-name>
          .
          <year>2004</year>
          . Psychology. Pearson/Prentice Hall.
          <volume>826</volume>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>Marjan</given-names>
            <surname>Laal</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Lifelong Learning: What does it Mean? Procedia - Social and</article-title>
          <source>Behavioral Sciences</source>
          <volume>28</volume>
          (jan
          <year>2011</year>
          ),
          <fpage>470</fpage>
          -
          <lpage>474</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Emily</surname>
            <given-names>R</given-names>
          </string-name>
          <string-name>
            <surname>Lai</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Collaboration: A Literature Review Research Report</article-title>
          . , 49 pages.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Lev</surname>
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Vygotsky</surname>
          </string-name>
          .
          <year>1962</year>
          .
          <article-title>Thought and Language</article-title>
          .
          <source>The Journal of Mind and Behavior Wintet</source>
          <volume>8</volume>
          ,
          <issue>1</issue>
          (
          <year>1962</year>
          ),
          <fpage>175</fpage>
          -
          <lpage>178</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>Vivian</given-names>
            <surname>Miu Chi Lun</surname>
          </string-name>
          and Michael Harris Bond.
          <year>2006</year>
          .
          <article-title>Achieving relationship harmony in groups and its consequence for group performance</article-title>
          .
          <source>Asian Journal of Social Psychology</source>
          <volume>9</volume>
          ,
          <issue>3</issue>
          (
          <year>2006</year>
          ),
          <fpage>195</fpage>
          -
          <lpage>202</lpage>
          . https://doi.org/10.1111/j.
          <fpage>1467</fpage>
          -
          <lpage>839X</lpage>
          .
          <year>2006</year>
          .
          <volume>00197</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Ioanna</surname>
            <given-names>Lykourentzou</given-names>
          </string-name>
          , Angeliki Antoniou, Yannick Naudet, and
          <string-name>
            <given-names>Steven P.</given-names>
            <surname>Dow</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Personality Matters: Balancing for Personality Types Leads to Better Outcomes for Crowd Teams</article-title>
          .
          <source>In Proceedings of the 19th ACM Conference on ComputerSupported Cooperative Work &amp; Social Computing (CSCW '16)</source>
          . ACM, New York, NY, USA,
          <fpage>260</fpage>
          -
          <lpage>273</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>Judith</given-names>
            <surname>Mastho</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>The Pursuit of Satisfaction: A ective State in Group Recommender Systems</article-title>
          .
          <source>International Conference on User Modeling</source>
          <volume>35</volume>
          ,
          <issue>38</issue>
          (
          <year>2005</year>
          ),
          <fpage>297</fpage>
          -
          <lpage>306</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Robert</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>McCrae</surname>
            and
            <given-names>Oliver P.</given-names>
          </string-name>
          <string-name>
            <surname>John</surname>
          </string-name>
          .
          <year>1992</year>
          .
          <article-title>An Introduction to the Five-Factor Model and Its Applications</article-title>
          .
          <source>Journal of Personality 60</source>
          ,
          <issue>2</issue>
          (jun
          <year>1992</year>
          ),
          <fpage>175</fpage>
          -
          <lpage>215</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <surname>Sinéad</surname>
            <given-names>McGivney</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Alan F.</given-names>
            <surname>Smeaton</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Hyowon</given-names>
            <surname>Lee</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>The e ect of personality on collaborative task performance and interaction</article-title>
          .
          <source>Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering 10 LNICST</source>
          (
          <year>2009</year>
          ),
          <fpage>499</fpage>
          -
          <lpage>511</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>Catherine</given-names>
            <surname>Giggs Michael A. Campion</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Gina J.</given-names>
            <surname>Medsker</surname>
          </string-name>
          .
          <year>2001</year>
          . Relations_Between_Work.pdf. ,
          <volume>46</volume>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <surname>Richard</surname>
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Moreland</surname>
          </string-name>
          .
          <year>1985</year>
          .
          <article-title>Social categorization and the assimilation of "new" group members</article-title>
          .
          <source>Journal of Personality and Social Psychology</source>
          <volume>48</volume>
          ,
          <issue>5</issue>
          (
          <year>1985</year>
          ),
          <fpage>1173</fpage>
          -
          <lpage>1190</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35] Richard L Moreland,
          <article-title>JM Levine,</article-title>
          and
          <string-name>
            <given-names>ML</given-names>
            <surname>Wingert</surname>
          </string-name>
          .
          <year>2013</year>
          . Creating the Ideal Group: Composition E ects at Work. Taylor and Francis.
          <volume>644</volume>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <surname>Ann-Marie Nazzaro</surname>
            and
            <given-names>Joyce</given-names>
          </string-name>
          <string-name>
            <surname>Strazzabosco</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Group dynamics and team building</article-title>
          .
          <source>DEVELOPMENT 4</source>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>Chinasa</given-names>
            <surname>Odo</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>Group Formation for Online Collaborative Learning: A Systematic Literature Review</article-title>
          .
          <source>In International Conference on Arti cial Intelligence in Education.</source>
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <surname>Chinasa</surname>
            <given-names>Odo</given-names>
          </string-name>
          , Judith Mastho , and
          <string-name>
            <given-names>Nigel</given-names>
            <surname>Beacham</surname>
          </string-name>
          . N.D.. Heterogeneous Group Formation:
          <article-title>Combining the right Learner Characteristics for Online Collaborative Learning</article-title>
          . (N.D.).
          <source>Unpublished manuscript.</source>
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <surname>Chinasa</surname>
            <given-names>Odo</given-names>
          </string-name>
          , Judith Mastho , Nigel Beacham, and
          <string-name>
            <given-names>Manal</given-names>
            <surname>Alhathli</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>A ective State for Learning Activities Selection</article-title>
          .
          <source>In Proceedings of Intelligent Mentoring Systems Workshop Associated with the 19th International Conference on Arti cial Intelligence in Education</source>
          , AIED
          <year>2018</year>
          .
          <volume>1</volume>
          -
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <surname>Rena</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Pallo</surname>
            and
            <given-names>Keith</given-names>
          </string-name>
          <string-name>
            <surname>Pratt</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Learning Together in Community: Collaboration Online</article-title>
          .
          <source>20th Annual Conference on Distance Teaching and Learning</source>
          (
          <year>2005</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [41]
          <string-name>
            <given-names>J.</given-names>
            <surname>Piaget</surname>
          </string-name>
          .
          <year>1936</year>
          .
          <article-title>The origins of intelligence in the child</article-title>
          .
          <source>Routledge &amp; Kegan Paul</source>
          , London.
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [42]
          <string-name>
            <surname>Tim</surname>
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Roberts</surname>
          </string-name>
          .
          <year>2004</year>
          .
          <article-title>Online collaborative learning : theory and practice</article-title>
          .
          <source>Information Science Pub</source>
          .
          <volume>321</volume>
          pages.
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [43]
          <string-name>
            <given-names>Muzafer</given-names>
            <surname>Sherif</surname>
          </string-name>
          and
          <string-name>
            <given-names>Carolyn W.</given-names>
            <surname>Sherif</surname>
          </string-name>
          .
          <year>1965</year>
          .
          <article-title>The Adolescent in His Group in Its Setting: Theoretical Approach</article-title>
          and Methodology Required.
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          [44]
          <string-name>
            <surname>Kirsten</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Smith</surname>
            , Matt Dennis, Judith Mastho , and
            <given-names>Nava</given-names>
          </string-name>
          <string-name>
            <surname>Tintarev</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>A methodology for creating and validating psychological stories for conveying and measuring psychological traits. User Modeling</article-title>
          and
          <string-name>
            <surname>User-Adapted Interaction</surname>
          </string-name>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          [45]
          <string-name>
            <surname>Bruce</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Tuckman</surname>
          </string-name>
          .
          <year>1964</year>
          . Personality Structure, Group Composition, and Group Functioning.
          <source>Sociometry</source>
          <volume>27</volume>
          ,
          <issue>4</issue>
          (dec
          <year>1964</year>
          ),
          <fpage>469</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          [46]
          <string-name>
            <given-names>Rudina</given-names>
            <surname>Vrioni</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>E ects of Group Learning on the Academic Performance of University Students. problems of education in the 21st century 33 (</article-title>
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          [47]
          <string-name>
            <surname>Vygotsky</surname>
          </string-name>
          .
          <year>1978</year>
          .
          <article-title>Integration between learning and development</article-title>
          . Harvard University press, Cambridge.
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          [48]
          <string-name>
            <given-names>Mona</given-names>
            <surname>Zamani</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Cooperative learning: Homogeneous and heterogeneous grouping of Iranian EFL learners in a writing context</article-title>
          .
          <source>Cogent Education</source>
          <volume>3</volume>
          ,
          <issue>1</issue>
          (feb
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          [49]
          <string-name>
            <given-names>Vicky</given-names>
            <surname>Zygouris-Coe</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Collaborative Learning in an Online Teacher Education Course: Leasons Learned</article-title>
          .
          <source>ICICTE Proceedings</source>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>