<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Design Criteria to Model Groups in Big Data Scenarios: Algorithms and Best Practices?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ludovico Boratto</string-name>
          <email>ludovico.boratto@unica.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gianni Fenu</string-name>
          <email>fenu@unica.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pier Luigi Pau</string-name>
          <email>pierluigipau@unica.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dipartimento di Matematica e Informatica, Universita di Cagliari</institution>
          ,
          <addr-line>Via Ospedale 72 - 09124 Cagliari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>There are di erent types of information systems, such as those that perform group recommendations and market segmentations, which operate with groups of users. In order to combine the individual preferences and properly address suggestions to users, group modeling strategies are employed. Nowadays, data is characterized by large amounts in terms of volume, speed, and variety (the so-called big data issue). In this paper, we are going to tackle the problem of modeling group preferences in big data scenarios. This study will present the existing strategies, and we are going to present criteria to design the algorithms that implement them when big amounts of data have to be combined. Moreover, a set of best practices discusses under which conditions the presented strategies can be adopted in big data scenarios.</p>
      </abstract>
      <kwd-group>
        <kwd>Group Modeling</kwd>
        <kwd>Big Data</kwd>
        <kwd>Algorithms</kwd>
        <kwd>Design</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Combining the preferences of individual users is a central problem for the
information systems that operate with groups. The most challenging and widely
studied, both by the industry and the academia, are the group recommender [
        <xref ref-type="bibr" rid="ref1 ref2">1,
2</xref>
        ] and market segmentation [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ] systems, which aggregate information about
large groups of users and tens of items in order to lter the data and produce
suggestions for the users in terms of items or ads. Therefore, nowadays these
systems have to deal with big data and to be able to lter large amounts of
information.
      </p>
      <p>
        The task of aggregating the individual preferences into a single model is
known as group modeling, and several strategies have been studied in the
literature [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. It is known that no strategy is better than another and that the
group modeling strategy adopted by an information system should be chosen
after a deep analysis of the application domain in which the groups have to be
modeled [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>In this paper, we tackle the novel problem of studying criteria for applicable
and e cient design of group modeling algorithms in big data scenarios. More
speci cally, we are going to answer the following research question: which group
modeling strategies can actually be employed in real-world contexts
characterized by big data? In order to answer this question, we rst present the existing
group modeling strategies (Section 2), then we propose design guidelines to e
ciently implement these strategies in big data scenarios, and discuss with a set
of best practices which strategies are applicable in real-world big data contexts
(Section 3). Our aim is to guide future research in this area towards the
development of approaches that are e cient and e ective at the same time. This study
is concluded with a summary of the proposed criteria and with perspectives for
future work in this research area (Section 4).
2</p>
    </sec>
    <sec id="sec-2">
      <title>Background and Related Work</title>
      <p>
        Group modeling [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] is the process adopted to combine multiple user models into a
single model. In this section, we are going to present the modeling strategies that
have been employed in the literature. In order to facilitate their understanding,
an example of the results produced by the strategies is given as a reference, then
we present each of them.
2.1
      </p>
      <sec id="sec-2-1">
        <title>Group Modeling: Working Examples.</title>
        <p>Here, we present an example of how each group modeling strategy operates. We
consider three users (denoted as u1, u2, and u3), who rate ten items (i1, ..., i10)
with a rating from 1 to 10. Table 1 reports the output of the strategies that
combine individual ratings, while tables 2, 3, and 4, show how the Borda Count,
Copeland Rule, and Plurality Voting strategies respectively work (these tables
are based on the ratings in Table 1).
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Additive Utilitarian [AU]</title>
        <p>The individual ratings for each item are summed and a list of items ranked by
sum is created. The list produced by each strategy is the same that would be
generated when averaging the individual ratings, so it is also called `Average
strategy'. An example of how the strategy works is given in Table 1 (AU line).</p>
        <p>
          The strategy has proven to be e ective in di erent contexts [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], like the
combination of preferences on di erent types of features (e.g., location, cost,
cuisine) when recommending restaurants to a group [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
2.3
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Multiplicative Utilitarian [MU]</title>
        <p>The ratings given by the users for each item are multiplied and a ranked list of
items is produced. An example of how the strategy works is given in Table 1
(M U line).</p>
        <p>
          This strategy was employed in the music recommendation domain by [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
The strategy assigns to an item a number of points, according to the position in
the list of each user. The least favorite one gets 0 points and a point is added
each time the next item in the list is considered. If a user gave the same rating
to more than one item, the points are distributed. Considering the example in
Table 2, items i8 and i9 were rated by user u2 with the lowest rating and share
the lowest positions with 0 and 1 points, by getting (0+1)/2=0.5 points. A group
preference is obtained by adding the individual points of an item.
        </p>
        <p>
          This strategy was implemented in [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
2.5
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Copeland Rule [CR]</title>
        <p>It is a form of majority voting that sorts the items according to their Copeland
index, which is calculated as the number of times in which an alternative beats
i6
+
0
+
+
+
0
+
+
+
+
+8
4
i1
i1, i10
i10
i1, i10
i7
+
0
+
+
0
+
+
+
+4
i8
0
0
-8
5
i3
i3
i3
i3
i9
0
0
-8
6
i8
i8, i9
i9
i8, i9
i10
0
+
+
+
0
-2
u1
u2
u3
Group
i1
0
+
+
+
0
-2
the others, minus the number of times it loses against the other alternatives. In
the example in Table 3, item i2 beats item i1, since it received a higher rating
by both users u1 and u2.</p>
        <p>
          The approach proposed in [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] proved that a form of majority voting is the
most successful in a requirements negotiation context.
2.6
        </p>
      </sec>
      <sec id="sec-2-5">
        <title>Plurality Voting [PV]</title>
        <p>Each user votes for her/his favorite option. The one that receives the highest
number of votes wins. If more than one alternative needs to be selected, the
options that received the highest number of votes are selected. An example of
how the strategy works is given in Table 4.</p>
        <p>
          This strategy was implemented and tested by [
          <xref ref-type="bibr" rid="ref12 ref13">12, 13</xref>
          ] in the TV domain.
2.7
        </p>
      </sec>
      <sec id="sec-2-6">
        <title>Approval Voting [AV]</title>
        <p>Each user votes for as many items as she/he wants, and a point is assigned to
all the ones a user likes. To show how the strategy works, in the example in
Table 1 (AV line) we suppose that each user votes for all the items with a rating
above a threshold (for example, 5). A group preference is obtained by adding
the individual points of an item.</p>
        <p>
          To choose the pages to recommend to a group, Let's Browse [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] evaluates
if the page currently considered by the system matches with the user pro le
above a certain threshold and recommends the one with the highest score. This
strategy also proved to be successful in contexts in which the similarity between
the users in a group is high [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ].
2.8
        </p>
      </sec>
      <sec id="sec-2-7">
        <title>Least Misery [LM]</title>
        <p>The group rating produced for an item is the lowest rating expressed for that
item by any of the users in the group. This strategy usually models small groups,
to make sure that every member is satis ed. A drawback is that if the majority
of the group really likes something, but one person does not, the item will not
to be recommended to the group. This is what happens in Table 1 for the items
i2 and i7. An example of how the strategy works is given in Table 1 (LM line).</p>
        <p>
          This strategy is used by [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ], to recommend movies to small groups.
2.9
        </p>
      </sec>
      <sec id="sec-2-8">
        <title>Most Pleasure [MP]</title>
        <p>The rating assigned to an item for a group is the highest one expressed for that
item by a member of a group. An example of how the strategy works is given in
Table 1 (M P line).</p>
        <p>
          This strategy is used by [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] in a system that faces the cold start problem.
2.10
        </p>
      </sec>
      <sec id="sec-2-9">
        <title>Average Without Misery [AWM]</title>
        <p>The rating assigned to an item for a group is the average of the ratings given
by each user. All the items that received a rating under a certain threshold by
a user are not included in the group model (in the example in Table 1 - AW M
line, the threshold rating is 4).</p>
        <p>
          In order to model a group to decide the music to play in a gym, in [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] the
individual ratings are summed, discarding the ones under a minimum degree.
2.11
        </p>
      </sec>
      <sec id="sec-2-10">
        <title>Fairness [F]</title>
        <p>This strategy is based on the idea that users can be recommended something
they do not like, as long as they also get recommended something they like. This
is done by allowing each user to choose her/his favorite item. If two items have
the same rating, the choice is based on the other users' preferences. This is done
until everyone made a choice. Next, everyone chooses a second item, starting
from the person who chose last the rst time.</p>
        <p>If in the example in Table 1, we suppose that user u1 chose rst, she/he would
consider i2, i4, and i7, and would choose i4, because it has the highest average
considering the other users' ratings. Next, u2 would choose between i2 and i6
and would select i6 for the same reason. Then, u3 would choose item i10. Since
everyone chose an item, it would be u3's turn again and i5 would be chosen.
User u2 would choose i2, which has the highest rating along with i6 (which was
already chosen). Then, u1 would choose i7, which is the one with the highest
rating and was not chosen yet. The nal sequence of items that models the group
would be: i4, i6, i10, i5, i2, i7, i1, i3, i9, i8.</p>
        <p>
          This strategy is adopted by [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] in the music recommendation context.
This strategy selects the items according to the preferences of the most respected
person, using the preferences of the others just in case more than one item
received the same evaluation. The idea is that there are scenarios is which a
group is guided/dominated by a person. In the example in Table 1, u1 is the
most respected person.
        </p>
        <p>
          This strategy is adopted to select tourist attractions advantaging the users
with particular needs [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], or when experts are recognized in a group [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
Moreover, there are studies that highlight that when people interact, a user or a small
portion of the group in uences the choices of the others [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ].
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Criteria for Applicable Design of Group</title>
    </sec>
    <sec id="sec-4">
      <title>Algorithms in Big Data Scenarios</title>
    </sec>
    <sec id="sec-5">
      <title>Modeling</title>
      <p>This section presents design criteria to implement the strategies presented in
the previous section in scenarios characterized by big data. In Section 3.1, we
are going to present design criteria from an algorithmic point of view, while in
Section 3.2 we are going to study the nature of each strategy to evaluate their
applicability in real-world scenarios characterized by big data.
3.1</p>
      <sec id="sec-5-1">
        <title>Algorithms Design</title>
        <p>Each strategy is fairly trivial to implement in an e cient way, by adopting data
structures that can be quickly accessed. A possible way to implement a group
model might be a hash table that stores the item ids as keys and the group
rating as values. Each time a new individual rating arrives, the hash table can
be e ciently updated with average complexity O(1).</p>
        <p>
          In order to suggest the items to the users, the items in the group model have
to be sorted by group rating. An e cient sorting algorithm for big data, known as
two-way replacement selection, has been proposed in [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. The algorithm presents
a variant of the Merge Sort algorithm, speci cally designed for big data scenarios,
and it currently represents the state of the art.
3.2
        </p>
      </sec>
      <sec id="sec-5-2">
        <title>Applicability in Big Data Scenarios: Best Practices</title>
        <p>
          Here, we present a set of best practices related to the applicability of the
previously presented group modeling strategies in big data scenarios. Most of these
best practices are derived from a case-study conducted in the group
recommendation domain and presented in [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ], and from considerations on the aspects
that characterize big data scenarios.
        </p>
        <p>The main argument against the deployment of a strategy in a big data
scenario will be represented by a high computational cost of performing inserts
and updates of ratings in large sets of data. More precisely, it is assumed that
group ratings, resulting from the application of a speci c strategy on a set of
user ratings, are stored for later use in order to save computation power, and
that a recalculation of group ratings is required following the insertion or update
of user ratings. This evaluation takes into account the computational cost of
updating group ratings. Furthermore, for the sake of completeness, it will also be
noted when a strategy is simply inadequate for modeling large groups of users,
regardless of any di culties in handling large amounts of data.</p>
        <p>The Additive Utilitarian strategy can be easily employed in big data
scenarios, as the only operation required to update the group model is to add the
rating expressed by a user for an item to the existing group rating for that item.</p>
        <p>Likewise, the Multiplicative Utilitarian would be very simple to implement.
However, it would not be advisable to employ it in presence of large groups,
as an over ow would most certainly occur when the original user ratings are
multiplied1. Moreover, given the large amounts of operations that the strategy
would perform for such a group, rating normalization to avoid the problem would
lead to a loss in precision and to a drop in the accuracy of the system.</p>
        <p>Borda Count, Copeland Rule, Plurality Voting, and Fairness require to
update the individual model of each user each time she/he assigns a new rating.
After the individual model is updated, the group model can be updated
accordingly. Therefore, these strategies would not be e ciently applicable in big data
scenarios.</p>
        <p>The Average Without Misery, Approval Voting, Least Misery, and Most
Pleasure strategies, can apparently be easily and e ciently adapted in big data
scenarios, as they only require to calculate an average, the maximum, or the
minimum of the individual ratings given to each item. However, they should not
be adopted in big data due to their nature. Indeed, Average Without Misery
discards a group rating if at least a user has given to an item a rating lower than
the considered threshold. Therefore, even with a small threshold value, like 2, the
vast majority of the items would not be modeled by the strategy in a context in
which groups are large (the larger is the group, the higher is the number of times
an item is rated, and higher is the probability that at least one user did not like
the item). Considering the Approval Voting strategy with high threshold values
(for example, 5), too many ratings would be discarded by the model because
only the items with a high rating (i.e., with a rating above 5), would be
considered. The other two strategies (i.e., Least Misery and Most Pleasure) are usually
employed to model small groups; indeed, if a group is large, the group model
would contain respectively only low or high ratings, which would not represent
the preferences of the group as a whole.</p>
        <p>Lastly, in case a person that guides the group or whose preferences align with
most of the group exists, the Most Respected Person strategy would be at the
same time e ective and e cient to employ.
1 Given 60 users who expressed a very low rating (like 2) for an item, a 64 bit machine
would not be able to handle the group rating, since it cannot process numbers higher
that 252.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Conclusions</title>
      <p>In this paper, we analyzed the existing group modeling strategies and presented
criteria for applicable design in real-world scenarios characterized by big data.
As a result of this study, we can say that the vast majority of the strategies do
not present limitations from an algorithmic point of view and could be e ciently
implemented. However, due to how the strategies operate, their e ectiveness is
a ected in big data scenarios. Indeed, some of them do not consider a group
rating if a user or a part of the group has given a low rating to an item, or
some others would lead the group model to be composed just with low or high
ratings, blurring the knowledge on what the users in the group like or do not like.
In conclusion, in presence of big data, a simple but very e ective strategy, like
Additive Utilitarian, which considers all the users and all the ratings given by
them, should be preferred. Future work will be devoted at experimenting these
strategies in the real-world scenarios characterized by big data to analyze their
applicability and validate these design criteria.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Boratto</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carta</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>State-of-the-art in group recommendation and new approaches for automatic identi cation of groups</article-title>
          .
          <source>In: Information Retrieval and Mining in Distributed Environments. Volume 324 of Studies in Computational Intelligence</source>
          . Springer Berlin Heidelberg (
          <year>2011</year>
          )
          <volume>1</volume>
          {
          <fpage>20</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Jameson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smyth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Recommendation to groups</article-title>
          .
          <source>In: The Adaptive Web, Methods and Strategies of Web Personalization. Volume 4321 of Lecture Notes in Computer Science</source>
          . Springer, Berlin (
          <year>2007</year>
          )
          <volume>596</volume>
          {
          <fpage>627</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Yankelovich</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meer</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Rediscovering market segmentation</article-title>
          .
          <source>Harvard Business Review</source>
          <volume>84</volume>
          (
          <issue>2</issue>
          ) (
          <year>2006</year>
          )
          <volume>1</volume>
          {
          <fpage>10</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiang</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brusco</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>A uni ed framework for market segmentation and its applications</article-title>
          .
          <source>Expert Syst. Appl</source>
          .
          <volume>39</volume>
          (
          <issue>11</issue>
          ) (
          <year>September 2012</year>
          )
          <volume>10292</volume>
          {
          <fpage>10302</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Mastho</surname>
          </string-name>
          , J.:
          <article-title>Group recommender systems: Combining individual models</article-title>
          .
          <source>In: Recommender Systems Handbook</source>
          . Springer (
          <year>2011</year>
          )
          <volume>677</volume>
          {
          <fpage>702</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Pizzutilo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carolis</surname>
            ,
            <given-names>B.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cozzolongo</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ambruoso</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Group modeling in a public space: Methods, techniques and experiences</article-title>
          .
          <source>In: Proceedings of WSEAS AIC 05</source>
          ,
          <string-name>
            <surname>Malta</surname>
            ,
            <given-names>ACM</given-names>
          </string-name>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Pessemier</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dooms</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martens</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Comparison of group recommendation algorithms</article-title>
          .
          <source>Multimedia Tools and Applications</source>
          (
          <year>2013</year>
          )
          <volume>1</volume>
          {
          <fpage>45</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>J.F.</given-names>
          </string-name>
          :
          <article-title>Pocket restaurant nder: A situated recommender system for groups</article-title>
          .
          <source>In: Workshop on Mobile Ad-Hoc Communication at the 2002 ACM Conference on Human Factors in Computer Systems</source>
          , Minneapolis (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Christensen</surname>
            ,
            <given-names>I.A.</given-names>
          </string-name>
          , Schia no,
          <string-name>
            <surname>S.N.</surname>
          </string-name>
          :
          <article-title>Entertainment recommender systems for group of users</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>38</volume>
          (
          <issue>11</issue>
          ) (
          <year>2011</year>
          )
          <volume>14127</volume>
          {
          <fpage>14135</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Baltrunas</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makcinskas</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricci</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Group recommendations with rank aggregation and collaborative ltering</article-title>
          .
          <source>In: Proceedings of the 2010 ACM Conference on Recommender Systems, RecSys</source>
          <year>2010</year>
          , New York, NY, USA, ACM (
          <year>2010</year>
          )
          <volume>119</volume>
          {
          <fpage>126</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Felfernig</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zehentner</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ninaus</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grabner</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maalej</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pagano</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weninger</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reinfrank</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Group decision support for requirements negotiation</article-title>
          .
          <source>In: Advances in User Modeling - UMAP 2011 Workshops, Revised Selected Papers</source>
          . Volume
          <volume>7138</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2012</year>
          )
          <volume>105</volume>
          {
          <fpage>116</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Senot</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kostadinov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bouzid</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Picault</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aghasaryan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Evaluation of group pro ling strategies</article-title>
          .
          <source>In: IJCAI 2011, Proceedings of the 22nd International Joint Conference on Arti cial Intelligence</source>
          , IJCAI/AAAI (
          <year>2011</year>
          )
          <volume>2728</volume>
          {
          <fpage>2733</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Senot</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kostadinov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bouzid</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Picault</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aghasaryan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bernier</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Analysis of strategies for building group pro les</article-title>
          . In: User Modeling, Adaptation, and
          <string-name>
            <surname>Personalization</surname>
            , 18th International Conference,
            <given-names>UMAP</given-names>
          </string-name>
          <year>2010</year>
          .
          <article-title>Proceedings</article-title>
          . Volume
          <volume>6075</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2010</year>
          )
          <volume>40</volume>
          {
          <fpage>51</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Lieberman</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dyke</surname>
            ,
            <given-names>N.W.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vivacqua</surname>
            ,
            <given-names>A.S.:</given-names>
          </string-name>
          <article-title>Let's browse: A collaborative web browsing agent</article-title>
          .
          <source>In: IUI</source>
          . (
          <year>1999</year>
          )
          <volume>65</volume>
          {
          <fpage>68</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Bourke</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smyth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Using social ties in group recommendation</article-title>
          .
          <source>In: AICS 2011: Proceedings of the 22nd Irish Conference on Arti cial Intelligence and Cognitive Science: 31 August-2 September</source>
          , 2011: University of Ulster-Magee,
          <source>Intelligent Systems Research Centre</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>O</given-names>
            <surname>'Connor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Cosley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Konstan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.A.</given-names>
            ,
            <surname>Riedl</surname>
          </string-name>
          , J.:
          <article-title>Polylens: A recommender system for groups of users</article-title>
          .
          <source>In: Proceedings of the Seventh European Conference on Computer Supported Cooperative Work</source>
          , Kluwer (
          <year>2001</year>
          )
          <volume>199</volume>
          {
          <fpage>218</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Sanchez</surname>
            ,
            <given-names>L.Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bridge</surname>
            ,
            <given-names>D.G.</given-names>
          </string-name>
          ,
          <article-title>D az-</article-title>
          <string-name>
            <surname>Agudo</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Recio-Garc</surname>
            <given-names>a</given-names>
          </string-name>
          ,
          <string-name>
            <surname>J.A.:</surname>
          </string-name>
          <article-title>A case-based solution to the cold-start problem in group recommenders</article-title>
          .
          <source>In: Case-Based Reasoning Research and Development - 20th International Conference, ICCBR 2012. Proceedings. Volume 7466 of Lecture Notes in Computer Science</source>
          ., Springer (
          <year>2012</year>
          )
          <volume>342</volume>
          {
          <fpage>356</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>J.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anagnost</surname>
          </string-name>
          , T.D.:
          <article-title>Musicfx: An arbiter of group preferences for computer supported collaborative workouts</article-title>
          .
          <source>In: CSCW '98, Proceedings of the ACM 1998 Conference on Computer Supported Cooperative Work</source>
          , ACM (
          <year>1998</year>
          )
          <volume>363</volume>
          {
          <fpage>372</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Ardissono</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Petrone</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Segnan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torasso</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Intrigue:
          <article-title>Personalized recommendation of tourist attractions for desktop and hand held devices</article-title>
          .
          <source>Applied Arti cial Intelligence</source>
          <volume>17</volume>
          (
          <issue>8-9</issue>
          ) (
          <year>2003</year>
          )
          <volume>687</volume>
          {
          <fpage>714</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Jung</surname>
            ,
            <given-names>J.J.:</given-names>
          </string-name>
          <article-title>Attribute selection-based recommendation framework for short-head user group: An empirical study by movielens and imdb</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>39</volume>
          (
          <issue>4</issue>
          ) (
          <year>March 2012</year>
          )
          <volume>4049</volume>
          {
          <fpage>4054</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Carolis</surname>
            ,
            <given-names>B.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pizzutilo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Providing relevant background information in smart environments</article-title>
          . In: E-Commerce and
          <string-name>
            <given-names>Web</given-names>
            <surname>Technologies</surname>
          </string-name>
          , 10th International Conference, EC-Web
          <year>2009</year>
          .
          <article-title>Proceedings</article-title>
          . Volume
          <volume>5692</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2009</year>
          )
          <volume>360</volume>
          {
          <fpage>371</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Martinez-Palau</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dominguez-Sal</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Larriba-Pey</surname>
            ,
            <given-names>J.L.</given-names>
          </string-name>
          :
          <article-title>Two-way replacement selection</article-title>
          .
          <source>Proc. VLDB Endow</source>
          .
          <volume>3</volume>
          (
          <issue>1</issue>
          -2) (
          <year>September 2010</year>
          )
          <volume>871</volume>
          {
          <fpage>881</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Boratto</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carta</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Modeling the preferences of a group of users detected by clustering: A group recommendation case-study</article-title>
          .
          <source>In: Proceedings of the 4th International Conference on Web Intelligence</source>
          ,
          <article-title>Mining and Semantics (WIMS14)</article-title>
          .
          <source>WIMS '14</source>
          , New York, NY, USA, ACM (
          <year>2014</year>
          )
          <volume>16</volume>
          :
          <fpage>1</fpage>
          {
          <issue>16</issue>
          :
          <fpage>7</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>