<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Group Preferences in Social Network Services</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Florian Wenzel</string-name>
          <email>wenzel@informatik.uni-augsburg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Werner Kießling</string-name>
          <email>kiessling@informatik.uni-augsburg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute for Computer Science, University of Augsburg</institution>
          ,
          <addr-line>86135 Augsburg</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2010</year>
      </pub-date>
      <abstract>
        <p>With the beginning of the new millenium, the concept of group interactions in communication systems was boosted by the emergence of Web 2.0 technologies. Based on this new area of application, the notion of group decisions and group preferences also evolved, leading to new requirements for corresponding modeling frameworks. Purely numeric approaches are barely able to meet these newly emerging challenges. Therefore, we provide a comprehensive group preference framework to overcome the deficits of previous solutions and demonstrate possible applications in social network services. The concept provides both numeric and semantic means which can be applied to determine group preferences and to perform further evaluations based on the semantic value of preference terms. With Preference SQL a powerful system exists to implement the presented group preference model using standard commercial databases.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        With the beginning of the new millenium, the concept of
group interactions in communication systems was boosted
by the emergence of Web 2.0 technologies. From social
networking sites to e-commerce platforms, communities have
been established allowing users to provide recommendations
for products or to share common interests. Consequently,
the next step in this development is to combine these
single user valuations into consensus decisions for a group.
Lately, a new method has been introduced to combine
single user ratings into a common group recommendation [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
In the field of operations research, determining a group
decision among alternatives with multiple attributes is also a
well-known problem that has been investigated for decades.
Some of these approaches even introduce database-aided
algorithms [
        <xref ref-type="bibr" rid="ref10 ref6">6, 10</xref>
        ]. However, what all these former attempts
have in common is that they approach the topic from a
purely numeric point of view by using utility functions or
ranking techniques [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] for single user opinions and additional
numeric means to express disagreement between users or the
fuzziness of user preferences [
        <xref ref-type="bibr" rid="ref2 ref8">2, 8</xref>
        ].
In the course of this paper we therefore want to introduce
an augmented approach to tackle the problem of group
preferences. The preference framework introduced in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and
extended in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] provides powerful methods to model single
user preferences and to combine the corresponding
preference terms to form a common group preference.
Furthermore, preferences can be interpreted in both a numeric and
even more importantly a semantic fashion. These facts
allow for the introduction of a numeric quality measure for
group preferences and the use of semantics as background
knowledge for heuristics which can be applied to improve
that quality. With Preference SQL, a powerful
databaseaided implementation exists that makes the presented
findings ready to use in specific application contexts.
The remainder of this paper is structured as follows:
section 2 introduces means to model single user preferences
on multiple attributes and describes how these base
preferences can be combined to form complex user preferences.
The essential questions of how user preference terms
influence a common group preference and how user hierarchies
can be introduced into the group are discussed. Section 3
expands into the details of group preference evaluation and
depicts the difference between the numeric and the semantic
meaning of corresponding preference terms. These formal
demonstrations are further illustrated in a use case scenario
staging a fictious social network service for outdoor
enthusiasts in section 4. The implications of the described findings
for future research are highlighted in section 5 followed by
concluding thoughts.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. GROUP PREFERENCE FORMATION</title>
      <p>
        Numeric approaches often determine an implicit utility
function based on previous decisions of a group member in order
to determine group member preferences. This generalization
of past preferences has to be assessed critically since
environmental aspects and moderator variables [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] that vary across
situations are neglected and thus these functions not
necessarily reflect the individual’s intuitive preferences at the
given moment. In contrast, [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ] introduce a hierarchy of
base preference constructors that provide a framework to
express preferences on single attributes. This process can
be seen as an explicit means for a group member to express
opinions on multiple criteria. These base preferences can
further be combined into a complex single user preference
term with the help of constructors that allow to value some
base preferences more than others. Finally, user preference
terms are joined into a single group preference by the same
operators that help to form complex single user preferences.
      </p>
    </sec>
    <sec id="sec-3">
      <title>2.1 Expression of Group Member Preferences</title>
      <p>
        A preference P of the kind “I like y more than x” is
formally defined as x &lt;P y. This intuitive definition of
preferences in terms of “better-than” has a natural counterpart
in mathematics, namely strict partial orders. Besides basic
“better-than” preferences, often complex valuations have to
be expressed, which requires the accumulation of base
preferences into more complex ones. This leads to the inductive
construction of preferences P = (A, &lt;P ) with the help of
complex preference constructors. P is accordingly specified
by a preference term wich fixes the attribute names A and
the strict partial order &lt;P . Like base preferences, preference
terms that consist of complex preference constructors also
respresent strict partial orders, therefore laying the
foundation for a preference algebra [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Group members express their preferences on single attributes
which can have either numerical or non-numerical domains.
Numeric preferences include amongst others:
• LOWEST(A): x &lt;P y iff x &gt; y
• HIGHEST(A): x &lt;P y iff x &lt; y
• AROUND(A,z): x &lt;P y iff |x − z| &gt; |y − z|
• SCORE(A,f): x &lt;P y iff f (x) &lt; f (y) for a function f
Non-numerical preferences determine likes or dislikes on
categoric attribute values and are e.g. expressed by:
• POS(A, pos): x &lt;P y iff x 6∈ pos ∧ y ∈ pos, with pos
being a set of preferred values
• NEG(A,neg): x &lt;P y iff y 6∈ neg ∧ x ∈ neg, with neg
being a set of disliked values
Each group member specifies base preferences on some or
all attributes A1, . . . , An of a relation R. These base
preferences are afterwards combined using complex preference
constructors such as:
• Pareto P1 ⊗ P2: equal importance of preferences P1
and P2
• Prioritization P1&amp;P2: preference P1 is more important
than P2
The Pareto constructor stands for equal importance of
participating preferences. In contrast, a prioritization
constructor expresses a favor for the preference provided as first
attribute. Only if two tuples are equally important concerning
the first preference then the second preference is used for
further discrimination.</p>
      <p>As a result of this first step towards a common group
preference, a complex preference term for each group member in
preference algebra is formed. In a second step, these terms
T1, . . . , Tk of k single members are combined into a single
group preference.</p>
    </sec>
    <sec id="sec-4">
      <title>2.2 Formation of a Group Preference Term</title>
      <p>Given k single user preference terms T1, . . . , Tk there are
multiple ways to form a group preference by using the
complex preference constructors described before. A group
hierarchy can be introduced by the use of Pareto and
prioritization constructors. A flat hierarchy in which all group
members are of equal value is defined by a group preference</p>
      <p>Pgroup = T1 ⊗ . . . ⊗ Tk.</p>
      <p>Accordingly, some group members can be marked as more
important than others by the use of the prioritization
constructor, e.g.</p>
      <p>Pgroup = T1&amp;T2&amp; . . . &amp;Tk.</p>
      <p>In this case, group member one is more important than
group member two who is more important than group
member three and so forth.</p>
      <p>Most likely, these two possibilities are combined to form an
individual group hierarchy, e.g.
(1)
(2)
Pgroup = T1&amp;(T2 ⊗ . . . ⊗ Tk).
(3)
Especially hierarchy patterns depicted in equations 1 and 3
frequently occur, with the first equation describing a group
with no hierarchy and the third equation a group with one
leader amongst otherwise equal members. However,
virtually all combinations of single user terms are possible, e.g.</p>
      <p>Pgroup = T1&amp;(T2 ⊗ T3 ⊗ Tk−2&amp;(Tk−1 ⊗ Tk)).
(4)
Equivalent to single users preferences, group preferences can
be transformed to statements in Preference SQL for further
evaluation.</p>
    </sec>
    <sec id="sec-5">
      <title>2.3 Implementation with PSQL</title>
      <p>The Preference SQL (PSQL) system implements the SQL 92
standard and additionally supports a PREFERRING clause
which allows the expression of soft constraints. Hence, it
provides a powerful means to implement group preferences
in present database systems. A user preference term in
preference algebra can be transformed into an equivalent PSQL
statement which is evaluated by PSQL. The result of such a
preference query for preference P on relation R is denoted
as σ[P ](R). Preference queries are evaluated according to
a Best-Matches-Only strategy (BMO) which means that a
perfect match is returned if such tuples exist and otherwise
the best matches are retrieved but nothing worse. This
proceeding behaves contrary to conventional SQL queries which
determine only exact matches. As a consequence,
preference queries represent soft constraints that should be
fulfilled while SQL queries are interpreted as hard constraints
that have to be matched without exception. A PSQL
statement is similar to a SQL statement, with the distinctive
feature of an additional PREFERRING clause:</p>
      <sec id="sec-5-1">
        <title>SELECT &lt;attributes&gt; FROM &lt;table reference&gt;</title>
      </sec>
      <sec id="sec-5-2">
        <title>WHERE &lt;hard constraints&gt;</title>
      </sec>
      <sec id="sec-5-3">
        <title>PREFERRRING &lt;soft constraints&gt;</title>
        <p>Within the PREFERRING clause, POS preferences are
indicated by the keyword IN followed by the set of preferred
values while NEG preferences are indicated by NOT IN and
group preference contains more than just the aggregation of
single user preferences P∪ = σ[PU1 ](R) ∪ σ[PU2 ](R) or the
intersection P∩ = σ[PU1 ](R) ∩ σ[PU2 ](R). Instead,
compromises are found such as the tour with id=4.</p>
        <sec id="sec-5-3-1">
          <title>Example 2:</title>
          <p>This effect becomes even more obvious if no perfect matches
exist for single users:
(5)
• PU1 = P OS(dif, {easy}) ⊗ P OS(lsc, {sparse})
• PU2 = N EG(dif, {hard}) ⊗ N EG(lsc, {nice}
the set of unliked values. AROUND and BETWEEN
preferences are obviously stated by the corresponding keywords
AROUND and BETWEEN in combination with a numeric
value or interval. Finally, the Pareto constructor is described
by the keyword AND while PRIOR TO stands for a
prioritization.</p>
          <p>
            While an extended documentation of the PSQL syntax can
be found in [
            <xref ref-type="bibr" rid="ref5">5</xref>
            ], the following example depicts a user
preference on a relation R and the equivalent PSQL statement:
PU1 =(P OS(A1, {dif }) ⊗ N EG(A2, {lsc}))&amp;
          </p>
          <p>
            (AROU N D(A3, 5) ⊗ BET W EEN (A4, [
            <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
            ]))
          </p>
        </sec>
      </sec>
      <sec id="sec-5-4">
        <title>SELECT * FROM R</title>
      </sec>
      <sec id="sec-5-5">
        <title>PREFERRING (A1 IN (’dif ’)</title>
        <p>AND A2 NOT IN (’lsc’))</p>
      </sec>
      <sec id="sec-5-6">
        <title>PRIOR TO ( A3 AROUND 5</title>
      </sec>
      <sec id="sec-5-7">
        <title>AND A4 BETWEEN 2 AND 3)</title>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>3. GROUP PREFERENCE EVALUATION</title>
      <p>Once a group preference is formed and the corresponding
PSQL statement determined, a PSQL query returns the
BMO set for the specified group preference. This result
represents more than just the intersection of single user
preferences as the following two examples based on tuples
representing hiking tours illustrate:
id
1
2
3
4
5
dif
easy
medium
hard
easy
medium
lsc
nice
sparse
neutral
special
special</p>
      <sec id="sec-6-1">
        <title>Example 1:</title>
        <p>Based on the tuples depicted in Table 1, users U1 and U2
state the following preferences on attributes difficulty (dif )
and landscape (lsc):
• PU1 = P OS(dif, {easy}) ⊗ P OS(lsc, {nice})
• PU2 = P OS(dif, {medium} ⊗ P OS(lsc, {special})
In this example it can easily be seen that user U1 favors
the tuple with id=1 while U2 prefers the tuple with id=5.
The result σ[PU1 ⊗ PU2 ](R) of the common group preference
Pgroup = PU1 ⊗ PU2 is depicted in Table 2.</p>
        <p>id
1
4
5
dif
easy
easy
medium
lsc
nice
special
special
Based on the results of single user preferences σ[PU1 ](R) for
user U1 and σ[PU2 ](R) for U2 this evaluation shows that the
In this case, no perfect match exists in R for both U1 and
U2. The corresponding BMO sets for U1 and U2 are listed
in Tables 3 and 4.
Eventually, Table 5 shows the result σ[PU1 ⊗ PU2 ](R) of the
combined group preference Pgroup = PU1 ⊗ PU2 for U1 and
U2 which in this case is the intersection between the two
single user preferences. However, example 1 already showed
that this is not the case in general.</p>
        <p>id
2
4</p>
        <p>dif
medium
easy</p>
        <p>lsc
sparse
special
The two examples illustrate the behavior of group
preferences consisting solely of base preferences and Pareto
constructors. Correspondingly, the same results can be shown
for group preferences using prioritization constructors and
group terms consisting of a mixture of complex Pareto and
prioritization preference terms. Furthermore, different
preferences on the same attribute have been treated equally with
respect to any other preference constellation in this
evaluation. Considering the fact that semantically opposite
preferences on the same attribute stated by different members
of a group might end up in a common group preference, it
becomes obvious that an approach disregarding preference
semantics would produce poor group preference results. The
concluding outlook therefore outlines how the special
semantics of these pairings can be used as indicator for the
formation of subgroups.</p>
        <p>To illustrate the presented findings, a use case scenario is
evaluated in the following section.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>4. A SOCIAL NETWORK SERVICE FOR</title>
    </sec>
    <sec id="sec-8">
      <title>OUTDOOR ACTIVITIES</title>
      <p>The formal foundations of previous sections are now all put
to action in a fictionary social network service. In this
scenario, a website offers a database of tours for various outdoor
activities in which a user can find suitable entries by
specifying desired tour features in a predefined search overview.
Furthermore, a community exists in which every user keeps a
profile. This profile can be used to store search results and
to create personal tour entries which can be shared with
other members of the community.</p>
      <p>This pre-existing service is now augmented by the
introduction of preferences into the search process. A user states
preferences directly in the personal profile of the community.
This process doesn’t have to be performed repeatedly and
can be assisted by suitable GUI components for each
preference, such as sliders for AROUND preferences or checkbox
groups for POS or NEG preferences. These preferences are
then transformed into equivalent PSQL statements on a
relation containing the tour entries. Considering a user U1
and four tour attributes named difficulty, distance, duration
and landscape in a relation called hiking, a preference for a
distance close to 50 km, an easy difficulty level, a duration
between five and six hours and a dislike for sparse landscapes
can be expressed by the following PSQL statement:</p>
      <sec id="sec-8-1">
        <title>SELECT * FROM hiking</title>
      </sec>
      <sec id="sec-8-2">
        <title>PREFERRING (dist ARROUND 50)</title>
      </sec>
      <sec id="sec-8-3">
        <title>AND dif IN (’easy’)</title>
      </sec>
      <sec id="sec-8-4">
        <title>AND (dur BETWEEN 5 AND 6)</title>
      </sec>
      <sec id="sec-8-5">
        <title>AND lsc NOT IN (’sparse’);</title>
        <p>This statement can be used any time the user whishes a
tour suggestion and can be extended by hard constraints to
restrict potential candidates to specific locations. In this
case, if the relation also contains an attribute region, a
corresponding request with restriction to tours in Franconia
would be:</p>
      </sec>
      <sec id="sec-8-6">
        <title>SELECT * FROM hiking</title>
        <p>WHERE region = ’franconia’</p>
      </sec>
      <sec id="sec-8-7">
        <title>PREFERRING (dist ARROUND 50)</title>
      </sec>
      <sec id="sec-8-8">
        <title>AND dif IN (’easy’)</title>
      </sec>
      <sec id="sec-8-9">
        <title>AND (dur BETWEEN 5 AND 6)</title>
      </sec>
      <sec id="sec-8-10">
        <title>AND lsc NOT IN (’sparse’);</title>
        <p>This example of applying single user preferences in
individualized search processes clearly highlights the advantages of
preferences in contrast to conventional approaches via search
masks and SQL. Using the conventional approach, the user
has to state the same search criteria over and over again,
even if user preferences remain constant. With the
preference approach, preferences statements are only changed if
the user preferences indeed evolve. Furthermore, PSQL
results deliver BMO set which means that empty result and
flooding effects are avoided. Conventional approaches, in
contrast, show no result tolerance and thus don’t list tours
that have distances of 52 or 49 kilometers if a distance of
50 kilometers is specified in the search statement. In this
case, the user is required to frequently reformulate search
requests to obtain suitable results.</p>
        <p>Now consider the group function that is common to most
social networking websites which allows users to join groups
based on common interests. In this case, preferences provide
a major improvement for the social network service. Once a
user joins a group, e.g. the group representing the local
hiking club, common group activities can be organized based
on single user preferences. Considering PSQL conform
preference terms T1, . . . , Tk for k group members, a common
PSQL query is constructed as follows:</p>
      </sec>
      <sec id="sec-8-11">
        <title>SELECT * FROM hiking</title>
      </sec>
      <sec id="sec-8-12">
        <title>PREFERRING (T1 AND . . . AND Tk);</title>
        <p>This presented statement reflects a flat group hierarchy.
Furthermore, a group administrator might know of further
restrictions that have to be imposed onto the group decision,
e.g. limitations for the difficulty of the tour. These
preference hierarchies can be integrated seamlessly:</p>
      </sec>
      <sec id="sec-8-13">
        <title>SELECT * FROM hiking</title>
      </sec>
      <sec id="sec-8-14">
        <title>PREFERRING dif IN (’easy’)</title>
      </sec>
      <sec id="sec-8-15">
        <title>PRIOR TO (T1 AND . . . AND Tk);</title>
        <p>Finally, administrators may form subgroups by the
definition of critical attribute values, e.g. to define a beginner and
an advanced hiking group:</p>
      </sec>
      <sec id="sec-8-16">
        <title>SELECT * FROM hiking</title>
      </sec>
      <sec id="sec-8-17">
        <title>PREFERRING dif IN (’easy’)</title>
      </sec>
      <sec id="sec-8-18">
        <title>PRIOR TO (T1 AND . . . AND Tk);</title>
      </sec>
      <sec id="sec-8-19">
        <title>SELECT * FROM hiking</title>
      </sec>
      <sec id="sec-8-20">
        <title>PREFERRING dif NOT in (’easy’)</title>
      </sec>
      <sec id="sec-8-21">
        <title>PRIOR TO (T1 AND . . . AND Tk);</title>
        <p>After these groups are determined, single users have to be
assigned to groups based on a quality metric that determines
how good the user fits into a particular group.</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>5. SUMMARY AND OUTLOOK</title>
      <p>Despite past activities of various disciplines in the
exploration of group decisions, newly emerged areas of
application demand an extended framework to model the complex
process of group preference determination. This procedure
of merging single user preferences into a group preference
consequently raises the question of how well this group
consensus represents the notion of every single group member.
In contrast to group decision support systems which are
constructed to force a consensus among members, social
network services act upon the maxime that connections are
formed freely by users who share common interests. While
this assumption is certainly true with regard to some
aspects, interests might yet differ in other parts of a specific
domain. In the use case described in section 4, users built
groups based on a common interest in outdoor activities or
the membership in a hiking club. Nevertheless, essential
differences might occur based on diverse ability levels, e.g. in
terms of preferred tour difficulty. In these cases it might be
more fortunate to form multiple subgroups instead of
impose a single group on all members.</p>
      <p>The presented preference framework provides various new
insights to approach this problem. Preferences can be used
to define a quality measure which in turn determines the
homogeneity of a group by measuring the quality of its group
preference. In case the measure is below a certain
threshold, the semantics of preferences further allow to detect
certain phenomena that lead to a heterogeneous outcome. This
analysis finally delivers starting-points for the formation of
subgroups.</p>
      <p>Being able to explicitly state preferences in a community
profile certainly is an additional benefit of the presented
approach, however, it requires an extension of already installed
social network services. For present networking sites a
preference mining subservice might be of special interest that
generates base preferences out of pre-existing text blocks.
The presented approach provides a set of means which
extend the possibilities of modeling group preference far
beyond the status quo of numeric techniques and points out
starting-points for new research efforts. The introduction
of semantics into the group preference model provides an
additional layer that can be used as background knowledge
for informed heuristics. Most recent projects at the
University of Augsburg include the definition of quality metrics for
group preferences and the development of heuristics to
improve that group quality dynamically. Future publications
will address some of these newly emerged aspects in detail.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Amer-Yahia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. B.</given-names>
            <surname>Roy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Chawla</surname>
          </string-name>
          , G. Das, and
          <string-name>
            <given-names>C.</given-names>
            <surname>Yu</surname>
          </string-name>
          . Group Recommendation:
          <article-title>Semantics and Efficiency</article-title>
          . PVLDB,
          <volume>2</volume>
          (
          <issue>1</issue>
          ):
          <fpage>754</fpage>
          -
          <lpage>765</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>H.-M. Hsu</surname>
          </string-name>
          and C.-T. Chen.
          <article-title>Aggregation of fuzzy opinions under group decision making</article-title>
          .
          <source>Fuzzy Sets and Systems</source>
          ,
          <volume>79</volume>
          (
          <issue>3</issue>
          ):
          <fpage>279</fpage>
          -
          <lpage>285</lpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>W.</given-names>
            <surname>Kießling</surname>
          </string-name>
          .
          <article-title>Foundations of Preferences in Database Systems</article-title>
          .
          <source>In VLDB '02: Proceedings of the 28th international conference on Very Large Data Bases, Hong Kong, China</source>
          , pages
          <fpage>311</fpage>
          -
          <lpage>322</lpage>
          . Morgan Kaufmann,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>W.</given-names>
            <surname>Kießling</surname>
          </string-name>
          .
          <article-title>Preference Queries with SV-Semantics</article-title>
          . In J. R. Haritsa and T. M. Vijayaraman, editors,
          <source>COMAD '05: Advances in Data Management</source>
          <year>2005</year>
          ,
          <source>Proceedings of the 11th International Conference on Management of Data</source>
          , Goa, India, pages
          <fpage>15</fpage>
          -
          <lpage>26</lpage>
          . Computer Society of India,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>W.</given-names>
            <surname>Kießling</surname>
          </string-name>
          and
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Ko¨stler</article-title>
          .
          <source>Preference SQL - Design</source>
          , Implementation, Experiences.
          <source>In VLDB '02: Proceedings of the 28th international conference on Very Large Data Bases, Hong Kong, China</source>
          , pages
          <fpage>990</fpage>
          -
          <lpage>1001</lpage>
          . Morgan Kaufmann,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Choi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B. S.</given-names>
            <surname>Ahn</surname>
          </string-name>
          .
          <article-title>Interactive group decision process with evolutionary database</article-title>
          .
          <source>Decision Support Systems</source>
          ,
          <volume>23</volume>
          (
          <issue>4</issue>
          ):
          <fpage>333</fpage>
          -
          <lpage>345</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>O. K.</given-names>
            <surname>Ngwenyama</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Bryson</surname>
          </string-name>
          .
          <article-title>Eliciting and mapping qualitative preferences to numeric rankings in group decision making</article-title>
          .
          <source>European Journal of Operational Research</source>
          ,
          <volume>116</volume>
          (
          <issue>3</issue>
          ):
          <fpage>487</fpage>
          -
          <lpage>497</lpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>H.</given-names>
            <surname>Nurmi</surname>
          </string-name>
          .
          <article-title>Approaches to collective decision making with fuzzy preference relations</article-title>
          .
          <source>Fuzzy Sets and Systems</source>
          ,
          <volume>6</volume>
          (
          <issue>3</issue>
          ):
          <fpage>249</fpage>
          -
          <lpage>259</lpage>
          ,
          <year>1981</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>S.</given-names>
            <surname>Sharma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. M.</given-names>
            <surname>Durand</surname>
          </string-name>
          , and
          <string-name>
            <given-names>O.</given-names>
            <surname>Gur-Arie</surname>
          </string-name>
          .
          <article-title>Identification and Analysis of Moderator Variables</article-title>
          .
          <source>Journal of Marketing Research</source>
          ,
          <volume>18</volume>
          (
          <issue>3</issue>
          ):
          <fpage>291</fpage>
          -
          <lpage>300</lpage>
          ,
          <year>1981</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vetschera</surname>
          </string-name>
          .
          <article-title>Integrating databases and preference evaluations in group decision support : A feedback-oriented approach</article-title>
          .
          <source>Decision Support Systems</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ):
          <fpage>67</fpage>
          -
          <lpage>77</lpage>
          ,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>