<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Not all judgment aggregation should be neutral</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Bergen</institution>
          ,
          <addr-line>Bergen</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Judgment aggregation is concerned with the problem of aggregating individual views on logically related issues. It o ers a general framework in which several di erent types of aggregation problems can be represented and studied. Furthermore, judgment aggregation can be applied to problems that consider together issues that are typically considered as separate aggregation problems. E.g., judgment aggregation can be used to determine group goals and collectively advanced supporting beliefs. While goals can be seen as preferences, typically studied by preference aggregation, beliefs cannot. Neutrality of a judgment aggregation rule is the property of aggregating the views on all issues in the same manner and it is uniformly considered to be a desirable property. This paper defends the position that multi issue type aggregation problems may require non-neutral judgment aggregation rules, and proposes a method for developing such rules.</p>
      </abstract>
      <kwd-group>
        <kwd>Judgment aggregation</kwd>
        <kwd>neutrality</kwd>
        <kwd>preference aggregation</kwd>
        <kwd>merging beliefs and goals</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>A committee of investors is considering whether or not to buy the stock of
company X (proposition ). It is known that company X has launched a new
product. Some consider that a market success of X (proposition '1) and su cient
available committee funds (proposition '2) are reasons to purchase X shares. The
committee thus needs to assign truth values to , '1, and ('1 ^ '2) ! . The
committee is making these decisions around lunch time and they are feeling a bit
peckish. Typically they order pizza, however some are contemplating ordering
burgers instead. They have to yet nd out where to order the burgers from, but
there are really only two options for pizza in town: Napoli and Peppe's. If people
are not worried about spending too much money for lunch (proposition sP v),
then Napoli is far better than Peppe's, at least according to some members'
opinion. After some discussion they realise they that what they have to decide
is: whether pizza is better than burger (proposition pP b), whether Napoli is
indeed better than Peppe's (proposition nP e) and whether (pP b ^ sP v) ! nP e.</p>
      <p>Judgment aggregation is a theory concerned with nding a combination of
consistent collective opinions on logically related issues by aggregating individual
views over those issues. It o ers a general framework in which several di erent
types of aggregation problems can be represented and studied. Judgment
aggregation can be used to solve both the lunch and the investment problems of
the committee. Furthermore, both committee problems have the same
underlying structure. The same judgment aggregation rule can be applied to determine
both whether to invest in X, which is a belief aggregation problem, and whether
to order pizza from Napoli, which is a preference aggregation problem1.</p>
      <p>That same framework abstractness that allows for such versatility of problems
representable in judgment aggregation also allows for more complex problems
to be represented in it as well, problems that consider together issues that are
typically considered as separate aggregation problems. Such framework exibility
can be useful, particularly in multi-agent system's settings.</p>
      <p>
        Self governing cooperating agents would encounter the need to agree on which
beliefs to uphold as a group and which goals to collectively pursue. Beliefs and
goals in uence one another. A rational agent is one that chooses her goals in
accordance to the believes she holds about the world, but also that adjusts
her goals as her beliefs change. If the same consideration is to be extended to
groups of agents, a choice on whether to pursue a goal cannot be made separate
from the decisions on what to believe as a group. Agreements can be reached
by aggregating, or merging, the individual opinions of the agents; in the case
of determining collectively held beliefs and goals, by aggregating the individual
beliefs and goal choices of the agents [
        <xref ref-type="bibr" rid="ref15 ref3">15, 3</xref>
        ]. Judgment aggregation can be used
to concurrently reach agreements regarding goals and beliefs.
      </p>
      <p>
        Judgment aggregation was originally concerned with collective reasoning in
collegiate courts of law [
        <xref ref-type="bibr" rid="ref16 ref17">16, 17</xref>
        ]. It was later shown that the same theory can
be used to represent preference aggregation problems [24]. Further, judgment
aggregation has been considered for the purpose of: identifying collective goals
and collectively supported beliefs [
        <xref ref-type="bibr" rid="ref3">3, 28</xref>
        ], nding collective argument labelings
in argumentation theory [
        <xref ref-type="bibr" rid="ref2 ref4">4, 2</xref>
        ], and most recently also to collective annotate
linguistic resources [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        A judgment aggregation problem is speci ed by an agenda and possibly a set
of constraints. An agenda is the set of, possibly logically related, issues for which
individual judgments are collected and collective judgments are requested. The
issues are typically binary questions to which a positive (yes, true, agree, etc.)
or a negative answer (no, false, disagree, etc) can be given. A judgment is \an
answer" to an issue. The constraints are a set of formulas expressing additional
relations among the agenda issues that must be observed when \answering" the
issues. In the logical framework of judgment aggregation, in line with [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], an
agenda issue is represented in an abstract manner with a pair of propositions
'; :'. A positive \answer" or judgment is represented with ', and a negative
one with :'.
      </p>
      <p>The abstract representation of the judgments and agenda issues induces the
versatility of the judgment aggregation framework. It also allows us to focus
1 Remark that a preference aggregation problem would typically be represented as the
problem of selecting one from the list of options: order pizza from Peppe's, order
pizza from Napoli, order a burger, as speci ed in Section 4.
on the relations between individual and collective judgments and to study the
properties of aggregation functions in an abstract way, with ndings of such
studies extending to all the domains of application. The abstract representation
of the agenda issues is beyond reproach when all the agenda issues have the same
meaning, i.e., are of the same type, for example when they are all beliefs, or all
preferences. However when the agenda contains a mixture of di erent types of
issues, as is the case when judgment aggregation is used to reach an agreement
on a common goal, the \ at" representation is no longer adequate.</p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] it was shown that the representation language of the agenda, in general,
cannot be exploited to circumvent the impossibility results regarding judgment
aggregation rules [24]. This result appears to have ended the interest in the
representation language in judgement aggregation. However, the representation
of the agenda issues is rather the lesser problem, more crucial is that di erent
types of issues would require di erent treatment by the aggregation function,
which is not the case at present.
      </p>
      <p>The property of aggregation functions which stipulates that all issues should
be aggregated in the same fashion is called neutrality. At present, neutrality is
considered desirable to that extent, that non-neutral rules virtually have not been
designed and a precise formulation of the neutrality property has not been given.
When the agenda has the same type of issues, neutrality seems natural to require.
However there are agendas where this is not the case. Consequently, neutrality
should not be considered a de facto desirable condition in judgment aggregation
and non-neutral aggregation methods must be explored. Furthermore, the type of
issues being aggregated must be taken into consideration and desirable properties
of aggregation should be associated with the distinct type.</p>
      <p>This work is structured as follows. In Section 2 we elaborate on di erent types
of issues that can be found in the agendas of various judgment aggregation
problems. In Section 3 we give the de nitions of the main concepts in the judgment
aggregation framework. In Section 4 we discuss the property of neutrality and
other assumed-desirable properties. In Sections 5 one method of non-neutral
aggregation is proposed. In Section 6 we make a summary and outline directions
for future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Types of issues and their aggregation</title>
      <p>
        The representation of issues in the logic framework abstracts from the meaning
of those issues. An issue '; :' that arrises from a preference has the intuitive
reading of \is it the case that you prefer option x to option y". Often special
predicates xP y; :xP y are used, e.g., in [
        <xref ref-type="bibr" rid="ref8">8, 20</xref>
        ], for representing issues that are
preferences, or as in the lunch committee decision example. An issue '; :' that
arises from beliefs has the intuitive reading of \is it the case that you believe
' is true", whereas if that same issue arises from possible agent goals it can be
interpreted both as \should goal ' be pursued" and \do you want to pursue goal
'". An issue '; :' may represent an, at present, unknown or unobservable fact
about the world, e.g., will the project of company X be a market success, thus
having the intuitive reading of \are you of the conviction that ' is true".
      </p>
      <p>In a preference aggregation problem all issues in the corresponding judgment
aggregation agenda are of the same type { preferences. When a jury considers
evidence, all the issues are of the same type { past-observable facts of the world.
However, there is nothing preventing anyone from using judgment aggregation
on problems with agendas that concurrently have di erent types of issues.</p>
      <p>
        In fact, the original judgment aggregation problem, the \doctrinal
paradox"[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], has an agenda in which two types of issues occur: premises and a
conclusion. The agenda in the \doctrinal paradox" consists of three issues. The
premises are: `Is there a contract?', and `Is there an estoppel?'. The
conclusion is the decision on the case { `Does the judge(s) rule for the plainti ?' (or
against). The judges must rule in favour of the plainti when there was both a
contract and an estoppel. The truth of both the issue of the existence of contract
and estoppel are facts of the world (which might not be observable), while the
decision on the case is the (informed) opinion of the judge(s).
      </p>
      <p>It is straightforward to observe that preferences di er from presently
unobservable facts about the world. One agent can prefer pizza over burger (pP b),
and another can prefer burger over pizza (:pP b) but both of these positions can
be held at the same time by di erent agents because one does not invalidate the
other; preferences are matters of subjective views and tastes. One agent might
be convinced that the project of company X will be a market success ( ), while
another might be convinced that the project will be failure (: ). However, only
one of these judgments is correct, and some time after the project's release it
would be known which one. Preferences give rise to subjectively valued
propositions, while unknown facts give rise to objectively valued propositions in the
agenda. The truth-value of subjectively valued propositions exists based solely
on the bias, opinion, emotions, convictions, etc. of the entity that assigns this
value. In contrast, the truth-value of an objectively valued proposition exists
independently of the bias of the entity that assigns the value.</p>
      <p>Regardless of whether the agenda issue is a subjectively or objectively valued
proposition, there may exist only one entity, agent, or source, that is in the unique
position to assign the judgment for this issue. For example, I am the only person
in the position to decide whether for me Napoli pizza is a ordable lunch-food.
My a ordability preference however might be included in an agenda with other
issues that are related but over whose truth-value I do not have full control.
Objectively valued propositions yield even better examples of full control issues.
Consider the owner of the funds that the committee will invest. Whether there
are available funds for investing (if '2 is true or false) can only be decided by
the owner, as he or she fully controls this resource. An issue can also be fully
controlled by a group of agents. For example, Mary and John can together decide
to marry each other, thus determining the judgment on the issue of \Mary and
John are married". Instances of objectively valued fully controlled judgments
can be expected to occur when one agent coordinates with a group of agents, or
a group of agents coordinates with another group.</p>
      <p>The beliefs and goals give rise to di erent types of propositions as well. The
beliefs of the agents represent the current information that the agent has about
the world. The proposition G x denotes the decision of the agent to have his
future state be one in which x holds. We can view the agent's goals as giving
rise to subjective valued propositions, because the truth value of the associated
proposition is the prerogative of the agent. The agent however, may not be able
to guarantee a future in which x holds, as much as a person can not always
guarantee that pizza will be served to them instead of a burger, as per their
preference. Beliefs, on the other hand can be viewed as giving rise to objectively
valued propositions. Although an agent chooses which beliefs to adopt, the aim
of beliefs is to as faithfully as possible represent the state of the world.</p>
      <p>The type of the issues that represent labels of arguments in an argumentation
context and annotations of linguistic resources would depend on the speci c
context in which these issues are created.</p>
      <p>It is not our aim at this section to give an ultimate taxonomy of issue types
that can occur in judgment aggregation but to emphasise that di erent types
do exist and that there is a need for them to be aggregated accordingly. For the
purpose of this article it is su cient to distinguish between objectively valued
and subjectively valued issues, and orthogonally, between fully controlled and
partially controlled issues.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Preliminaries</title>
      <p>We begin by introducing the de nitions of the basic concepts that can be found
in a logical framework of judgment aggregation before discussion the property
of neutrality in greater detail.</p>
      <p>An agenda A is a set of propositions, not necessarily atomic, from a set of
well formed propositions L. This set L is often taken to be the set of well formed
formulas of the (classical) propositional logic. For each ' 2 A it holds that
:' 2 A, and ' is neither tautology nor a contradiction. An agenda issue is a
pair f'; :'g A and a judgment is thus either ' or :', corresponding to taking
the position that the issue in question is true or false respectively2. For example,
the agenda of the investment problem is f ; : ; '1; :'1; ('1 ^ '2) ! ; :(('1 ^
'2) ! )g, while the agenda of the lunch problem is fpP b; :pP b; nP e; :nP e; (pP b^
sP v) ! nP e; :((pP b ^ sP v) ! nP e)g. In addition to the agenda, one can
specify a set of constraints L which constrain further3 the allowed combination
of judgments that can be given for the speci ed agenda.</p>
      <p>A judgment set J is a subset of the agenda that is complete when for each issue
f'; :'g A either ' 2 J or :' 2 J . For example, the opinions of a committee
member that has no monetary concerns, thinks that pizza is preferable to a
burger, and that pizza is better ordered from Peppe's are represented as the
2 A proposition preceded by an odd number of consecutive negations is considered
to be a negated proposition, while a proposition preceded by an even number of
consecutive negations is considered to be a non negated proposition.
3 The agenda issues are typically logically related among each other.
set of judgments fpP b; :((pP b ^ sP v) ! nP e); :nP eg. The judgment set J is
consistent if it is a consistent set and -consistent if J [ is a consistent set.
In the rest of this article we use consistent to denote both consistent and
consistent judgment sets. The set of all non-empty consistent judgment sets for
a speci ed A and is the set D(A; ), while the set of all consistent judgments
sets that are also complete is D(A; ). Clearly D D.</p>
      <p>A pro le of judgments P 2 D(A; )n is a collection of n judgment sets,
each associated with an agent, or source, 1 i n. For convenience, we
use Ji 2 P to denote that Ji is the i'th element of P . The number of all
judgment sets, or agents, in P that contain a particular ' 2 A is NP ('),
NP (') = jfi j ' 2 Ji; and Jiis the ith element of P gj.</p>
      <p>A judgment aggregation rule R, also called an irresolute rule, is a function
of type R : D(A; )n ! 2D(A; ). A judgment aggregation rule maps a pro le
of judgments to a set of complete and consistent judgment sets. A judgment
aggregation function F , also called a resolute rule, is de ned as a function of
type F : D(A; )n ! D(A; ). A resolute rule maps a pro le of judgments to a
single complete and consistent judgment set. The judgment sets in the set R(P )
are called collective judgment sets for P . The elements of a collective judgment
set are called collective judgments.</p>
      <p>
        Typically the impossibility characterisation results, namely studies showing
which properties of aggregation cannot be satis ed at the same time, have been
done for the resolute rules, see for example [24] for an overview. Almost all
speci c proposed judgment aggregation operators are irresolute rules [
        <xref ref-type="bibr" rid="ref10 ref12 ref19 ref5 ref7">25, 19, 26,
5, 10, 7, 12</xref>
        ]. The possibly best known judgment aggregation rule is issue-majority
de ned as m(P ) = f' j ' 2 A; NP (') &gt; 21 g: A pro le P 2 D(A; )n is
majorityconsistent if m(P ) is a consistent set, i.e., m(P ) 2 D(A; ).
      </p>
      <p>The following properties have been de ned for irresolute rules, however the
de nitions extend in a straightforward way to resolute rules as well.</p>
      <p>A judgment aggregation rule R is anonymous if for every P 2 D(A; )n, and
every A and , for every permutation on the order of the judgment sets in P
it holds that R(P ) = R( (P )).</p>
      <p>A judgment aggregation rule R is majority-preserving if for every
majorityconsistent pro le P 2 D(A; )n, and every A and , it holds that
R(P ) = fJ j m(P ) 2 D(A; ) and m(P ) J g. Intuitively, whenever a pro le P
is majority-consistent and m(P ) is a complete judgment set, then a
majoritypreserving function R would select only the m(P ) as a collective judgment set.
For those majority-consistent pro les for which m(P ) is not a complete
judgment set, only all the complete and consistent judgment sets that are supersets
of m(P ) are selected as collective judgment sets.</p>
      <p>Systematicity is one of the rst properties studied, together with anonymity
[23, 24], and de ned for resolute judgment aggregation rules. It is composed of
two properties: neutrality and independence of irrelevant alternatives (IIA). A
judgment aggregation function F satis es IIA if for all all '; 2 A, and all A,
, for every P; P 0 2 D(A; )n, where P = hJ1; : : : Jni and P 0 = hJ10 ; : : : J n0i, if [
' 2 Ji i 2 Ji0], then [' 2 F (P ) i 2 F (P 0)]. Intuitively, a function satis es
IIA if the collective judgment on each issue depends only on the individual
judgments for that issue in the pro le4.</p>
      <p>The neutrality property of a judgment aggregation rule R is informally the
property: the collective judgment on an issue depends only on the number of
positive and negative judgments given for that issue in the pro le.</p>
      <p>
        A version of neutrality called issue-neutrality, has been formally de ned for
resolute rules in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] in the following way. A judgment aggregation function F
is issue-neutral if for all '; 2 A, and all A, , P 2 D(A; )n, where P =
hJ1; : : : Jni, if [for all Ji 2 P , ' 2 Ji i 2 Ji], then [' 2 F (P ) i 2 F (P )].
      </p>
      <p>It is not straightforward to extend issue-neutrality to irresolute rules
because there are several ways to do this, each varying in strength. The strongest
corresponding property can be expressed as in De nition 1.</p>
      <p>De nition 1. An irresolute judgment aggregation rule R is strongly issue-neutral
when for all '; 2 A, and all A, , P 2 D(A; )n, where P = hJ1; : : : Jni, if
[' 2 Ji i 2 Ji, for 1 i n], then [for all J 2 R(P ), ' 2 J i 2 J ].
4</p>
    </sec>
    <sec id="sec-4">
      <title>Desirable properties in judgment aggregation</title>
      <p>
        The initial inspiration for a minimal set of desirable properties in judgment
aggregation was the desirable properties for preference aggregation according to
Arrow [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. A preference aggregation problem is speci ed as follows. Given is a set
of options (or candidates, or alternatives) O a preference pro le is a collection
of n preference orders %i, 1 i n, over O. A preference aggregation function
maps a preference pro le to a preference order over O. A preference aggregation
function is neutral if the options are treated the same, regardless of what the
option is. It is reasonable to expect that all alternatives are treated the same by
the aggregation function.
      </p>
      <p>
        Non-neutral aggregation functions that satisfy IIA are still dictatorial. A
resolute judgment aggregation function F is dictatorial when for every pro le P
the same collective judgment J is selected. Note that in the original formulation
of the framework and the de nition of the judgment aggregation function,
functions were de ned as F (J1; : : : Jn) = J , where J1; : : : ; Jn; J are subsets of the
agenda but not required to be complete nor consistent. Two additional
properties for F have been additionally explicitly de ned: universal domain stipulates
that function F has to be de ned for each possible pro le; collective rationality
stipulates that the collective judgment set J is a consistent and complete set.
The premise based rule [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], that satis es IIA , and is anonymous and neutral,
does not satisfy universal domain.
      </p>
      <p>
        Judgment aggregation irresolute rules that do not satisfy IIA have been
considered [
        <xref ref-type="bibr" rid="ref10 ref12 ref19 ref5 ref7">25, 19, 26, 5, 10, 7, 12</xref>
        ], but all of them consider only the support for a
judgment on an issue and not the issue itself, i.e., they are neutral in the
informal sense. Their neutrality is not explicitly considered, testifying to the universal
understanding of neutrality as a desirable property for rules beyond discussion.
4 Observe that the co-domain of F(P) is the set of consistent and complete judgment
sets, thus 62 F (P 0) implies : 2 F (P 0)
      </p>
      <p>A property that also appears to be universally accepted as desirable,
possibly also as a legacy from the close connections between judgment aggregation
and preference aggregation, is majority-preservation. A rule that is
majoritypreserving, when applied to a preference aggregation problem represented as a
judgment aggregation problem, produces collective judgment sets that contain
the Condorcet winner when such an alternative exists.</p>
      <p>The motivation for desiring to maximise the number of collective judgments
supported by a majority in the pro le, which is the typical method for
constructing majority-preserving rules, is clear when the agenda issues are preferences.
Since every agent is the ultimate authority on what they want, and since not
everyone can get what they individually want, the aim of the aggregation is to
maximise the satisfaction of as many agents as possible. However, if the issues
are objectively valued, it does not matter how many agents are \happy" with
the collective judgments. What matters is to increase the likelihood that the
issues' objective truth-values coincide with the assigned collective judgments.</p>
      <p>
        The Condorcet jury theorem [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] states that if the agents are more likely than
not to individually nd the correct valuation for a proposition, than the valuation
supported by the majority is most likely to be correct. However the propositions
in question are independent, whereas the issues in an agenda are logically related
[22]. When the conditions of the Condorcet jury theorem do not apply, it is no
longer clear why a judgment aggregation rule should be majority-preserving.
Furthermore, in the case of an agenda with objectively valued issues, rational
agents can be expected to be more \satis ed", or have an increase in utility,
with the increase of the likelihood of truth of the collective judgments, not with
the increase of their likelihood to their own opinions. In conclusion,
majoritypreservation can be clearly seen as desirable only in the case of subjectively
valued propositions.
      </p>
      <p>Lastly let us brie y concern ourself with the desirability of the anonymity
property. Clearly, when there is no way of establishing the relevance or reliability
of a judgment's source, it is prudent to seek anonymous judgment aggregation
rules. However, when the value of an agenda issue is fully controlled by some,
this agent, or these agents, should have veto over the issues they control. To
aggregate an agenda that consists both of fully controlled issues and partially
controlled issues, one needs a rule that is non-neutral and non-anonymous with
respect to the fully controlled issues.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Sequential judgment aggregation</title>
      <p>Having argued that a judgment aggregation rule should only be neutral if the
agenda issues are type-homogenous, we need to consider methods for
constructing non-neutral judgment aggregation rules. A judgment aggregation rule that
satis es IIA can be easily made non-neutral: since each issue is aggregated
separately, one simply needs to use di erent, type-adequate, rules, to aggregate every
issue. However, since IIA rules will necessarily violate either universal domain
or anonymity, using a IIA rule may not be possible.</p>
      <p>
        One option to treat issues di erently is to apply, possibly di erent,
judgment aggregation rules sequentially to the pro le. This method is what is used
when the premise based rule [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] is applied, and also in the complete conclusion
based procedure of [27]. The method of [27], applicable to agendas that are split
into premises and conclusions, is to use a resolute judgement aggregation rule
to one issue of the agenda, the conclusion issue, and add the resulting collective
judgment to the constraints before aggregating the full agenda with an irresolute
rule. An extreme example of a sequential rule is the one considered in [21], where
each issue is aggregated one by one. A similar approach can be used to
aggregate pro les for mixed issue type agendas: to aggregate the agenda sequentially
in several steps, at least one for each di erent type of issue. Thus, all of the
completely controlled issues would form one issue type, that can possibly be
further divided to a subset of objectively valued issues and a subset of subjectively
valued issues.
      </p>
      <p>In [27], issue-majority over one issue and in the context of an odd number
of agents, which is a resolute, is used as the rst step. In general a resolute
rule might not be available, meaning that several collective judgment sets might
be the result of a rst aggregation step. Since the collective judgments from
di erent collective judgment sets can be mutually inconsistent, they cannot all
be included in the constraints of the next step. There are several options on how
to select the constraints. For example, one can: a) add the disjunction of the
collective judgment sets; b) add the intersection of the collective judgment set;
c) select one of the collective judgment sets using a tie-breaking mechanism; etc.</p>
      <p>The de nitions of the logic framework now need to be extended.
De nition 2.</p>
      <p>Partial agendas.An agenda A is partitioned into k partitions when
A = Ap1 [ Ap2 [ [ Apk , and all the partitions Ap1 ; Ap2 ; ; Apk are
mutually disjoint. Given an aggregation order, namely some permutation of
the partitions of the agenda (hAp1 ; : : : ; Apk i), the step agendas are obtained
as A1 = (Ap1 ), A2 = (Ap2 ) [ A1, . . . , Ak = (Apk ) [ Ak 1 = A.
Partial pro le. A partial pro le Pi, 1 i k for pro le P =&lt; J1; : : : ; Jn &gt;
of the agenda Ai is de ned as Pi = hJ1 \ Ai; : : : ; Jn \ Aii.</p>
      <p>Collective selector. A collective selector function &amp; : 2D(A; ) ! 2L maps a
set of collective judgment sets into a consistent set of formulas. It holds that
&amp;(R(P )) = S, S 2L, S 2 ? and if R(P ) = J , then &amp;(R(P )) = J .
Partial aggregator. A partial aggregator function Ri; i : D(Ai; )n !
2D(Ai; i), where ; i 2 L, 1 i k are consistent and mutually consistent
constraints, is an irresolute judgement aggregation rule that aggregates a
pro le of judgment sets consistent with respect to a set of constraints into
a set of judgment sets consistent with respect to the set of constraints i.
Partial constraints. An aggregation constraint at step i, 1 i k, is
i , such that 1 = , and i = &amp;(Ri 1; i 1 (Pi 1)) [ i 1.</p>
      <p>Sequential judgment aggregation rule. Given a k-partitioned agenda A,
and an aggregation order , a judgment aggregation rule R is sequential when
R(P ) = Rk; k (P ), and Ri; i (Pi), for 1 i
1 = , and i = &amp;(Ri 1; i 1(Pi 1)) [ i 1.
k, is recursively de ned as:</p>
      <p>Some clarifying observations are due before an illustrative example. The
sequential judgment aggregation rule is not neutral even when all partial
aggregators used are the same functions, because the issues at each step are considered
under di erent constraints.</p>
      <p>The collective selector selects R(P ) i R(P ) is a singleton and employs some
selection method when R(P ) is not a singleton, such as the disjunction of all the
judgment sets produced by R(P ), their intersection, etc.</p>
      <p>At the rst step of aggregation, all the judgment sets in the partial pro le are
consistent with the aggregation constraint . At each subsequent step, is made
stronger, namely more selective, by the outcome of the previous aggregation
step. The partial judgment sets in the subsequent partial pro les may not be
consistent with the new constraints t, but the result of the aggregation must
be. Since at each step the constraints are obtained by adding the results of the
aggregation in the previous constraints, it is not possible, at any point for t to
be inconsistent with t+1. In the last step, the full pro le A is aggregated with
the strongest constraint k.</p>
      <p>
        The judgment aggregation functions so far de ned are not from the desired
type as partial aggregator function Rt since they require that the same constraint
be imposed both on the judgment sets in the pro le and on the collective
judgment sets obtained by aggregation. However, the aggregation rules from [
        <xref ref-type="bibr" rid="ref10 ref19 ref7">19,
10, 7</xref>
        ], can be extended in a straightforward fashion, into partial aggregators.
      </p>
      <p>Consider for example the M CSA from[20], also known as the Slater rule for
judgments, de ned as M CSA (P ) = MaxCardCons(m(P ); ), where
MaxCardCons(m(P ); )) denotes the maximum cardinality set of -consistent
subsets of m(P ). The M CSAi; i partial aggregator can be de ned as
M CSAi; i (Pi) = MaxCardCons(m(Pi); i). Another example is the M W A
from [20], also known as the median rule, de ned as
M W A (P ) = argmax WP (J ); where WP (J ) = P NP ': The M W Ai; i
par</p>
      <p>J2D(A; ) '2J
tial aggregator can be de ned as M W Ai; i (Pi) =
argmax WP (J ); where
J2D(Ai; i)
WP (J ) = P'2J NPi ':
Example 1. Let A = Ap1 [ Ap2 [ Ap3 , with Ap1 = fp; :p; q:q; g , Ap2 = fr; :rg,
and Ap3 = fs; :sg. Let = f(p ^ q) $ r; r ! sg. Consider the pro le given in
Table 1. Assume we aggregate rst A1 = Ap2 using the issue-majority rule, then
A2 = Ap1 [ A1 using M CSA2; 2 and last A3 = A using the M W A3; 3 . Let the
selector function be &amp;(Ri(Pi)) = W Ri(Pi), 1 i 3. The collective judgments
of, and constraints applied in, each aggregation step are also given in in Table 1.</p>
      <p>The agenda can be split into as many partitions as there are issue types,
with the issues in one partition being all of the same type. The question is then
which type of issues should be given precedence in the order of aggregation. It
is questionable whether a uniform rule for type order in sequential aggregation
can be established in this regard.</p>
      <p>Constraints
J1 =
J2 =</p>
      <p>J3 =
m(P1) =
M CSA2; 2 (P2) = ff p,
M W A3; 3 (P ) =</p>
      <p>Ap1 Ap2 Ap3
fp, :p, q; :q r, :r, s, :sg = f(p ^ q) $ r; r ! sg
fp q r sg
fp :q :r sg
f:p q :r :sg
f:rg 1 =
:rg; 2 = 1 [ f:rg
f q, :rgg 2 = 1 [ f:rg
ffp, :q, :r; sg, 3 = 2 [ f(:p ^ q ^ :r) _ (p ^ :q ^ :r)g
f:p, q, :r; sgg 3 = 2 [ f(:p ^ q ^ :r) _ (p ^ :q ^ :r)g
Table 1. An example of sequential aggregation.</p>
      <p>It can be consistently assumed that the assigned values of the fully controlled
issues, by their respective controllers, are mutually consistent. If these judgments
are not mutually consistent, then either they are not really fully controlled,
or there is a problem with setting the agenda. This assumption also imposes
that the rst aggregation step is allowing each of the controllers to establish
the judgments for these issues, regardless of whether they are objectively, or
subjectively valued, and adding these judgments to the aggregation constraints,
forming the constraints for the next step. The partially controlled judgments can
be considered in two separate agenda partitions with respect to whether they
are subjectively or objectively valued. It is less clear how to aggregate the latter.</p>
      <p>On one hand, a rational group of agents would be expected to base its
decisions on what to desire based on what it determines is most likely to be the true
state of the world. Thus the decisions on which goals should be pursued, should
be made after making the decisions on what beliefs to support as a collective.
This would imply that the subjectively valued issues should be aggregate after
the objectively valued ones. However, an agent might choose what to adopt as
the true state of the world based on what goals it has chosen to proceed,
particularly if the nature of the objectively valued issues is such that their truthfulness
cannot be expected to be established in the forceable future. Consider a family
considering to join a religious denomination. It is unforeseeable when it would
be established whether god X exists or not, however this can still be considered
an objectively valued issue. The members of the congregation of believers in
X are o ered free housing. The family might rst decide to pursue the goal of
obtaining free housing and then decide that god X exits.</p>
      <p>In conclusion, the decision of order of aggregation should be further speci ed
by a more detailed consideration of the context of the aggregation problem.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Summary and Future work</title>
      <p>The judgment aggregation framework is su ciently abstract to allow a variety of
aggregation problems to be represented as judgment aggregation problem. Thus
studying the properties of judgment aggregation we obtain results that extend
to all related aggregation problems. However, what the literature has failed to
observe, or at least visibly emphasise, is that the abstractness of the framework
also allows for more complex aggregation problems to be represented as well.
The goal of this paper is to put a spotlight on this issue and advocate for more
research attention to be directed towards aggregating for agendas that contain
more than one type of issues.</p>
      <p>A judgment aggregation rule is neutral if all the agenda issues are given
equal treatment when aggregated. Neutrality has been uniformly accepted as a
desirable property for rules, however this desirability is unfounded in the case of
complex agendas. There are several issues that need to be pursued when
developing non-neutral rules. Primarily, there exists no formal de nition for neutrality
for irresolute rules, although these are the only type of rules that exists which
are anonymous and satisfy universal domain. One de nition was o ered here,
however there are several approaches that can be taken and the best one, if it
exists, should be established. Although some discussion is included here
regarding the type of issues that can be considered in an agenda, the presented issue
taxonomy is neither exhaustive nor precise, and needs to be improved in these
regards. Further, adequate aggregation properties need to be associated for each
issue types. For instance, majority-preserving rules are desirable for subjectively
valued, but maybe not for objectively valued issues.</p>
      <p>The here-de ned sequential judgment aggregation rules and framework allow
for neutral rules to be used in combination that yields non-neutral aggregation.
However, the approach of sequential judgment aggregation opens its own set of
unexplored problems. One is the issue of the selector function that determines the
formation of constraints for each aggregation step. Three examples of selectors
are given, but this is not an exhaustive list. The advantages and disadvantages
of each need to be explored. Another big open issue is the question of property
inheritance, for example, if all the partial aggregators satisfy property x is it
the case that the resulting sequential aggregation rule will also satisfy x; which
properties are inherited and which are not, etc. Lastly there possibly are other
methods for non-neutral judgment aggregation beyond the sequential judgment
aggregation rules.</p>
      <p>Acknowledgments. I would like to acknowledge, and express gratitude for, the
insightful discussions with Marc van Zee and Leon van der Torre from the
University of Luxembourg.
20. J. Lang and M. Slavkovik. Judgment aggregation rules and voting rules. In
Proceedings of the 3rd International Conference on Algorithmic Decision Theory
(ADT 2013), volume 8176 of Lecture Notes in Arti cial Intelligence, pages 230{244.</p>
      <p>Springer-Verlag, 2013.
21. C. List. A model of path-dependence in decisions over multiple propositions.
American Political Science Review, 3(98):495 { 513, 2004.
22. C. List. Collective wisdom: Principles and mechanisms. In H. Landemore and
J. Elster, editors, Collective wisdom: a judgment aggregation perspective, chapter 9,
pages 203{229. Cambridge University Press, 2012.
23. C. List and P. Pettit. Aggregating sets of judgments: An impossibility result.</p>
      <p>Economics and Philosophy, 18(01):89{110, 2002.
24. L. List and B. Polak. Introduction to judgment aggregation. Journal of Economic</p>
      <p>Theory, 145(2):441 { 466, 2010.
25. M.K. Miller and D. Osherson. Methods for distance-based judgment aggregation.</p>
      <p>Social Choice and Welfare, 32(4):575{601, 2009.
26. K. Nehring, M. Pivato, and C. Puppe. Condorcet admissibility:
Indeterminacy and path-dependence under majority voting on interconnected decisions.
http://mpra.ub.uni-muenchen.de/32434/, July 2011.
27. G. Pigozzi, M. Slavkovik, and L. van der Torre. A complete conclusion-based
procedure for judgment aggregation. In F. Rossi and A. Tsoukias, editors, Algorithmic
Decision Theory, 1rst International Conference, ADT 2009, Venice, Italy,
October 20-23, 2009. Proceedings, volume 5783 of Lecture Notes in Computer Science,
pages 1{13. Springer, 2009.
28. M. Slavkovik and G. Boella. Recognition-primed group decisions via judgment
aggregation. Synthese, 2012.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>K.</given-names>
            <surname>Arrow</surname>
          </string-name>
          .
          <article-title>Social choice and individual values</article-title>
          .
          <source>Cowles Foundation Monograph Series</source>
          ,
          <year>1963</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>E.</given-names>
            <surname>Awad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Booth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Tohme</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Rahwan.</surname>
          </string-name>
          <article-title>Judgment aggregation in multiagent argumentation</article-title>
          .
          <source>CoRR, abs/1405.6509</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>G.</given-names>
            <surname>Boella</surname>
          </string-name>
          , G. Pigozzi,
          <string-name>
            <given-names>M.</given-names>
            <surname>Slavkovik</surname>
          </string-name>
          , and L. van der Torre.
          <article-title>Group intention is social choice with commitment</article-title>
          . In Marina De Vos, Nicoletta Fornara, Jeremy Pitt, and George Vouros, editors, Coordination, Organizations, Institutions, and
          <article-title>Norms in Agent Systems VI</article-title>
          , volume
          <volume>6541</volume>
          of Lecture Notes in Computer Science, pages
          <volume>152</volume>
          {
          <fpage>171</fpage>
          . Springer Berlin / Heidelberg,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>R.</given-names>
            <surname>Booth</surname>
          </string-name>
          , E. Awad,
          <string-name>
            <surname>and I. Rahwan.</surname>
          </string-name>
          <article-title>Interval methods for judgment aggregation in argumentation</article-title>
          .
          <source>In KR</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>R.</given-names>
            <surname>Camps</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Mora</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Saumell</surname>
          </string-name>
          .
          <article-title>A general method for deciding about logically constrained issues</article-title>
          .
          <source>Annals of Mathematics and Arti cial Intelligence</source>
          ,
          <volume>64</volume>
          (
          <issue>1</issue>
          ):
          <volume>39</volume>
          {
          <fpage>72</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>F.</given-names>
            <surname>Dietrich</surname>
          </string-name>
          .
          <article-title>A generalised model of judgment aggregation</article-title>
          .
          <source>Social Choice and Welfare</source>
          ,
          <volume>28</volume>
          (
          <issue>4</issue>
          ):
          <volume>529</volume>
          {
          <fpage>565</fpage>
          ,
          <year>June 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>F.</given-names>
            <surname>Dietrich</surname>
          </string-name>
          .
          <article-title>Scoring rules for judgment aggregation</article-title>
          .
          <source>Social Choice and Welfare</source>
          , pages
          <volume>1</volume>
          {
          <fpage>39</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>F.</given-names>
            <surname>Dietrich</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>List</surname>
          </string-name>
          .
          <article-title>Arrow's theorem in judgment aggregation</article-title>
          .
          <source>Social Choice and Welfare</source>
          ,
          <volume>29</volume>
          (
          <issue>1</issue>
          ):
          <volume>19</volume>
          {
          <fpage>33</fpage>
          ,
          <year>July 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>F.</given-names>
            <surname>Dietrich</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Mongin</surname>
          </string-name>
          .
          <article-title>The premisse-based approach to judgment aggregation</article-title>
          .
          <source>Journal of Economic Theory</source>
          ,
          <volume>145</volume>
          (
          <issue>2</issue>
          ):
          <volume>562</volume>
          {
          <fpage>582</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>C.</given-names>
            <surname>Duddy</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Piggins</surname>
          </string-name>
          .
          <article-title>A measure of distance between judgment sets</article-title>
          .
          <source>Social Choice and Welfare</source>
          ,
          <volume>39</volume>
          (
          <issue>4</issue>
          ):
          <volume>855</volume>
          {
          <fpage>867</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. U. Endriss and
          <string-name>
            <given-names>R.</given-names>
            <surname>Fernandez</surname>
          </string-name>
          .
          <article-title>Collective annotation of linguistic resources: Basic principles and a formal model</article-title>
          .
          <source>In Proceedings of the 51st Annual</source>
          <article-title>Meeting of the Association for Computational Linguistics (ACL-</article-title>
          <year>2013</year>
          ),
          <year>August 2013</year>
          .
          <article-title>A short version was presented at BNAIC-2013</article-title>
          and is available at http://www.illc.uva.nl/ ulle/pubs/ les/EndrissFernandezBNAIC2013.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>P.</given-names>
            <surname>Everaere</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Konieczny</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Marquis</surname>
          </string-name>
          .
          <article-title>Counting votes for aggregating judgments</article-title>
          .
          <source>In Thirteenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS'14)</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. U. Grandi and
          <string-name>
            <given-names>U.</given-names>
            <surname>Endriss</surname>
          </string-name>
          .
          <article-title>Lifting integrity constraints in binary aggregation</article-title>
          .
          <source>Arti cial Intelligence</source>
          ,
          <volume>199</volume>
          {
          <fpage>200</fpage>
          :
          <fpage>45</fpage>
          {
          <fpage>66</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>B.</given-names>
            <surname>Grofman</surname>
          </string-name>
          , G. Owen, and
          <string-name>
            <given-names>S.L.</given-names>
            <surname>Feld</surname>
          </string-name>
          .
          <article-title>Thirteen theorems in search of the truth</article-title>
          .
          <source>Theory and Decision</source>
          ,
          <volume>15</volume>
          (
          <issue>3</issue>
          ):
          <volume>261</volume>
          {
          <fpage>278</fpage>
          ,
          <year>1983</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>S.</given-names>
            <surname>Konieczny</surname>
          </string-name>
          and
          <string-name>
            <given-names>R. Pino</given-names>
            <surname>Perez</surname>
          </string-name>
          .
          <article-title>Propositional belief base merging or how to merge beliefs/goals coming from several sources and some links with social choice theory</article-title>
          .
          <source>European Journal of Operational Research</source>
          ,
          <volume>160</volume>
          (
          <issue>3</issue>
          ):
          <volume>785</volume>
          {
          <fpage>802</fpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>L.A.</given-names>
            <surname>Kornhauser</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.G.</given-names>
            <surname>Sager.</surname>
          </string-name>
          <article-title>Unpacking the court</article-title>
          .
          <source>Yale Law Journal</source>
          ,
          <volume>96</volume>
          :
          <fpage>82</fpage>
          {
          <fpage>117</fpage>
          ,
          <year>1986</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>L.A.</given-names>
            <surname>Kornhauser</surname>
          </string-name>
          and
          <string-name>
            <surname>L.G. Sager.</surname>
          </string-name>
          <article-title>The one and the many: Adjudication in collegial courts</article-title>
          .
          <source>California Law Review</source>
          ,
          <volume>81</volume>
          :1{
          <fpage>51</fpage>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Lewis</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kornhauser</surname>
          </string-name>
          .
          <article-title>Modeling collegial courts. ii. legal doctrine</article-title>
          .
          <source>Journal of Law</source>
          , Economics, &amp; Organization,
          <volume>8</volume>
          (
          <issue>3</issue>
          ):pp.
          <volume>441</volume>
          {
          <issue>470</issue>
          ,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>J. Lang</surname>
            , G. Pigozzi,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Slavkovik</surname>
            , and
            <given-names>L. van der Torre.</given-names>
          </string-name>
          <article-title>Judgment aggregation rules based on minimization</article-title>
          .
          <source>In Theoretical Aspects of Rationality and Knowledge</source>
          ,
          <source>TARK'11</source>
          , pages
          <fpage>238</fpage>
          {
          <fpage>246</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>