<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>On Counting Propositional Logic and Wagner's Hierarchy? ??</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Melissa Antonelli</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ugo Dal Lago</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paolo Pistone</string-name>
          <email>paolo.pistone2g@unibo.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Universita di Bologna</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>We introduce and study counting propositional logic, an extension of propositional logic with counting quanti ers. This new kind of quanti cation makes it possible to express that the argument formula is true in a certain portion of all possible interpretations. We show that this logic, beyond admitting a satisfactory proof-theoretical treatment, can be related to computational complexity: the complexity of the underlying decision problem perfectly matches the appropriate level of Wagner's counting hierarchy.</p>
      </abstract>
      <kwd-group>
        <kwd>Propositional Logic plexity</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Introduction</p>
      <p>
        Counting Hierarchy
Among the many intriguing relationships existing between logic and computer
science, we can certainly mention the ones connecting classical propositional
logic (PL, for short), on the one hand, and computational complexity, the theory
of programming languages, and several other branches of theoretical computer
science, on the other. As it is well known, PL provided the rst example of a
nontrivial NP-complete problem [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]; moreover, formal systems for classical and
intuitionistic propositional logic correspond to type systems for -calculi and
related formalisms [
        <xref ref-type="bibr" rid="ref16 ref34">16, 34</xref>
        ]. These lines of research have further evolved in various
directions, resulting in active sub-areas of computer science. In particular,
variations of propositional logic have been put in relation with complexity classes
other than P and NP, as well as with type systems other than the simply typed
-calculus. For instance, the complexity of deciding quanti ed propositional
formulas is well known to match the appropriate level of the polynomial hierarchy
(PH, for short) [
        <xref ref-type="bibr" rid="ref10 ref27 ref28 ref35 ref42">27, 28, 35, 42, 10</xref>
        ].
      </p>
      <p>
        Nevertheless, some aspects of the theory of computation have not found a
precise logical counterpart, at least so far. One such development concerns the
counting classes of complexity and the related counting hierarchy (CH, for short),
as introduced by Valiant [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ] and Wagner [39{41], which are deeply connected
to randomized complexity classes, such as PP. In fact, Wagner's CH has been
treated logically by means of tools from descriptive complexity and nite model
theory [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. However, to the best of the authors' knowledge, there is no
counterpart of counting classes in the realm of propositional logic.
      </p>
      <p>In this paper we aim at bridging the gap by introducing a new
quantied propositional logic, called counting propositional logic (CPL, for short).
To present this logic in a more intuitive way, we start by de ning a
univariate fragment of CPL, that we call CPL0, and we later describe the general,
multivariate, logic CPL. The main feature of both these logics is the presence
of counting quanti ers, which are designed to count the number of values of
the bound propositional variables satisfying the argument formula. We study
the proof theory of counting logics together with its relations to computational
complexity. Along the way, we introduce a sound and complete proof system in
the form of a single-sided sequent calculus on labelled formulas. We also establish
complexity results for both univariate CPL0, the validity of which corresponds
to P]SAT, and for multivariate CPL, whose decision problem characterizes the
whole CH. Indeed, we prove that deciding (a special kind of) prenex normal
forms is complete for the appropriate level of the hierarchy, in the spirit of the
correspondence between quanti ed propositional logic (QPL, for short) and PH.</p>
      <p>
        The presentation is structured as follows. First, we introduce the syntax,
semantics, and proof theory of counting logics. Speci cally, in Section 2 we present
a sound and complete proof system for CPL0, in the form of a labelled sequent
calculus. In the univariate case, the correspondence with computational
complexity is limited to the class P]SAT. In Section 3, we extend the calculus for
CPL0 to the multivariate counting logic CPL. Section 4 is devoted to
establishing the connection between counting logic and complexity theory, by relating
the decision problem for CPL with the hierarchy CH. The proof proceeds by a
careful analysis of prenex normal forms, which by construction have precisely
the shape one needs to match Wagner's complete problems [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ].
2
      </p>
      <p>On Univariate Counting Propositional Logic
In this section we introduce a univariate version of counting propositional logic,
called CPL0, together with a sound and complete proof system for it. Although
this fragment has a limited expressive power, it provides an intuitive overview
over the main semantical and proof-theoretical ingredients behind the more
general logic CPL, introduced in the next section. Furthermore, the problem of
establishing the validity of a CPL0-formula is proved to be in the class P]SAT.
2.1</p>
      <p>
        CPL0-Formulae and their (Quantitative) Semantics
In the semantics of standard propositional logic the interpretation of a formula
is a truth-value. The core idea from which our counting logics arise is to replace
this way of interpreting formulas by a more quantitative semantics: the
interpretation of a formula will be the measurable set of all valuations that satisfy
it. Speci cally, since propositional formulas may have an arbitrary number of
propositional values, a valuation can be taken as an element of 2!; hence, given
a formula of CPL0, call it A, we may take as its interpretation the set JAK 2!
made of all maps f 2 2! \making A true". Such sets can be easily seen to belong
to the standard Borel algebra B(2!) over 2!, thus yielding a genuinely
quantitative semantics. In particular, atomic propositions are interpreted by cylinder
sets [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] of the following form:
      </p>
      <p>Cyl(i) = ff 2 2! j f (i) = 1g:
and non-atomic propositions are naturally interpreted by relying on the standard
-algebra operations of complementation, nite intersection and nite union.</p>
      <p>
        Since a formula corresponds to a measurable set, it makes sense to enrich
the language of propositional logic with new formulas expressing conditions on
the measure of such sets. By adapting Wagner's notion of counting operator [
        <xref ref-type="bibr" rid="ref40 ref41">40,
41</xref>
        ], we introduce two quanti ers, Cq; Dq, where q ranges over Q[0;1], so that the
formulas CqA and DqA express that A is satis ed by a given portion of all its
1
possible interpretations. For example, the formula C 2 A expresses the fact that A
is satis ed by at least half of its valutations, namely A is true with probability at
3
least 12 . Equally, the formula D 4 A expresses the fact that A is satis ed by strictly
less than three-fourths of its valutations, meaning that the probability for A to
be true is strictly smaller than 34 . Semantically, this amounts at respectively
checking that JAK 12 and JAK &lt; 34 , where is the standard Borel
measure on B(2!).
      </p>
      <p>De nition 1 (Formulas of CPL0). The formulas of CPL0 are de ned by the
following grammar:</p>
      <p>A ::= i j :A j A ^ B j A _ B j CqA j DqA
where i 2 N and q 2 Q[0;1].</p>
      <p>
        In the following, let ( C) indicate the -algebra generated by the set of all
n-cylinders, which is the smallest -algebra containing C and which is Borel.
Moreover, let denote the standard cylinder measure over ( C), which can be
de ned as the unique measure on ( C) such that Cyl(i) = 12 , see [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
De nition 2 (Semantics of CPL0). For each formula A of CPL0 its
interpretation is the measurable set, JAK 2 B(2!), inductively de ned as follows:
i = Cyl(i)
      </p>
      <p>J K</p>
      <p>J:AK = 2! JAK
JA ^ BK = JAK \ JBK
JA _ BK = JAK [ JBK</p>
      <p>J
CqAK =</p>
      <p>Two CPL0-formulas, A and B, are said logically equivalent, noted A B, when
JAK = JBK. A formula A is valid when JAK = 2!.</p>
      <p>The two counting quanti ers are inter-de nable, as can be easily shown
semantically:</p>
      <p>CqA
:DqA</p>
      <p>DqA
:CqA:
(1)
Observe that they are not dual in the sense of standard modal operators: CqA
is not equivalent to :Dq:A. Notably, using these quanti ers, it is even possible
to express that a formula A is satis ed with probability strictly greater than q
or with probability no smaller than q, as (resp.) D1 q:A and C1 q:A. The
example below can help clarifying the intuitive meaning of the semantics of
CPL0.
1
Example 1. Let us consider the counting formula C 2 A, where A = B _ C,
Bme=as0ur^e :411aannddaCre=m:u0tu^al1ly. Tdhisejotiwnto. mHeeanscuer,able sets, JBK and JCK, both have
1 (JAK) 1= (JBK) + (JCK) = 12 ,
which means that JC 2 AK = 2!, and so the formula C 2 A is valid.
2.2</p>
      <p>The Proof Theory of CPL0
We introduce a one-sided, single-succedent sequent calculus, and prove that it
is sound and complete with respect to the semantics of CPL0. The language of
this calculus is constituted by labelled formulas of the form b A or b A,
where A and b are respectively a counting and a Boolean formula. Intuitively,
a labelled formula b A (resp. b A) is true when the set of valuations
satisfying b is included in (resp. includes) the interpretation of A.
De nition 3 (Boolean Formulas). Boolean formulas are de ned by the
following grammar:</p>
      <p>b; c ::= xi j &gt; j ? j :b j b ^ c j b _ c:
where i 2 N. The interpretation of a Boolean formula b, JbK 2 B(2!), is
inductively de ned as follows:</p>
      <p>JxiK = Cyl(i)
J&gt;K = 2!</p>
      <p>J?K = ;
Labelled formulas are de ned as follows:</p>
      <p>J:bK = 2! JbK
Jb ^ cK = JbK \ JcK
Jb _ cK = JbK [ JcK:
De nition 4 (Labelled Formula). A labelled formula is an expression of one
of the forms b A, b A, where b is Boolean formula and A is a counting
formula. A labelled sequent is a sequent of the form ` L, where L is a labelled
formula.</p>
      <p>We also introduce a special class of formulas, that we call external hypotheses.
Such formulas express semantic properties of Boolean formulas or conditions
to be checked inside B(2!). In the following, we use b c as shorthand for
JbK JcK.
De nition 5 (External Hypothesis). An external hypothesis is either an
expression of the form b c or of the form (JbK).q, where . 2 f ; &gt;; ; &lt;; =g,
b; c are Boolean formulas and q 2 Q[0;1].</p>
      <p>The measure of the interpretation of a Boolean formula, (JbK), can be related
to the number ]SAT(b) of the valuations making b true as follows:
Lemma 1. For each Boolean formula b containing the propositional variables
x0; : : : ; xn 1, (JbK) = ]SAT(b) 2 n:
Proof. Any valuation : fx0; : : : ; xn 1g ! 2 is associated to a measurable set
X( ) 2 B(2!) by letting X( )=ff j 8i&lt;nf (i) = (xi)g = Tin=01 Cyl(i) (xi), where
Cyl(i) (xi) is Cyl(i) if (xi) = 1 and Cyl(i) otherwise. Observe that (X( )) =
2 n. For any b, we have that JbK = S b X( ) (this is easily checked by induction
on b). Since for all distinct , 0, X( )\X( 0) = ;, we conclude that ]SAT(b) 2 n
= P b 2 n = P b (X( )) = S b X( ) = (JbK).</p>
      <p>The calculus is de ned by the rules in Figure 1. Let `CPL0 L indicate that ` L
is derivable by the given rules. In Figure 2 we provide an example of derivation in
CPL0.1 The use of external hypotheses, that is, of genuinely semantic conditions,
as premisses of syntactic rules might seem somehow unsatisfactory. However,
such premisses do make sense from a computational viewpoint: they correspond
to the idea that, when searching for a proof of a counting formula, one might
need to call for an oracle for values of the form (JbK) in fact, by Lemma 1,
an oracle for ]SAT(b) . This intuition will be made clear in the next subsection,
where we discuss an algorithm for CPL0-validity.</p>
      <p>A labelled formula b A (resp. b A) is valid, noted b A (resp.
b A), when JbK JAK (resp. JAK JbK). A sequent ` L is valid when L. As
anticipated, the proof system just introduced is sound and complete with respect
to the semantics of CPL0: a labelled formula is valid if and only if it is provable.
Soundness can be established by a standard induction on the derivation height.
The proof of completeness is less straightforward and described in full detail in [1,
x A.2]. The fundamental ingredient is the introduction of a decomposition relation
between nite sets of sequents, which allows one to decompose the validity of
a complex statement (for example, b A _ B) into that of a nite set of less
complex statements (such as, c A; d B, given that b c_ d holds). One
can show then that a complex valid sequent is decomposable into a nite set of
non-decomposable valid sequents, and, from the provability of the latter, climb
back to the validity of the original sequent using the rules of CPL0.</p>
    </sec>
    <sec id="sec-2">
      <title>Proposition 1.</title>
      <sec id="sec-2-1">
        <title>L holds if and only if `CPL0 L holds</title>
        <p>1 Observe that the last four counting rules in Fig. 1 make an arbitrarily chosen label b
appear in the conclusion. Intuitively, this is coherent with the semantics of counting
formulas, which are interpreted as either 2! or ;, which are (resp.) superset or subset
of any given set.</p>
        <p>b xn
` b</p>
        <p>n Ax1
` c</p>
        <p>A</p>
        <p>` c
` b A
` b ` bA _ B</p>
        <p>B
` b A ^ B
` d
` b</p>
        <p>A
` b
R1_</p>
        <p>R1^
` c
` c</p>
        <p>A
` b
A
` b
`(JbbK) =A0 R</p>
        <p>(JcK) q
CqA</p>
        <p>(JcK) &lt; q
DqA</p>
        <p>A
A
:A
b :c R
:
` b
` b</p>
        <p>` b
` b
RC
RD
b c _ d R
Fig. 2. Derivation of ` &gt;</p>
        <p>C 21 (0 ^ :1) _ (:0 ^ 1) in CPL0
As suggested before, a proof that a quanti ed formula like CqA or DqA is
valid can be seen as obtained by invoking an oracle, which provides a suitable
measurement (JbK), for a Boolean formula b. As shown by Lemma 1, these
measurements correspond to actually counting the number of valuations
satisfying the corresponding formula. It is possible to make this intuition precise by
showing that, in CPL0, validity can be decided by a polytime algorithm having
access to an oracle for the problem ]SAT of counting the models of a Boolean
formula.</p>
        <p>A formula of CPL0, call it A, is said to be closed if it is either of the form
CqB or DqB or it is a negation, conjunction, or disjunction of closed formulas.
It can be easily checked by induction on the structure of closed formulas that
for any closed A, either JAK = 2! or JAK = ;. We de ne, by mutual recursion,
two polytime algorithms Bool and Val: for each formula A of CPL0, Bool(A)
computes a Boolean formula bA such that JAK = JbAK, and, for all closed formula
A, Val(A) = 1 if and only if JAK = 2! and Val(A) = 0 if and only if JAK = ;.
The two algorithms are de ned in Figure 3. Notice that the algorithm Val makes
use of a ]SAT oracle.</p>
        <p>We recall that the class P]SAT is made of those problems which can be decided
in polytime having access to a ]SAT oracle. One can easily be convinced that the
algorithms Bool and Val both belong to P]SAT, which leads to the following:</p>
      </sec>
      <sec id="sec-2-2">
        <title>Proposition 2. CPL0-validity is in P]SAT.</title>
        <p>Bool(n) = xn
Bool(A1 ^ A2) = Bool(A1) ^ Bool(A2)
Bool(A1 _ A2) = Bool(A1) _ Bool(A2)</p>
        <p>Bool(:A1) = :Bool(A1)
Bool(CqA1) = Val(CqA1)
Bool(DqA1) = Val(DqA1)
Val(A1 ^ A2) = Val(A1) AND Val(A2)
Val(A1 _ A2) = Val(A1) OR Val(A2)</p>
        <p>Val(:A1) = NOT Val(A1)
Val(CqA1) = let b = Bool(A1) in
let n = ]Val(b) in</p>
        <p>]SA2Tn(b) q
Val(DqA1) = let b = Bool(A1) in
let n = ]Val(b) in
]SA2Tn(b) &lt; q
where ]Val(b) is the number of propositional variables in b.</p>
        <p>On Multivariate Counting Propositional Logic
In this section we introduce propositional counting logic CPL, which extends
counting quanti ers to a multivariate case, as discussed below. In Section 4 it will
be shown that this logic yield a characterization of the full counting hierarchy.</p>
        <p>
          As it is well-known, counting problems are not restricted to those in P]SAT.
For instance, one can consider problems concerning relations between valuations
of di erent groups of variables, like MajMajSAT [
          <xref ref-type="bibr" rid="ref25 ref26 ref7">7, 25, 26</xref>
          ]. Given a formula A of
PL containing two disjoint sets x and y of variables, this problem asks whether
for at least half of the valuations of x, at least half of the valuations of y makes
A true.
        </p>
        <p>To express these kinds of problems, we will consider a language in which
propositional atoms and counting quanti ers are named (we use a; b; c; : : : for
names); counting quanti cations, indicated as CqaA or DqaA, now depend on the
number of valuations of propositional atoms with name a satisfying A.
De nition 6 (Formulas of CPL). The formulas of CPL are de ned by the
following grammar:</p>
        <p>A ::= ia j :A j A ^ B j A _ B j CqaA j DqaA
where i 2 N, a is a name, and q 2 Q[0;1].</p>
        <p>Named quanti ers, Cqa and Dqa, bind the occurrences of the name a in A. Given a
formula A of CPL, we let FN(A) indicate the set of names occurring free (i.e. not
bound) in A.</p>
        <p>Names can be used to distinguish between distinct groups of propositional
variables. For example, the propositional formula F = (x1 _ y1) ^ (x2 _ y2),
containing two groups of variables x = fx1; x2g and y = fy1; y2g, can be expressed
in CPL using two distinct names a; b as G = (1a _ 1b) ^ (2a _ 2b). Since the
intuitive meaning of CqaA is that A is true in at least q of the valuations of
1 1
the variables with name a, we can take the CPL-formula Ca2 Cb2 G as expressing
the MajMajSAT problem for F (which happens to have a positive answer, in this
case).</p>
        <p>While the formulas CqaA and DqaA have a rather intuitive meaning, the
semantics of CPL-formulas is slightly subtler than in the case of CPL0. The
interpretation of a formula A now depends on the choice of a nite set of names
X FN(A), and consists in a measurable set A X belonging to the Borel
algebra B (2!)X . Hence, the quanti ers Cqa and DJqaKmust correspond to operations
allowing one to pass from B (2!)X[fag to B (2!)X . To de ne such operations
we need the following technical notion: given two disjoint nite sets of names
X; Y , for any f 2 (2!)X , and X (2!)X[Y , the f -projection of X is the set
f (X ) = fg 2 (2!)Y j f + g 2 X g (2!)Y , where (f + g)( ) is f ( ), if 2 X
and g( ) if 2 Y .</p>
        <p>De nition 7 (Semantics of CPL). For each formula A of CPL, and nite
set of names such that X FN(A), the interpretation of A, JAKX (2!)X , is
inductively de ned as follows:</p>
        <p>JiaKX = ff j f (a)(i) = 1g
JA ^ BKX = JAKX \ JBKX
JA _ BKX = JAKX [ JBKX</p>
        <p>J:AKX = (2!)X
JCqaAKX = ff j
JDqaAKX = ff j</p>
        <p>A X</p>
        <p>J K
f (JAKX[fag)</p>
        <p>qg
( f (JAKX[fag) &lt; qg:
That all sets JAKX are measurable, namely that JAKX 2 B (2!)X , is not an
obvious fact (as it crucially relies on some properties of f -projections), and is
proved in detail in [1, x 4]. Logical equivalence in CPL is de ned relatively to
a set of names X, by letting A X B if and only if FN(A); FN(B) X and
JAKX = JBKX .</p>
        <p>Similarly to what has been shown in the previous section, one can introduce
a sound and complete labelled calculus for CPL. In this case, labelled formulas
involve a named Boolean formula (i.e, built from named Boolean variables, such
as xia). Sequents are of the form `X L, with FN(L) X. Most rules of CPL
are straightforward generalizations of those for CPL0, except for the counting
rules, which are understandably more complex (see the example in Figure 4),
and rely on the notion of a-decomposition for Boolean formulas.2 In spite of
this involved de nition, soundness and completeness for this calculus can be still
proved generalizing the corresponding arguments for CPL0.</p>
        <p>`X[fag c</p>
        <p>A</p>
        <p>
          b X Wifei j (JdiKfag) qg RC *
`X b CqaA
* where Wi ei ^ di is an a-decomposition of c
We have already seen that the problem MajMajSAT, which is complete for CH2 =
PPPP, is \captured" by formulas of the form CqaCbrA, where A is quanti
erfree. We will extend this result to all levels of CH by considering CPL-formulas
containing an arbitrary number of counting quanti ers. We will proceed in three
steps. First, we will show that any formula of CPL can be put in prenex normal
form, that is, that all counting quanti ers can be moved at top-level. Next, we
will prove that the D quanti er, which has no counterpart in Wagner's problems,
can be eliminated. Finally, using Wagner's Theorem [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ], we will show that
prenex formulas with k nested C-quanti ers characterize the level k of CH.
2 Given a named Boolean formula b, with free names in X [ fag, an a-decomposition
of b is any Boolean formula c = Wik=01 di ^ ei such that: (i) JcKX[fag = JbKX[fag,
(ii) FN(di) fag and FN(ei) X, (iii) if i 6= j, then JeiKX \ JejKX = ;. It
can be shown that any Boolean formula b, with FN(b) X [ fag admits an
adecomposition. For further details, see [1, x 4]. The complete proof system for CPL
is presented in [1, x B.2].
4.1
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>On Wagner's Counting Hierarchy</title>
      <p>
        The existence of deep and mutual interactions between classical propositional
logic and computational complexity is well-known. For instance, checking the
satis ability of PL-formulas is the paradigmatic NP-complete problem [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], while
the subclass of all tautologies is coNP-complete. When switching to QPL, these
classes are even captured by a single logical concept: already in the early 1970s,
Meyer and Stockmeyer de ned PH, and proved that each level of the hierarchy
is characterized by the validity of prenex QBF with the corresponding number
of quanti er alternations [
        <xref ref-type="bibr" rid="ref10 ref27 ref28 ref35 ref42">27, 28, 35, 42, 10</xref>
        ].
      </p>
      <p>
        Nevertheless, if we move to a probabilistic framework, such a plain
correspondence seems lost, as no analogous logical counterpart has yet been found
for the counting complexity classes and hierarchy, introduced from the 1970s
on by Valiant [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ] and Wagner [39{41]. Speci cally, CH was presented in 1986
(actually by both Wagner and Parberry and Schnitger [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ]) as the counting
analogous to PH, which is inadequate to characterize problems in which counting is
involved. The hierarchy CH is de ned similarly to PH, but with PP in place of
NP, i.e. by letting CH0 = P and CHn+1 = PPCHn . Actually, the original
characterization in [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ] is in terms of alternating (counting and standard) quanti ers,
where Wagner's counting operator is capable of expressing also standard
quanti cation. In [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ], beyond introducing CH, the author also considers canonical
complete problems for each level of the hierarchy.
      </p>
      <p>In the rest of this section we will relate such results to CPL, showing that
the validity of the formulas of CPL yields a new family of complete problems for
CHn, hence providing a logical characterization of CH.
4.2</p>
      <p>Prenex Normal Forms
Let us introduce prenex normal forms in the language of CPL:
De nition 8 (PNF). A formula of CPL is an n-ary prenex normal form (or
simply a prenex normal form, PNF for short) if it can be written as 41 : : : 4nA,
where, for every i 2 f1; : : : ; ng, 4i is either Cqa or Dqa (for arbitrary a and q),
and A is quanti er-free. The formula A is said to be the matrix of the PNF.
To convert a formula of CPL into an equivalent PNF, some intermediate lemmas
are needed.3 Preliminarily, notice that for every formula A of CPL, name a, and
nite set X, such that FN(A) X and a 62 X, if q = 0, then JCqaAKX = (2!)X
and JDqaAKX = ;X .</p>
      <p>The lemma below shows that counting quanti ers occurring inside any
conjunction or disjunction can be extruded from it.</p>
      <p>Lemma 2. Let a 62 FN(A) and q &gt; 0. Then, for every X such that FN(A) [
FN(B) X and a 62 X, the following equivalences hold:</p>
      <sec id="sec-3-1">
        <title>A ^ CqaB</title>
      </sec>
      <sec id="sec-3-2">
        <title>A ^ DqaB</title>
        <p>X Cqa(A ^ B)</p>
        <p>X Dqa(:A _ B)
3 Their proofs can be found in [1, x C].</p>
      </sec>
      <sec id="sec-3-3">
        <title>A _ CqaB</title>
      </sec>
      <sec id="sec-3-4">
        <title>A _ DqaB X Cqa(A _ B) X Dqa(:A ^ B):</title>
        <p>Remarkably, a corresponding lemma does not hold for CPL0, due to the
impossibility of renaming variables (on which Lemma 2 relies).</p>
        <p>We then consider negation. In this case, the inter-de nability of Cq and Dq
in CPL0 (Equation 1) can be generalized to CPL, and this allows one to get rid
of negations which lie between any occurrences of a counting quanti er and the
formula's root.</p>
        <p>Lemma 3. For every q 2 Q[0;1], name a, and X such that FN(A)
and a 62 X, :DqaA X CqaA and :CqaA X DqaA hold.</p>
        <p>X [ fag,
Therefore, using Lemma 2 and Lemma 3, we can conclude that every formula of
CPL can be put in PNF, as desired.</p>
        <p>Proposition 3. For every formula A of CPL there is a PNF B, such that for
every X with FN(A)[FN(B) X, A X B holds. Moreover, B can be computed
in polynomial time from A.
4.3</p>
        <p>Positive Prenex Normal Forms
Reducing formulas to PNF is close to what we need, but there is one last step to
make, namely getting rid of the quanti er D, which does not have any
counterpart in Wagner's construction. In other words, we need to reduce CPL-formulas
to prenex normal forms of a special kind :
De nition 9 (PPNF). A formula of CPL is said to be a positive prenex
normal form (PPNF, for short) when it is both PNF and D-free.</p>
        <p>The gist to convert formulas into (equivalent) PPNF, consists in two main
steps: (i) converting each instance of D into one of C, using Lemma 3, and (ii)
applying the lemma below which states that C enjoys a speci c, weak form of
self duality, to push the negation inside the matrix.</p>
        <p>Lemma 4 (Epsilon Lemma). For every formula A of CPL and q 2 Q[0;1],
there is a p 2 Q[0;1] such that, for every X with FN(A) X and a 62 X:
:CqaA X Cpa:A: Moreover, p can be computed from q in polynomial time.
Proof (Sketch4). Let bA be a Boolean formula satisfying JAKX[fag = JbAKX[fag,
a-decomposable as Win di ^ ei, and let k be maximum such that xka occurs in bA.
Let [0; 1]k be the set of those rational numbers r 2 [0; 1] which can be written as
a nite sum of the form Pk</p>
        <p>i=0 bi 2i. For all i 2 f0; : : : ; ng, (JdiKfag) 2 [0; 1]k,
where bi 2 f0; 1g, and for all f : X ! 2!, also f (JAKX[fag) 2 [0; 1]k. Let
now be 2 (k+1) if q 2 [0; 1]k and q 6= 1, be 2 (k+1) if q = 1 and let = 0 if
q 62 [0; 1]k. In all cases, q + 62 [0; 1]k so, by means of some simple computation,
1 (q+ ):AKX :
it is possible to conclude that J:CqaAKX = JCa
Actually, the value of p is very close to 1 q, the di erence between the two
being easily computable from the formula A. So, any negation occurring in the
counting pre x of a PNF formula, can be pushed back into the matrix.
4 For full details, see [1, Lemma 13].</p>
        <p>Proposition 4. For every formula A of CPL there is a PPNF B such that
for every X, with FN(A) [ FN(B) X, A X B holds. Moreover, B can be
computed from A in polynomial time.
4.4</p>
        <p>
          CPL and the Counting Hierarchy
As anticipated, in [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ] Wagner not only introduced his counting operator and
hierarchy, but also de ned complete problems for each level of CH. Below, we
present a slightly weaker version of Wagner's Theorem [40, pp. 338-339], which
perfectly ts our needs.
        </p>
        <p>
          Suppose L to be a subset of Sn, where S is a set, that 1 m &lt; n, and that
b 2 N. We de ne CbmL as the following subset of Sn m:
f(an; : : : ; am+1) j #(f(am; : : : ; a1) j (an; : : : ; a1) 2 Lg)
bg :
Let T and F indicate the usual true and false formulas of PL. For any natural
number n 2 N, let T F n be the subset of PLn+1 containing all tuples in the form
(A; t1; : : : ; tn), where A is a propositional formula in CNF with at most n free
variables, and t1; : : : ; tn 2 fT; Fg render A true. Finally, for every k 2 N, we
denote as W k the language consisting of all (binary encodings of) tuples of the
form (A; m1; : : : ; mk; b1; : : : ; bk) such that A 2 Cbm11 Cbmkk T F P mi .
Theorem 1 (Wagner, Th.7 [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ]). For every k, the language W k is complete
for CHk.
        </p>
        <p>Observe that elements of W k can be seen as alternative representations for PPNF
formulas of CPL, once any mi is replaced by minf1; 2mbii g. Consequently,
Corollary 1. The closed and valid k-ary PPNFs, whose matrix is in CNF,
dene a complete set for CHk.
5</p>
        <p>
          Related Works
The literature on logics enabling some forms of probabilistic reasoning is vast,
yet most proposals are not related to computational aspects. In the last decades,
several probabilistic logics have been developed in the realm of modal logic,
starting from the pioneering works by Nilsson [
          <xref ref-type="bibr" rid="ref30 ref31">30, 31</xref>
          ]. In particular, in the 1990s,
some noteworthy probability logics were (independently) introduced both by
Bacchus [
          <xref ref-type="bibr" rid="ref4 ref5 ref6">6, 4, 5</xref>
          ] and by Fagin, Halpern, and Megiddo [
          <xref ref-type="bibr" rid="ref13 ref14 ref18 ref19">14, 18, 13, 19</xref>
          ]. Another
class of probabilistic modal logics have been designed to model Markov chains
and similar structures, see for instance [
          <xref ref-type="bibr" rid="ref20 ref23 ref24">20, 23, 24</xref>
          ]. A notable example is Riesz
modal logic [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], which admits a sound and complete proof system. Remarkably,
this is the only sequent calculus for probability logic we are aware of, while
complete axiomatic systems have been provided for both the probability logics
quoted above [
          <xref ref-type="bibr" rid="ref14 ref6">6, 14</xref>
          ]. By the way, our calculi are actually inspired by labelled
systems, such as G3K and G3P , as presented for example in [
          <xref ref-type="bibr" rid="ref17 ref29">29, 17</xref>
          ].
        </p>
        <p>
          As we have seen, CH was rst de ned by Wagner in [
          <xref ref-type="bibr" rid="ref39 ref40 ref41">39, 41, 40</xref>
          ] and,
independently, by Pareberry and Schnitger [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]. It was conceived as an extension
of Meyer and Stockmeyer's PH [
          <xref ref-type="bibr" rid="ref27 ref28">27, 28</xref>
          ] aiming at characterizing natural
problems in which counting is involved. There are two main, equivalent [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ] ways to
de ne CH: the original characterization in terms of alternating quanti ers [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ],
and the one based on oracles [
          <xref ref-type="bibr" rid="ref36">36</xref>
          ]. Notably, Wagner's operator was not the only
\probabilistic" (class) quanti ers introduced in the 1980s (consider, for instance,
Papadimitriou's probabilistic quanti er [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ], Zachos and Heller's random
quantier [
          <xref ref-type="bibr" rid="ref44">44</xref>
          ], or Zachos' overwhelming and majority quanti ers [
          <xref ref-type="bibr" rid="ref43">43</xref>
          ]). However, to the
best of the authors' knowledge, all these operators are counting quanti ers on
(classes of) languages, rather than stricto sensu logical ones. One remarkable
exception is represented by Kontinen's work [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ], in which second-order quanti ers
are de ned in the style of descriptive complexity.
6
        </p>
        <p>Conclusion
To the best of our knowledge, CPL is the rst logical system extending
propositional logic with counting quanti ers. Our main source of inspiration comes
from computational complexity, namely from Wagner's counting operator on
classes. By the way, we believe that the main contribution of the paper is not
the introduction of counting logics per se, but the investigation of its
connections with counting classes. Indeed, we have shown that counting quanti ers play
nicely with propositional logic in characterizing CH, and thus relate nicely with
some old and recent results in complexity theory. In our opinion, CPL naturally
appears as the probabilistic counterpart of QPL.</p>
        <p>
          Due to space reasons, we left out some important applications of counting
logics to other branches of computer science, such as the theory of programming
languages. In particular, it is possible to design type systems for the randomized
-calculus by extending simple types with counting quanti ers,5 and to de ne a
probabilistic counterpart of the Curry-Howard correspondence [
          <xref ref-type="bibr" rid="ref16 ref34">16, 34</xref>
          ] relating
typing derivations with derivations in CPL.6 Moreover, the proof theory of CPL
has just been brie y delineated and the dynamics (i.e. the cut-elimination
procedure) of the introduced formal systems deserves further investigation. Promising
results also concern the possibility to inject \counting" quanti ers into the
language of arithmetic. In particular, in [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] we have investigated an extension of
standard Peano Arithmetics with measure quanti ers, which can be seen as a
natural generalization of the quanti ers of CPL0 to the language of arithmetic.
The extension of counting quanti ers to arithmetic looks particularly promising,
as it suggests ways of characterizing in a \logical" way explicit lower bounds for
counting problems [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ], as well as the possibility of de ning new logical systems
capturing probabilistic complexity classes like BPP (see [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]).
5 Notice that while several type systems for randomized -calculi and guaranteeing
various forms of termination properties have been introduced in the last years, [
          <xref ref-type="bibr" rid="ref12 ref3 ref9">12,
9, 3</xref>
          ], none of these systems is explicitly logic-oriented.
6 Some achievements in this direction have been presented in [1, x 6].
        </p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Antonelli</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Dal</given-names>
            <surname>Lago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Pistone</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          : On Counting Propositional Logic (
          <year>2021</year>
          ), available at: https://arxiv.org/abs/2103.12862
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Antonelli</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Dal</given-names>
            <surname>Lago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Pistone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            : On Measure Quanti ers in First-Order
            <surname>Arithmetic</surname>
          </string-name>
          (
          <year>2021</year>
          ), to appear
          <source>in Proceedings of Computability in Europe</source>
          <year>2021</year>
          (
          <article-title>CiE2021); long version</article-title>
          available at: https://arxiv.org/abs/2104.12124
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Avanzini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Dal</given-names>
            <surname>Lago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Ghyselen</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          :
          <article-title>Type-based complexity analysis of probabilistic functional programs</article-title>
          .
          <source>In: Proceedings of the 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS)</source>
          . pp.
          <volume>1</volume>
          {
          <fpage>13</fpage>
          . IEEE, Vancouver, BC, Canada, Canada (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bacchus</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Lp, a logic for representing and reasoning with statistical knowledge</article-title>
          .
          <source>Computational Intelligence</source>
          <volume>6</volume>
          (
          <issue>4</issue>
          ),
          <volume>209</volume>
          {
          <fpage>231</fpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bacchus</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>On probability distributions over possible worlds</article-title>
          .
          <source>Machine Intelligence and Pattern Recognition</source>
          <volume>9</volume>
          ,
          <issue>217</issue>
          {
          <fpage>226</fpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Bacchus</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Representing and Reasoning with Probabilistic Knowledge</article-title>
          . MIT Press (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Biere</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heule</surname>
            , M., van Maaren,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walsh</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Handbook of Satis ability</article-title>
          . IOS Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Billingsley</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Probability and Measure. Wiley (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Breuvart</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dal Lago</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          :
          <article-title>On intersection types and probabilisitic lambda calculi</article-title>
          .
          <source>In: PPDP '18: Proceedings of the 20th International Symposium on Principles and Practice of Declarative Programming</source>
          . pp.
          <volume>1</volume>
          {
          <fpage>13</fpage>
          . No.
          <volume>8</volume>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. Buning, H.,
          <string-name>
            <surname>Bubeck</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          :
          <article-title>Theory of quanti ed Boolean formulas</article-title>
          . In: Biere,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Heule</surname>
          </string-name>
          , M., van Maaren,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Walsh</surname>
          </string-name>
          , T. (eds.)
          <article-title>Handbook of Satis ability</article-title>
          . IOS Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Cook</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The complexity of theorem-proving procedures</article-title>
          .
          <source>In: STOC '71</source>
          . pp.
          <volume>151</volume>
          {
          <issue>158</issue>
          (
          <year>1971</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Dal</given-names>
            <surname>Lago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Grellois</surname>
          </string-name>
          ,
          <string-name>
            <surname>U.</surname>
          </string-name>
          :
          <article-title>Probabilistic termination by monadic a ne sized typing</article-title>
          .
          <source>ACM Trans. Program. Lang. Syst</source>
          .
          <volume>41</volume>
          (
          <issue>2</issue>
          ),
          <volume>10</volume>
          {
          <fpage>65</fpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Fagin</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halpern</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>Reasoning about knowledge and probability</article-title>
          .
          <source>Journal of ACM</source>
          <volume>41</volume>
          (
          <issue>2</issue>
          ),
          <volume>340</volume>
          {
          <fpage>367</fpage>
          (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Fagin</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halpern</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Megiddo</surname>
            ,
            <given-names>N.:</given-names>
          </string-name>
          <article-title>A logic for reasoning about probabilities</article-title>
          .
          <source>Inf. Comput</source>
          .
          <volume>87</volume>
          (
          <issue>1</issue>
          /2),
          <volume>78</volume>
          {
          <fpage>128</fpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Furber</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mardare</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mio</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Probabilistic logics based on Riesz spaces</article-title>
          .
          <source>LMCS</source>
          <volume>16</volume>
          (
          <issue>1</issue>
          ) (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Girard</surname>
          </string-name>
          , J.Y.:
          <article-title>Proof and Types</article-title>
          . Cambridge University Press (
          <year>1989</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Girlando</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Negri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sbardolini</surname>
          </string-name>
          , G.:
          <article-title>Uniform labelled calculi for conditional and counterfactual logics</article-title>
          .
          <source>In: WoLLIC 2019</source>
          . pp.
          <volume>248</volume>
          {
          <issue>263</issue>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Halpern</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An analysis of rst-order logics for probability</article-title>
          .
          <source>Arti cial Intelligence</source>
          <volume>46</volume>
          (
          <issue>3</issue>
          ),
          <volume>311</volume>
          {
          <fpage>350</fpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Halpern</surname>
          </string-name>
          , J.:
          <article-title>Reasoning About Uncertainty</article-title>
          . MIT Press (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Hansson</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jonsson</surname>
            ,
            <given-names>B.:</given-names>
          </string-name>
          <article-title>A logic for reasoning about time and reliability</article-title>
          .
          <source>Form. Asp. Comput</source>
          .
          <volume>6</volume>
          (
          <issue>5</issue>
          ),
          <volume>512</volume>
          {
          <fpage>535</fpage>
          (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Jerabek</surname>
          </string-name>
          , E.:
          <article-title>Approximate counting in Bounded Arithmetic</article-title>
          .
          <source>J. Symb. Log</source>
          .
          <volume>72</volume>
          (
          <issue>3</issue>
          ),
          <volume>959</volume>
          {
          <fpage>993</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Kontinen</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>A logical characterization of the Counting Hierarchy</article-title>
          .
          <source>TOCL</source>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Kozen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Semantics of probabilistic programs</article-title>
          .
          <source>JCSS</source>
          <volume>53</volume>
          (
          <issue>3</issue>
          ),
          <volume>165</volume>
          {
          <fpage>198</fpage>
          (
          <year>1982</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shelah</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Reasoning with time and chance</article-title>
          .
          <source>Inf. Control</source>
          .
          <volume>53</volume>
          (
          <issue>3</issue>
          ),
          <volume>165</volume>
          {
          <fpage>198</fpage>
          (
          <year>1982</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25. van Melkebeek,
          <string-name>
            <surname>D.:</surname>
          </string-name>
          <article-title>A survey on lower bounds for satis ability and related problems</article-title>
          .
          <source>FnT-TCS 2</source>
          ,
          <issue>197</issue>
          {
          <fpage>303</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26. van Melkebeek,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Watson</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          :
          <article-title>A Quantum Time-Space Lower Bound for the Counting Hierarchy</article-title>
          , available at: https://minds.wisconsin.edu/handle/1793/60568
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27. Meyer, A.,
          <string-name>
            <surname>Stockmeyer</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The equivalence problem for regular expressions with squaring requires exponential space</article-title>
          .
          <source>In: SWAT</source>
          . pp.
          <volume>125</volume>
          {
          <issue>129</issue>
          (
          <year>1972</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28. Meyer, A.,
          <string-name>
            <surname>Stockmeyer</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Word problems requiring exponential time (preliminary report)</article-title>
          .
          <source>In: STOC'73</source>
          . pp.
          <volume>1</volume>
          {
          <issue>9</issue>
          (
          <year>1973</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Negri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>von Plato</surname>
          </string-name>
          , J.:
          <article-title>Proof Analysis: A Contribution to Hilbert's Last Problem</article-title>
          . Cambridge University Press (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Nilsson</surname>
          </string-name>
          , N.:
          <article-title>Probabilistic logic</article-title>
          .
          <source>Arti cial Intelligence</source>
          <volume>28</volume>
          (
          <issue>1</issue>
          ),
          <volume>71</volume>
          {
          <fpage>87</fpage>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Nilsson</surname>
          </string-name>
          , N.:
          <article-title>Probabilistic logic revisited</article-title>
          .
          <source>Arti cial Intelligence</source>
          <volume>59</volume>
          (
          <issue>1</issue>
          /2),
          <volume>39</volume>
          {
          <fpage>42</fpage>
          (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Papadimitriou</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Games against nature</article-title>
          .
          <source>JCSS</source>
          <volume>31</volume>
          (
          <issue>2</issue>
          ),
          <volume>288</volume>
          {
          <fpage>301</fpage>
          (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Parberry</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schnitger</surname>
          </string-name>
          , G.:
          <article-title>Parallel computation with threshold functions</article-title>
          .
          <source>JCSS 36</source>
          ,
          <issue>278</issue>
          {
          <fpage>302</fpage>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Sorensen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Urzyczyn</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>Lectures on the Curry-Howard Isomorphism</article-title>
          , vol.
          <volume>149</volume>
          .
          <string-name>
            <surname>Elsevier</surname>
          </string-name>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Stockmeyer</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The Polynomial-Time Hiearchy</article-title>
          .
          <source>Theor. Comput. Sci. 3</source>
          ,
          <issue>1</issue>
          {
          <fpage>22</fpage>
          (
          <year>1977</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Toran</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An oracle characterization of the Counting Hierarchy</article-title>
          .
          <source>In: Proceedings. Structure in Complexity Theory Third Annual Conference</source>
          . pp.
          <volume>213</volume>
          {
          <issue>223</issue>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Toran</surname>
          </string-name>
          , J.:
          <article-title>Complexity classes de ned by counting quanti ers</article-title>
          .
          <source>Journal of the ACM</source>
          <volume>38</volume>
          (
          <issue>3</issue>
          ),
          <volume>753</volume>
          {
          <fpage>774</fpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Valiant</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The complexity of computing the permanent</article-title>
          .
          <source>Theor. Comput. Sci. 8</source>
          (
          <issue>2</issue>
          ),
          <volume>189</volume>
          {
          <fpage>201</fpage>
          (
          <year>1979</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <surname>Wagner</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Compact descriptions and the counting polynomial-time hierarchy</article-title>
          .
          <source>In: Frege Conference 1984: Proceedings of the International Conference held at Schwerin</source>
          . pp.
          <volume>383</volume>
          {
          <issue>392</issue>
          (
          <year>1984</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>Wagner</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>The complexity of combinatorial problems with succinct input representation</article-title>
          .
          <source>Acta Informatica</source>
          <volume>23</volume>
          ,
          <issue>325</issue>
          {
          <fpage>356</fpage>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          41.
          <string-name>
            <surname>Wagner</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Some observations on the connection between counting and recursion</article-title>
          .
          <source>Theor. Comput. Sci</source>
          .
          <volume>47</volume>
          ,
          <issue>131</issue>
          {
          <fpage>147</fpage>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          42.
          <string-name>
            <surname>Wrathall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Complete sets and the Polynomial-Time Hierarchy</article-title>
          .
          <source>Theor. Comput. Sci. 3</source>
          (
          <issue>1</issue>
          ),
          <volume>23</volume>
          {
          <fpage>33</fpage>
          (
          <year>1976</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          43.
          <string-name>
            <surname>Zachos</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Probabilistic quanti ers and games</article-title>
          .
          <source>JCSS</source>
          <volume>36</volume>
          (
          <issue>3</issue>
          ),
          <volume>433</volume>
          {
          <fpage>451</fpage>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          44.
          <string-name>
            <surname>Zachos</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heller</surname>
          </string-name>
          , H.:
          <article-title>A decisive characterization of BPP</article-title>
          . Information and Control pp.
          <volume>125</volume>
          {
          <issue>135</issue>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>