<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Resolution and Clause Learning for Multi-Valued CNF</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>David Mitchell mitchell@cs.sfu.ca</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Simon Fraser University</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Con ict-directed clause learning (CDCL) is the basis of SAT solvers with impressive performance on many problems. CDCL with restarts (CDCL-R) has been shown to have essentially the same reasoning power as unrestricted resolution (formally, they p-Simulate each other). We show that this property generalizes to multi-valued CNF formulas. In particular, for Signed (or Multi-Valued) CNF formulas, and Regular Formulas, we show that a natural generalization of CDCL-R to these logics has essentially the same reasoning power as natural generalizations of resolution from the literature. These formulas are possible reduction targets for a number of multi-valued logics, and thus a possible basis for e cient reasoning systems for these logics.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Multi-valued logics are among the most established formal methods for
reasoning with uncertainty. In this paper, we study a property relating resolution
proofs and a family of satis ability algorithms for multi-valued CNF formulas,
as de ned in, for example, [
        <xref ref-type="bibr" rid="ref3 ref8">8, 3</xref>
        ].
      </p>
      <p>
        The dominant algorithm in modern SAT solvers is the con ict-directed clause
learning algorithm, introduced in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], with restarts [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], here denoted CDCL-R.
Good solvers based on CDCL-R have remarkable performance on some classes
of problems. Consequently, many reasoning tasks are carried out by reduction to
propositional CNF, or by adaptation of CDCL to other families of formulas. It
has been shown that CDCL-R with unlimited restarts has, up to a small
polynomial factor, the same reasoning power as unrestricted propositional resolution
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. (It remains open whether restarts are essential or not.) Independently, using
essentially the same method plus a probabilistic argument, it was shown in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
that CDCL-R can refute any CNF formula with a width k resolution refutation
in time O(n2k+2).
      </p>
      <p>
        Because most SAT solvers require input in CNF, it is standard to solve
propositional logic reasoning problems by reduction to CNF. Validity or satis ability
of many multi-valued and fuzzy logics (as well as annotated logics, and others)
can be reduced to Signed or Multi-Valued CNF formulas [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The main purpose of
this paper is to show that the result and method from [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] generalize naturally
to the Signed CNF setting. In particular, we present a natural generalization
of CDCL-R to Signed CNF, and show that this algorithm has essentially the
same reasoning power as standard binary resolution proofs for these formulas.
Our proof is essentially an adaptation of that in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], with parts in uenced by
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], although our presentation is distinct. Rather than proceed from a detailed
examination of CDCL-R, we proceed from the key properties of resolution, to
a simpli ed derivation algorithm, and then to a highly abstracted version of
CDCL-R.
      </p>
      <p>
        We assume the reader is familiar with the standard CDCL-R algorithm. (A
self-contained description of CDCL and its relationship to resolution can be
found in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], among other places. The reader may also want to refer to [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] for distinct presentations of the algorithm, as well as the original proofs ours is
based on, and [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], where a careful examination of the relation between resolution
and the implication graph method for obtaining con ict clauses appears.)
      </p>
      <p>
        A number of algorithms and solvers for signed or multi-valued formulas, or
special cases of them, have been described in the literature. We leave a review
of these to a longer paper. Here we point out only that our algorithm, while
presented very di erently, seems essentially the same as that described in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ],
but with the addition of restarts. As far as we know, restarts are essential to our
result. Restarts also seem to be essential in practical SAT solvers.
      </p>
      <p>The organization of the paper is as follows. In Section 2 we de ne Signed
CNF formulas, the speci c families of formulas we study, and binary resolution
for these formulas. The properties of resolution proofs which are central to the
proof are de ned in Section 3. In Section 4 we describe an algorithm which
embodies the core reasoning in (our generalization of) CDCL-R, while Section 5
shows that repeated calls to this algorithm can refute formulas as e ciently
as resolution. In Section 6 we give our generalized CDCL-R algorithm, de ne
p-simulation and give the main theorem. We conclude brie y in Section 7.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Signed CNF Formulas and Resolution</title>
      <p>Let D be a nite set of truth values and P a countably in nite set of multi-valued
propositional atoms. Signed CNF formulas for D are constructed from literals
of the form p2S, where S is a non-empty proper subset of D and p 2 P. (In the
literature on Signed CNF, literals are usually written S:p, but we prefer the set
notation for readability.) Formally S is a string of constant symbols, denoting
elements of D, enumerating the set S. This is typically glossed over, so that S
is used both for the set of truth values and the string representing it.</p>
      <p>
        A clause is a disjunction of literals, and a formula is a conjunction of clauses.
When convenient we identify clauses with sets of literals, and formulas with sets
of clauses. An assignment for formula and truth value set D is a function
mapping the propositional symbols in to D. By \assignment", we often mean
partial assignment. Assignment satis es literal p2S if (p) is in the subset of D
denoted by the string S. De nitions of satisfaction, implication, and equivalence
of CNF formulas follow in the standard manner [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The semantics of formulas
are multi-valued, in that models are multi-valued, but the connectives in Signed
CNF are classical. In complexity analyses, we will assume that D is xed.
      </p>
      <p>A number of variants of this basic logic have been studied. Typical variants
restrict the allowed literals, or impose structure on the truth set D. We consider
the following three. (Unfortunately, terminology is not uniform in the literature,
so our terms may correspond only roughly to those in some other papers.)
1. Multi-Valued CNF (MV-CNF): Formulas as just described, with the
requirement that each propositional symbol p occurs in at most one literal
in any clause.
2. Regular CNF over a lattice (Reg-CNF): Let D = hD; i be a lattice.</p>
      <p>We call a literal p2S regular for D i S is either the upset "i = fs 2 D j
i sg, or the downset #i = fs 2 D j s ig of some i in D. A formula is
regular for D if every literal in is regular for D.</p>
      <sec id="sec-2-1">
        <title>3. Regular CNF with Complements, over a total order (Reg-N-CNF):</title>
        <p>Let D = hD; i be a set with total order. For each literal p2S, there is some
i 2 D for which S is "i, #i, or a complement of one of these, "i or #i.</p>
        <p>For generic remarks, we use the term \signed CNF" or \signed formula", and
we use one of these speci c terms when remarks apply to a speci c case.
Example 1. Consider the signed formulas with D = f0; 1g. These are equivalent
to classical CNF formulas.</p>
        <p>Example 2. Consider regular formulas for D = hD; &lt;i, where, D is the set
f s 0 1 ; s 1 1 ; s 2 1 ; : : : ss 11 g, and &lt; is the standard order on Q. Formulas for D
correspond to the standard multi-valued logics with nite truth value set, which
were the original motivation for the study of signed CNF formulas.</p>
        <p>The complement of a regular atom is not necessarily regular, and may not
even be equivalent to any disjunction of regular atoms. Thus, the regular CNF do
not allow complements of literals. We included the third case, regular CNF over
a total order, with complements, because it corresponds naturally to standard
multi-valued logics. However, the proof for Multi-Valued CNF captures this case,
so we mention it directly only on occasion.
2.1</p>
      </sec>
      <sec id="sec-2-2">
        <title>Signed Resolution</title>
        <p>Let Signed Binary Resolution be the following derivation rule
p2S _ A p2R _ B
p2(S \ R) _ A _ B</p>
        <p>We say the two antecedent (top) clauses in (1) were resolved on p to produce
the resolvent (bottom) clause. Two literals p2S and p2R clash if S 6= R. If R \ S
is non-empty, we call the literal p2(R \ S) the residue, and otherwise we say that
the clash is annihilating. A pair of clashing literals which are annihilating are
inconsistent.
(1)</p>
        <p>Rule (1) is the basis of resolution proof systems for our three families, but we
need two variants. In each case, a resolution derivation of clause C from a set
of clauses is a sequence of clauses hC1; : : : ; Csi, where each Ci is either in or
derived from two earlier clauses in by the resolution rule, and Cs = C. The
length of the derivation is s. A refutation of is a derivation of the empty clause,
denoted . A resolution rule is sound and refutation complete for a family of
formulas if every formula in the family is unsatis able i it has a refutation using
the rule.</p>
        <p>
          Multi-Valued CNF: We obtain a sound and refutation-complete proof system
if we imbue rule (1) with implicit merging and annihilation [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. That is:
1. Whenever (S \ R) is empty, the false \literal" p2; is omitted from the
resolvent;
2. If two literals p2S and p2R with the same propositional symbol occur in
the resolvent, they are replaced by p2(S [ R).
        </p>
        <p>
          Regular CNF: In this case, arbitrary literals on the same propositional symbol
cannot be merged because the result may not be regular. Hence, we allow
a clause to contain multiple literals on the same propositional symbol. The
following restricted signed resolution rule is sound and complete for regular
formulas over a lattice [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ].
        </p>
        <p>(p2"i _ A) (p2#j _ B)
(A _ B)
provided i 6 j:
(2)</p>
      </sec>
      <sec id="sec-2-3">
        <title>Regular CNF with Complements: The same as given for MV-CNF.</title>
        <p>In the restriction for Regular formulas, and also in the case of Regular
formulas with negation, there are no residuals: the clashing literals are always
annihilated.</p>
        <p>If is a set of clauses and L a set or sequence of literals, we may write ; L
as an abbreviation for [ f(l) j l 2 Lg. We say literal p2S is at least as strong
as p2R if S R, and stronger if S ( R. If p2S is at least as strong as p2R,
then also (p2S) j= (p2R).
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Empowering and Absorbed Clauses</title>
      <p>
        The ability of CDCL-R to e ciently simulate resolution proofs is closely tied to
a property of resolution refutations involving unit resolution. (See [
        <xref ref-type="bibr" rid="ref1 ref14">14, 1</xref>
        ] for the
original versions, for classical CNF.) A unit clause is a clause with exactly one
literal, and unit resolution is the use of the resolution rule when at least one
adnertievceeddefnrotmis a buyniutncitlaruesseo.luWtieonwarliotene. W`ure w(lr)i,teor si`umrplyif th`eurrel,isifa (rle)fuctaantiobne
of using only unit resolution. As in the classical case, with appropriate data
structures, it is possible to check if `ur l or `ur in linear time. In MV-CNF,
unit resolution does not necessarily annihilate the literal of the unit clause, unlike
in the classical case.
      </p>
      <p>For a set or sequence of literals L, we denote by L the of literals which are
the complements of literals in L. In particular, if C is a clause, then C the set
of complements of literals in C. Thus, ; C `ur indicates, intuitively, that the
restriction of obtained by setting all literals of C false can be refuted by unit
propagation. For regular formulas, this operation is always de ned, since the
complement of a regular literal need not be regular. For this case, we make use
of the following sets. For each sequence L = l1; l2; : : : lk of literals, L denotes the
set of sets of literals of the form C = (l10; l20; : : : lk0) where each li0 is inconsistent
with li. In particular, for each clause C = (l1; l2; : : : lk), we denote by C the set of
sequences of literals of the form L = l10; l20; : : : lk0 (except order does not matter)
where each li0 is inconsistent with li.</p>
      <sec id="sec-3-1">
        <title>De nition 1 (Empowering and Absorbed Clauses) Let be a set of clauses</title>
        <p>and C a clause with j= C. For sets of MV-CNF or Reg-N-CNF formulas
(those with complements) we say C is a-empowering for i C = (A _ a) and
1. ; C `ur ,
2. ; A 6 `uurr ,</p>
        <sec id="sec-3-1-1">
          <title>3. ; A 6 ` b, for any literal b that is inconsistent with a.</title>
          <p>For Reg-CNF, which does not have complements, we say that C is a-empowering
for i C = (A _ a) and
1. For some C0 2 C;,A0 ;6 C`ur0 `ur ,
2. If A0 2 A then ,
3. If A0 2 A, and b a literal inconsistent with a, then ; A0 6 `ur b.
C is empowering for
by otherwise.</p>
          <p>if it is a-empowering, for some a 2 C, and is absorbed</p>
          <p>Intuitively, a clause C is empowering for if ; C has a unit refutation, but
; A does not, where C = (A _ a). Notice that ; C is with one or more unit
clauses added, in contrast to [ fCg, which is with one more clause.</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>Lemma 1 (Existence of Empowering Clauses). Let be a set of signed</title>
        <p>clauses for which 6`ur , and a signed resolution refutation of . Then
contains a clause that is empowering for .</p>
        <p>Proof. The rst part may be expressed identically for formulas with or without
complements. Let C be the rst clause in that does not satisfy condition 1
of De nition 1. Such a clause exists, because the su ces if no earlier clause
does. C is the resolvent of two earlier clauses of , say C1 = (p2S1 _ A1), and
C2 = (p2S2 _ A2), where p2S1 and p2S2 clash. We claim one of C1 or C2 is
empowering for . Both are logically implied by , because they are in and
signed resolution is sound. Both satisfy condition 1 of De nition 1, by choice of
C.</p>
        <p>We complete the argument for formulas with complements as follows. Both
satisfy condition 2 of De nition 1, because C = (p2(S1 \ S2) _ A1 _ A2), so if
; A1 `ur or ; A2 `ur then ; C `ur , contradicting choice of C. Now, suppose
both C1 and C2 fail condition 3 of De nition 1. That is, for some R1 S1 and
R2 S2, we have ; A1 `ur (p2R1) and ; A2 `ur (p2R2). Resolving (p2R2) and
(p2R1) produces a unit clause containing atom p2(R1 \ R2), which is at least
as strong as p2(S1 \ S2). Then ; C `ur , again contradicting choice of C. So
at least one of C1 or C2 is empowering for .</p>
        <p>The completion for formulas without complements is the same, but messier:
Both C1 and C2 satisfy condition 2, because C = (p2(S1 \ S2) _ A1 _ A2), so if
; A01 `ur for some A01 2 A1 or ; A02 `ur for some A02 2 A2, then ; C0 `ur
for some C0 2 C, contradicting choice of C. Now, suppose both C1 and C2 fail
condition 3. That is, for some A01 2 A1, A02 2 A2, R1 S1 and R2 S2, we
have that ; A01 `ur (p2R1) and ; A02 `ur (p2R2). Resolving (p2R2) and (p2R1)
produces a unit clause containing atom p2(R1 \ R2), which is at least as strong
as p2(S1 \ S2). Then there is a C0 2 C with ; C0 `ur , again contradicting
choice of C. So either C1 or C2 is empowering for .
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Probing with Learning</title>
      <p>The core of the CDCL algorithm can be viewed as a back-and-forth between two
processes, one which guesses at partial assignments, and one which derives new
clauses. We rst consider an algorithm, that we call Probe-and-Learn, which
embodies a \single round" of this interaction. Describing the algorithm requires
some terminology.</p>
      <p>For multi-valued formulas, the guessing involves restrictions on assignments,
rather than assignments. We will call such restrictions \decision sequences".
De nition 1. A decision sequence for D and
of distinct literals such that:
is a sequence
= ha1; a2; : : : asi</p>
      <sec id="sec-4-1">
        <title>1. If p2S appears in , then S D, and p appears in .</title>
        <p>2. If ai is p2S, then S \ TfR j p2R = aj and j &lt; ig 6= ;. (That is, each
successive literal further restricts the possible assignments.)
3. The set of literals in is satis able.</p>
        <p>For any non-empty decision sequence
maximal proper pre x = hl1; : : : lk 1i.
= hl1; : : : lk 1; lki, let
denote the</p>
        <p>Each decision sequence de nes a set of truth assignments, namely those
consistent with each literal in the sequence. For any decision sequence and literal
l, we say that makes l false if no assignment consistent with is consistent
with l. makes l true if every assignment consistent with satis es l.</p>
        <p>Unit propagation is a central feature in CDCL algorithms, and in particular
of the \back-and-forth" process embodied in Probe-and-Learn. We will de ne
unit propagation for multi-valued formulas, as used in our algorithm, in terms
of decision sequences.</p>
        <p>De nition 2 (UP( ; )) For any clause set and decision sequence for ,
we denote by UP( ; ) the decision sequence 0 de ned by the xpoint of the
following operation:</p>
        <p>If contains a clause C = (l _ B) where
but neither makes l true or false, extend
makes every literal of B false,
with l.</p>
        <p>Unit propagation corresponds to unit resolution, in a context where we are
interested in collecting implied restrictions on truth assignments rather than
derived clauses. In particular, UP( ; ) makes a clause of false if and only if
[ `ur .</p>
        <p>A second process, closely related to unit propagation, involves derivation of
clauses called asserting clauses.</p>
        <sec id="sec-4-1-1">
          <title>De nition 2 (Con ict Clause and Asserting Clause). Clause C is an</title>
          <p>asserting clause for clause set and decision sequence i
1. ; C `ur , or in the case of Reg-CNF, for each A 2 C, ; A `ur ;
2. For each literal a 2 C, there is a literal at least as strong as a, s.t. ; `ur ;
3. For exactly one literal a 2 C, ; 6`ur , for any atom at least as strong
as a.</p>
          <p>C is a con ict clause for and if it satis es only the rst two conditions.</p>
          <p>The Probe-and-Learn algorithm, is presented as Algorithm 1. It takes a clause
set and decision sequence as an argument. If unit propagation from satis es
, the procedure returns. If unit propagation from makes a clause of false,
we call this a con ict. If necessary, the procedure extends (by unspeci ed
means) until one of these cases holds. In the case of a con ict, the
handlecon ict procedure is called. Handle-con ict returns an asserting clause and an
appropriate pre x of . The newly derived clause C is constructed so that
makes all literals but one false, so after adding it to , unit propagation will
set at least one more literal and satisfy this clause. It is possible that further
propagation happens, and a sequence of new clauses is derived and added to .</p>
          <p>Algorithm 1: Probe And Learn</p>
          <p>Input: Finite poset D, signed clause set and decision sequence .</p>
          <p>Output: Clause set 0, and a decision sequence 0
12 whilea UmPin(im;al)e6jx=tensaionndof 62s.t. aeinthder ;U P`u(r ; d)oj= or ; `ur
3 ; C handle-con ict( ; ). ;
4 [ fCg ;
5 end
6 return ; ;
;</p>
          <p>There is no restriction on the method by which handle-con ict can generate
an asserting clause. For correctness of Probe-and-Learn, it is su cient that,
whenever the call handle-con ict( ; ) returns 0; C, then
1. 0 is a proper pre x of ;
2. C is an asserting clause for 0; , as de ned in De nition 2, unless it is the
empty clause.
3. if C is the empty clause, is empty.</p>
          <p>For the p-simulation results of Section 6.1, handle-con ict() must run in
polynomial time. For the concrete simulation bounds of Sections 5 and 6, it
must run in linear time (as is the case in the standard implementations in SAT
solvers.)</p>
          <p>The standard \clause-learning schemes" used in CDCL SAT solvers involve
a resolution derivation closely connected to the unit propagation sequence that
establishes a con ict. A generalized version of this process can also be used in
our multi-valued handle-con ict. In the following sub-section, we demonstrate
the derivation of a particular one. (This one derives a clause analogous to the
soballed \1UIP asserting clause", which is the basis of the asserting clause derived
in most CDCL SAT solvers.)
4.1</p>
        </sec>
        <sec id="sec-4-1-2">
          <title>Asserting Clause Derivation</title>
          <p>We need to show that, whenever Algorithm 1 calls handle-con ict, an asserting
clause exists and can be constructed e ciently. For the formula with
complements, this is trivial: If is a minimal decision sequence with ; `ur , then ,
the set of complements of decision literals, is an asserting clause for S = h ; i.
For the case of regular formulas, we give a concrete construction, upon which
implementation of handle-con ict can be based. This construction is the
generalization of the standard method used in most CDCL SAT solvers.</p>
          <p>Consider a decision sequence . We may carry out unit propagation in
from , incrementally constructing extensions of by appending literals that unit
propagation sets. Each time we observe a clause C = (a_A) for which the current
decision sequence makes every literal in A false but leaves a undetermined, we
append a to the decision sequence and call C the \reason for a". A con ict
is detected when a literal that is inconsistent with a is already in the decision
sequence (in other words, C has been made false.) Let denote the resulting
decision sequence, up to but not including the con icting literal. For each literal
l in , de ne the decision level of l to be the size of the minimum pre x l of
such that ; l `ur l. If l is in , then its decision level is its index in . If l is set
by unit propagation from only its decision level is 0.</p>
          <p>For signed formulas, when a con ict is detected, we must have a clause C =
(A _ l), with l = p2S, in which all atoms are made false by the sequence l. This
does not entail existence of a clause (B _ p2R), where R \ S = ;. The reason
is that resolution steps need not be annihilating (there may be a residue of the
clashing literals). If a clause C = (A_p2R_l), involved in unit propagation, is the
reason for extending the decision sequence with l, then some set of previously
derived unit clauses on the atom p annihilated p2R. It does imply that the
collection of literals on propositional symbol p which appear on l eliminate all
values in S as candidates for assignment to p. More precisely, among the literals
in l is a sub-sequence of literals p = hp2R1; : : : p2Rri such that ([Ri) \ S = ;.
Mark each literal, of each clause, involved in the unit propagation sequence, with
this sequence of literals. We begin with a clause C0 = C, and generate a sequence
of clauses Ci, by means of the following algorithm:</p>
          <p>Algorithm 2: Signed-CNF 1UIP Clause Derivation
1 while C contains more than one literal with decision level j j do
2 p2S the last literal in which clashes with a literal in C;
3 p2R a literal of C marked with p2S;
4 A the reason for p2S;
5 C the resolvent of C and A;
6 end</p>
        </sec>
        <sec id="sec-4-1-3">
          <title>7 return C</title>
          <p>Lemma 2. Each clause generated by Algorithm 2 is a con ict clause, and the
clause returned by the algorithm is an asserting clause, according to De nition 2.
Proof. Let C0; C1; : : : be the sequence of clauses derived by Algorithm 2. C0 is
trivially a con ict clause. Assume that Ci = (p2S _ Bi) is a con ict clause,
that p2R is the literal of Ci identi ed in line 3, and that A = (p2S _ Ai) is
the reason for p2S being added to the assignment. Then Ci+1 = (p2(;SC0\`uRr) _
Bi _ Ai) is the resolvent of Ci and Ai. Clearly, for any C0 2 Ci+1, ,
because, intuitively, setting all literals of Ci+1 false makes A e ectively unit,
thus setting p2R, after which we use the fact that Ci is a con ict clause. Since
unit propagation from makes Ci false and makes A unit, it also makes Ci+1
false. Thus, Ci+1 is a con ict clause.</p>
          <p>
            The clause returned by this algorithm is the analog of the 1UIP clause used in
standard CDCL-R solvers, and we believe is the same clause as generated by the
method in [
            <xref ref-type="bibr" rid="ref11">11</xref>
            ]. If we modify the termination condition of the loop in Algorithm 2
to \C contains a literal not in ", this corresponds to the DECISION learning
scheme of classical CDCL. In this case the asserting clause returned contains
only literals which clash with decision literals.
4.2
          </p>
        </sec>
        <sec id="sec-4-1-4">
          <title>Running Time of Probe-and-Learn</title>
          <p>Proposition 1. Unit propagation and derivation of an asserting con ict clause
can be carried out in time linear in j j.</p>
          <p>Proposition 2. Let
be a decision sequence for
s.t.</p>
          <p>ur
[ `
. Then
1. Probe-and-Learn( ; ), using a poly-time handle-con ict, runs in time
polynomial in j j.</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>2. Probe-and-Learn( ; ), with linear-time handle-con ict, runs in time O(j j2).</title>
        <p>Proof. Each iteration of the body of the loop performs unit propagation and
executes handle-con ict, which performs the asserting clause derivation. On each
iteration of the loop, except possibly the terminating iteration in the case that
a satisfying assignment is found, is set to a proper pre x of its previous value.
The maximum length of decision sequence is jDj j j. We assume D is xed, so
the total time spent in the loop is O(j j (time for handle-con ict)).
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Simulating Resolution with Probe-and-Learn</title>
      <p>Here, we show that, for any resolution refutation of MV-CNF or Reg-CNF
formula , there is a sequence of calls to probe-and-learn which refutes in
time polynomial in the combined size of and . We begin by showing that
any empowering clause can be absorbed by a sequence of calls to
probe-andlearn.</p>
      <p>First, suppose that C = (A _ a) is an a-empowering clause for . Let be
a decision sequence consisting of the literals of an element of A, in any order,
f ollowed by a literal which is inconsistent with a. If handle-con ict() uses the
DECISION learning scheme, then Probe-and-Learn( ; ) extends with at least
one clause which is in , and thus it absorbs C.</p>
      <p>When probe-and-learn does not use the DECISION learning scheme, it is
a little more complicated, because the clauses derived might not include any
literals based on atoms from C. However, with a suitable sequence of calls we
can be sure to derive clauses which make C absorbed.</p>
      <p>Lemma 3. Suppose C = (A_a) is a-empowering for . Then there is a sequence
of calls to probe-and-learn which generate an extension 0 of such that C is
absorbed by 0. Moreover, the total execution time for this sequence of calls is
polynomial in the size of , provided the time for handle-con ict is also.
Proof. Let be a decision sequence from A, followed by a literal which is
inconsistent with a. Probe-and-learn must extend = 0 to a set 1 by adding
at least one derived clause, which (because it is an asserting clause) has fewer
literals than . As long as C remains empowering for i, we call probe-and-learn
again as follows. On each repetition, since C is still a-helpful, no con ict is found
until after a is asserted. It follows that each asserting clause derived has a di
erent asserted atom, so the number of repetitions is bounded by the product of j j
and jDj. Moreover, eventually a itself, or some atom stronger than a, will be the
asserted atom, at which point C is no longer a-helpful. If C is still helpful, we
repeat for each atom b for which C is still b-helpful, after which C is no longer
helpful for . The entire sequence of calls requires time polynomial in j j.</p>
      <p>To see that an appropriate sequence of calls to probe-and-learn can refute
in time not much longer than the size of some given refutation, we identify a
sequence of empowering clauses, and absorb each.</p>
      <p>Lemma 4. Let be a set of signed clauses, and a resolution refutation of
. Then, there is a sequence of calls to probe-and-learn, which refutes in
time polynomial in the combined sizes of and , provided handle-con ict is
polynomial time.
j j.</p>
      <p>Pforloloowf.s.WIfe gie`nurera,tewea asreeqduoennec.e Ot0h:e:r:wisse,ofletsuApebresetthseofrst,cwlaiutshe in0 = tha,t aiss
empowering for i. By Lemma 3, there is a sequence of calls to probe-and-learn
which generates a superset of i for which A is not empowering. Let this be
i+1. The total execution time is polynomial at most j j times a polynomial in
6</p>
    </sec>
    <sec id="sec-6">
      <title>CDCL with Restarts</title>
      <p>The CDCL algorithm with restarts (CDCL-R) can be described in terms of a
sequence of calls to Probe-And-Learn. This is illustrated by Algorithm 3.</p>
      <p>Algorithm 3: Con ict-Directed Clause Learning with Restarts (CDCL-R)
Input: nite poset D and nite set
Output: SAT or UNSAT
// Clause set, initialized to the input clauses. ;
// Decision sequence, initialized to empty. ;
of signed clauses for D.
4
5
6
7
8
9
10
11 end
1
2 hi
3 repeat</p>
      <p>; Probe-and-Learn(D; ; ) ;
if U P ( ) j= then</p>
      <p>return SAT
if = hi then</p>
      <p>return UNSAT
if Time to Restart then</p>
      <p>hi</p>
      <p>While many details have been abstracted away, Algorithm 3 is essentially the
algorithm implemented by most CDCL-based solvers. It begins with the empty
decision sequence. In the rst call to Probe-and-Learn, the decision sequence
is extended until a clause is made false, after which clause learning and
backjumping are carried out (by handle-con ict, in Probe-and-Learn). In subsequent
executions of the loop body, the decision sequence resulting from the most recent
handle-con ict is extended until either a satisfying assignment is produced, or
Probe-and-learn again nds a con ict.</p>
      <p>At this level of abstraction, the signed version and classical version are not
distinguishable, except for the input parameter D. We make D argument to
Probe-and-Learn to make explicit the fact that Probe-and-Learn (and, in
particular, handle-con ict), must be appropriate to D and the class of formulas in
question. Further, if D is of size 2, then with appropriate choice for
Probe-andLearn, this algorithm is equivalent to the classical CDCL. Our algorithm does
not allow for deletion of learned clauses, because the proof does not allow for
this, but this can be trivially added.</p>
      <p>Since CDCL-R can be viewed simply as a repeated application of
Probe-andLearn, with possible restarts, it is straightforward to see that CDCL-R can be
guided to refute a formula with a resolution refutation
the size of .
in time polynomial in</p>
      <sec id="sec-6-1">
        <title>De nition 3 (Extended Decision Sequence for CDCL-R) An extended de</title>
        <p>cision sequence for CDCL-R on input , is a nite sequence of symbols
satisfying:
1. each symbol is either a literal of or the distinguished symbol R, (for \restart"),
2. each maximal sub-sequence without an R is a decision sequence for .</p>
        <p>We may take two views on extended decision sequences. On one view, we
may take it as a record or witness of an actual execution of CDCL-R. On the
other, we may view it as a string to control an intended execution of CDCL-R.
Lemma 5. If has a resolution refutation of size s, then there is an execution
of CDCL-R on input which refutes in time polynomial in s.
Proof. (Sketch) The only change to the strategy for repeated Probe-and-Learn
given above is that, after each Probe-and-Learn call we restart, so that
Probeand-Learn is always called with the empty decision sequence. Thus, instead of
implementing the strategy for probes by setting the arguments to
Probe-andLearn, we do it by having Probe-and-Learn select (on line 1) the decision
sequence speci ed by the strategy.
6.1</p>
      </sec>
      <sec id="sec-6-2">
        <title>Proof Complexity and p-Simulation</title>
        <p>
          Propositional proof complexity is the study of the relative power of proof systems
for propositional logic, measured by minimum length of proofs for tautological
formulas. The abstract de nition of propositional proof system introduced in the
seminal paper of Cook and Reckow [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], can be trivially adapted to refutation
proofs for unsatis able signed CNF formulas (or, indeed, any co-NP complete
set).
        </p>
        <sec id="sec-6-2-1">
          <title>De nition 4 A refutation proof system for signed CNF formulas for domain D</title>
          <p>is a set of strings L (the proofs) with a polytime function VL (a veri er for L)
such that VL(x) = if x is an L-proof that is unsatis able, and VL(x) = ?
otherwise.</p>
          <p>Proof system A p-simulates proof system B if there exists a polynomial
function poly(), such that for every unsatis able formula and every B-proof B
of , there is an A-proof A of with j A j poly(j B j).</p>
          <p>
            As a simplifying convention, we require that the minimum size of a proof of
is j j. This is not standard in proof complexity, but is necessary for relevance
to practical satis ability algorithms, and is followed also in, e.g., [
            <xref ref-type="bibr" rid="ref14 ref2 ref5 ref9">2, 5, 9, 14</xref>
            ].
This is because a formula may be large but have a tiny proof. However, any
reasonable satis ability solver begins by reading the entire formula. Moreover,
any reasonable CDCL-R-style solver begins by executing unit propagation, which
may visit the entire formula.
          </p>
          <p>To view a satis ability algorithm as a proof system, we may take any trace of
the algorithm on an unsatis able clause set as a proof of the unsatis ability of
, provided that the trace re ects the running time of the algorithm, and that
we can e ciently verify that the trace corresponds to an execution that reports
\unsatis able". For present purposes, we may use extended decision sequences
as CDCL-R proofs.</p>
          <p>Theorem 1. CDCL-R for MV-CNF (resp. Reg-CNF), with polytime
handlecon ict, p-simulates signed resolution for MV-CNF (resp. Reg-CNF).
Proof. (Sketch) To show that CDCL-R p-simulates resolution, we show that
for any resolution refutation of clause set , there is an extended decision
sequence s.t., when CDCL-R is executed in accordance with on input , it
runs in time polynomial in the length of , and reports UNSAT. This is given
to us by Lemma 5.</p>
        </sec>
      </sec>
      <sec id="sec-6-3">
        <title>Corollary 1 (Pipatsrisawat &amp; Darwiche) CDCL-R p-simulates resolution.</title>
        <p>
          To see this, it is enough to observe that signed formulas and resolution, when
jDj = 2, are equivalent to the classical case. We state this corollary to point out
that our result is indeed a generalization of that in [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
        </p>
        <p>Theorem 2. Signed resolution p-simulates CDCL-R for MV-CNF and
RegCNF formulas, with 1UIP handle-con ict.</p>
        <p>Proof. (Sketch) Consider an execution of CDCL-R that halts and outputs
\UNSAT", and let the extended decision sequence corresponding to this execution.
The size of is certainly polynomial in the length of execution. The set of clauses
produced by handle-con ict, together with the input clauses, together with the
clauses generated by unit propagation when unsatis ability is nally determined,
constitute a resolution refutation. A symbol of is consumed for every clause
produced by handle-con ict, so the set of learned clauses at the end is of size
polynomial in the size of . The set of unit clauses derived by unit propagation
at the end is certainly polynomial in the size of the set of learned clauses plus the
input set. It follows that the entire refutation is of size polynomial in j j + j j.
7</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Discussion</title>
      <p>
        We have presented a natural generalization of the SAT algorithm known as
CDCL with restarts to signed CNF formulas. Adapting the proofs from [
        <xref ref-type="bibr" rid="ref1 ref14">14, 1</xref>
        ]
we showed that the algorithm p-simulates natural forms of binary resolution for
these formulas. In particular, our proof applies to general multi-valued CNF
formulas, to regular formulas when the truth value set is a lattice, and to regular
formulas with complements when the truth value set has a total order.
Consideration of implementation is beyond the scope of this paper, but we consider the
algorithm to be e ectively implementable, and thus a possible basis for practical
model- nding or theorem-proving systems.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Albert</surname>
            <given-names>Atserias</given-names>
          </string-name>
          , Johannes Klaus Fichte, and
          <string-name>
            <given-names>Marc</given-names>
            <surname>Thurley</surname>
          </string-name>
          .
          <article-title>Clause-learning algorithms with many restarts and bounded-width resolution</article-title>
          .
          <source>J. Artif. Intell. Res. (JAIR)</source>
          ,
          <volume>40</volume>
          :
          <fpage>353</fpage>
          {
          <fpage>373</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Paul</given-names>
            <surname>Beame</surname>
          </string-name>
          , Henry Kautz, and
          <string-name>
            <given-names>Ashish</given-names>
            <surname>Sabharwal</surname>
          </string-name>
          .
          <article-title>Towards understanding and harnessing the potential of clause learning</article-title>
          .
          <source>Journal of Arti cial Intelligence Research</source>
          ,
          <volume>22</volume>
          :
          <fpage>319</fpage>
          {
          <fpage>351</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>B.</given-names>
            <surname>Beckert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Hahnle</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Manya</surname>
          </string-name>
          .
          <article-title>The SAT problem of signed CNF formulas</article-title>
          . In Basin ET al, editor,
          <source>Labelled Deduction, chapter 1</source>
          . Kluwer Academic Applied Logic Series,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Bernhard</given-names>
            <surname>Beckert</surname>
          </string-name>
          ,
          <article-title>Reiner Hahnle, and Felip Manya. The 2-sat problem of regular signed cnf formulas</article-title>
          .
          <source>In Proc. 30th IEEE International Symposium on Multi-Valued Logic (ISMVL</source>
          <year>2000</year>
          ), pages
          <fpage>331</fpage>
          {
          <fpage>336</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Samuel</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Buss</surname>
          </string-name>
          , Jan Ho mann, and Jan Johannsen.
          <article-title>Resolution trees with lemmas: Resolution re nements that characterize DLL algorithms with clause learning</article-title>
          .
          <source>Logical Methods in Computer Science</source>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Cook</surname>
          </string-name>
          and
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Reckhow</surname>
          </string-name>
          .
          <article-title>The relative e ciency of propositional proof systems</article-title>
          .
          <source>J. Symbolic Logic</source>
          ,
          <volume>44</volume>
          (
          <issue>1</issue>
          ):
          <volume>23</volume>
          {
          <fpage>46</fpage>
          ,
          <year>1979</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Reiner</given-names>
            <surname>Ha</surname>
          </string-name>
          <article-title>hnle. Short conjunctive normal forms in nitely valued logics</article-title>
          .
          <source>J. Log. Comput.</source>
          ,
          <volume>4</volume>
          (
          <issue>6</issue>
          ):
          <volume>905</volume>
          {
          <fpage>927</fpage>
          ,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Reiner</surname>
            <given-names>H</given-names>
          </string-name>
          ahnle.
          <article-title>Exploiting data dependencies in many-valued logics</article-title>
          .
          <source>Journal of Applied Non-Classical Logics</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Philipp</given-names>
            <surname>Hertel</surname>
          </string-name>
          , Fahiem Bacchus, Toniann Pitassi, and Allen Van Gelder.
          <article-title>Clause learning can e ectively p-simulate general propositional resolution</article-title>
          .
          <source>In Proc., 23rd National Conference on Arti cial Intelligence (AAAI-08)</source>
          , Volume
          <volume>1</volume>
          , pages
          <fpage>283</fpage>
          {
          <fpage>290</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. H.
          <string-name>
            <surname>Kautz</surname>
            , E. Horvitz,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Ruan</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Gomes</surname>
            , and
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Selman</surname>
          </string-name>
          .
          <article-title>Dynamic restart policies</article-title>
          .
          <source>In Proc., 19th National Conference on Arti cial Intelligence (AAAI-2002)</source>
          , pages
          <fpage>674</fpage>
          {
          <fpage>681</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Cong</surname>
            <given-names>Liu</given-names>
          </string-name>
          , Andreas Kuehlmann, and
          <string-name>
            <surname>Matthew</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Moskewicz</surname>
          </string-name>
          .
          <article-title>Cama: A multivalued satis ability solver</article-title>
          .
          <source>In Proc., 2003 Int'l. Conf. on Computer Aided Design (ICCAD-2003)</source>
          , pages
          <fpage>326</fpage>
          {
          <fpage>333</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Joo</surname>
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Marques-Silva</surname>
          </string-name>
          and
          <article-title>Karem A. Sakallah. Grasp: A search algorithm for propositional satis ability</article-title>
          .
          <source>IEEE Transactions on Computers</source>
          ,
          <volume>48</volume>
          (
          <issue>5</issue>
          ):
          <volume>506</volume>
          {
          <fpage>521</fpage>
          , May
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. D.G. Mitchell.
          <article-title>A SAT solver primer</article-title>
          .
          <source>EATCS Bulletin</source>
          ,
          <volume>85</volume>
          :
          <fpage>112</fpage>
          {
          <fpage>133</fpage>
          ,
          <year>February 2005</year>
          . The Logic in Computer Science Column.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>K.</given-names>
            <surname>Pipatsrisawat</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Darwiche</surname>
          </string-name>
          .
          <article-title>On the power of clause-learning SAT solvers as resolution engines</article-title>
          .
          <source>Arti cial Intelligence</source>
          ,
          <volume>175</volume>
          (
          <issue>2</issue>
          ):
          <volume>512</volume>
          {
          <fpage>525</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>