<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>ASPQ: An ASP-Based 2QBF Solver</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Giovanni Amendola</string-name>
          <email>amendola@mat.unical.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Carmine Dodaro</string-name>
          <email>dodaro@mat.unical.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesco Ricca</string-name>
          <email>ricca@mat.unical.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Mathematics and Computer Science University of Calabria</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Answer Set Programming (ASP) is an established logic-based programming paradigm which has been successfully applied for solving complex problems. Since ASP can model problems up to the second level of the polynomial hierarchy, it can be used to model and solve the 2QBF problem. In this paper we show how to obtain a fairly effective 2QBF solver by just resorting to state-of-the-art ASP solvers.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Answer Set Programming (ASP) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] is a declarative programming paradigm that has
been developed in the field of logic programming and nonmonotonic reasoning. The
idea of ASP is to represent a given computational problem by means of a logic program
whose stable models [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] (or answer sets) correspond to the desired solutions, and then
to use an ASP solver to actually compute the stable models.
      </p>
      <p>
        ASP has been used in numerous scientific applications in the areas of artificial
intelligence [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], bioinformatics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], databases [
        <xref ref-type="bibr" rid="ref15 ref7">7, 15</xref>
        ], and game theory [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Moreover,
ASP is attracting increasing interest also beyond the scientific community, and counts
already some successful application in industrial products [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. ASP has become a
popular choice for solving complex problems since it combines an expressive language with
efficient implementations. Indeed, the results of the latest ASP Competition series [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
witness the continuous improvements achieved in the field of ASP solving.
      </p>
      <p>
        The core language of ASP, which features disjunction in rule heads and
nonmonotonic negation in rule bodies, can be used to solve all problems at the second level of the
polynomial hierarchy. This result was obtained by Eiter and Gottlob [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] that provided
a reduction from 2QBF to the problem of verifying the existence of an answer set of
a disjunctive ASP program. Given the large progress measured in the last few years in
ASP solving, it is natural to ask whether this solving technology can applied profitably
also for solving 2QBFs.
      </p>
      <p>In this paper we provide a first answer to this question, by showing that a fairly
effective 2QBF solver can be obtained by using state-of-the-art ASP solving technology.
To this end, we implemented a tool whose input is a formula in QDIMACS format and
produces as output the corresponding ASP program applying the encoding proposed
by Eiter and Gottlob. The ASP program obtained is subsequently evaluated combining
two state-of-the-art ASP solvers (that employ different techniques for handling hard
problems). The resulting proof-of-concept 2QBF solver, called ASPQ, entered as
noncompetitive participant the QBF competition in 2016. ASPQ obtained a fairly acceptable
result in the 2QBF track, obtaining (virtually) the fifth place, thus performing better than
various native QBF solvers. These results witness that the capabilities of state-of-the-art
ASP solvers can be exploited for solving 2QBF.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Answer Set Programming</title>
      <p>
        In this section we overview the language of ASP. Following the traditional grounding
view [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], we concentrate on programs over a propositional signature L . A disjunctive
rule r is of the form
a1 _
_ al
b1; :::; bm; not bm+1; :::; not bn;
(1)
where all ai and b j are atoms (from L ) and l 0, n m 0 and l + n &gt; 0; not
represents negation-as-failure. The set H(r) = fa1; :::; al g is the head of r, while B+(r) =
fb1; :::; bmg and B (r) = fbm+1; : : : ; bng are the positive body and the negative body of
r, respectively; the body of r is B(r) = B+(r) [ B (r). We denote by At(r) = H(r) [ B(r)
the set of all atoms occurring in r. A rule r is a fact, if B(r) = 0/ (we then omit ); a
constraint, if H(r) = 0/ ; normal, if jH(r)j 1; and positive, if B (r) = 0/ . A (disjunctive
logic) program P is a finite set of disjunctive rules. P is called normal [resp. positive] if
each r 2 P is normal [resp. positive]. We let At(P) = Sr2P At(r).
      </p>
      <p>
        Any set I L is an interpretation; it is a model of a program P (denoted I j= P) if,
and only if, for each rule r 2 P, I \ H(r) 6= 0/ if B+(r) I and B (r) \ I = 0/ (denoted
I j= r). A model M of P is minimal, if, and only if, no model M0 M of P exists. We
denote by MM(P) the set of all minimal models of P and by AS(P) the set of all answer
sets (or stable models) of P, i.e., the set of all interpretations I such that I 2 MM(PI ),
where PI is the Gelfond-Lifschitz reduct [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] of P with respect to I, i.e., the set of rules
a1 _ ::: _ al b1; :::; bm, obtained from rules r 2 P of form (1), such that B (r) \ I = 0/ . A
program P such that AS(P) 6= 0/ is called coherent, otherwise it is called incoherent [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
Example 1. Consider the program P = fb _ c not a; d c; not bg. It has the
minimal models MM(P) = ffag; fbg; fc; dgg. Instead, the set of all answer sets is AS(P) =
ffbg; fc; dgg. Hence, P is coherent. Note that I = fag is not an answer set of P, since I
is not a minimal model of PI = fd cg.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Encoding 2QBF in ASP</title>
      <p>
        In this section, we introduce the translation from 2QBFs to logic programs proposed by
Eiter and Gottlob [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] to prove the S2P-hardness of checking whether a disjunctive logic
program has some answer set.
      </p>
      <p>To describe the translation, let F = 9X 8Y F be a quantified boolean formula, where
we may assume that X = fx1; : : : ; xeg, Y = fy1; : : : ; yag and F = D1 _ : : : _ Dm, such that
Di = Li;1 ^ : : : ^ Li;k, where 1 k a + e and Li; j are literals over X [Y . For every atom
z 2 X [ Y , we introduce a fresh atom z0. Moreover, let s be a function mapping literals
from atoms z 2 X [ Y to atoms as follows:
s (L) =
z0 if L = :z;</p>
      <p>L otherwise
Algorithm 1: ASPQ-main</p>
      <p>Input : A 2-QBF formula F</p>
      <p>
        Output: SAT or UNSAT
1 begin
2 Tbloqqer := 120s; Tclasp := 60s
3 F := BLOQQER (Tbloqqer, F);
4 if F = &gt; then return SAT;
5 if F = ? then return UNSAT;
6 P := QDimacs2ASP(F);
7 res := CLASP (Tclasp, P );
8 if res = UNKNOWN then res := WASP (P );
9 if res = COHERENT then return UNSAT;
10 else return SAT;
// QBFEval settings;
// solved by bloqqer
// solved by bloqqer
// encode the logic program
// run clasp for Tclasp seconds
// run wasp if unsolved
Finally, we introduce one more fresh atom, say w, and define a disjunctive logic program
PF to consist of the following rules:
z _ z0
y
w
w
w and y0 w
s (Li;1); : : : ; s (Li;k)
not w
for each z 2 X [ Y
for each y 2 Y
for each Di, i = 1; : : : ; m
Eiter and Gottlob [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] proved that F is true if, and only if, PF has an answer set.
Example 2. Consider the 2QBF F = 9x8y8z((x ^ y) _ (x ^ :y ^ :z) _ (:y ^ z)).
Therefore, the corresponding logic program is PF = fx _ x0; y _ y0; z _ z0; y w; y0 w; z
w; z0 w; w x; y; w x; y0; z0; w y0; z; w not wg, which has as unique answer
set fx; y; y0; z; z0; wg, corresponding to set x to true in F , so that F is true.
Example 3. Consider the 2QBF F = 9x9y8z((x ^ :z) _ (:x ^ y ^ :z)). Therefore, the
corresponding logic program is PF = fx _ x0; y _ y0; z _ z0; z w; z0 w; w
x; z0; w x0; y; z0; w not wg, which is incoherent. Indeed, there are only two choices
to infer w, fx; z0g and fx0; y; z0g. Therefore, an interpretation candidate must contain
one of the two sets. In both cases, it cannot be an answer set. Indeed, we can have
I1 = fx; y; z; z0; wg, I2 = fx; y0; z; z0; wg, and I3 = fx0; y; z; z0; wg; but fx; y; zg 2 MM(PI1 ),
fx; y0; zg 2 MM(PI2 ), and fx0; y; zg 2 MM(PI3 ). In conclusion, F is false.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>The ASPQ 2QBF Solver</title>
      <p>
        Main Algorithm. The main algorithm implemented in ASPQ is reported as Algorithm 1.
The input formula F is first simplified by the preprocessor BLOQQER [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], which
replaces F by a (usually) smaller equisatisfiable formula. The simplification process can
take significant time in case of huge formulas. Hence, the tool is allowed to run for at
most Tbloqqer seconds. F is not modified if BLOQQER exceeds the allotted time. Note
that BLOQQER might be able to simplify the formula up to solving it. In that case, it
      </p>
      <p>
        Total SAT UNSAT
Solver # Time # Time # Time
areqs 235 2963.33 179 2136.52 56 826.81
rareqs+bloqqer 232 5287.58 156 2084.94 76 3202.64
depqbf-v2 223 5135.23 142 1553.21 81 3582.02
xb-qsts 206 5581.42 154 3354.41 52 2227.01
ASPQ 188 741.09 141 275.41 47 465.68
# +15
(conventionally) returns a tautology for SAT formulas or a contradiction for UNSAT.
This case is exploited to terminate immediately the computation and return the result.
Otherwise, F is encoded as a propositional ASP program P as detailed in Section 3.
The program P is subsequently provided as input of the ASP solver CLASP [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], which
is executed for Tclasp seconds. If CLASP is not able to find an answer set within the
allotted time, then WASP [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] is executed without time limits. The reason for using two
solvers comes from the observation that CLASP and WASP employ different strategies
for solving disjunctive programs (see [
        <xref ref-type="bibr" rid="ref1 ref11">1, 11</xref>
        ] for details), which may solve different sets
of instances.
      </p>
      <p>QBFEval setting. ASPQ entered the QBFEval 2016 in the 2QBF track as non competing
system (it was submitted two days after the official solver submission deadline). We
set Tbloqqer = 60s, so that preprocessing never occupies more than 10% of the allotted
time (the timeout was set by the organizers to 600s); and we set Tclasp = 60s. This
choice is motivated by the results of a preliminary experiment. In fact, we observe
that CLASP and WASP show a complementary behavior, i.e. the former shows good
performances on unsatisfiable instances whereas the latter shows good performances
on satisfiable instances. Moreover, in our experimental setting, CLASP finds a solution
after few minutes of the computation whereas WASP on average needs more than 5
minutes. Thus, we allotted 10% of the available time to CLASP and the remaining 80%
to WASP.</p>
      <p>Notes on performance. Table 1 reports for ease of presentation the first five positions
of the QBF competition in 2016 (full results are available at http://www.qbflib.
org/index_eval.php), and ASPQ is outlined using a boldface font. We note that,
despite ASPQ is based on a simple architecture, and we used a straightforward static
parameter setting strategy, ASPQ could solve 188 instances of the 305 used in the
competition, (virtually) ranking on the fifth position over 21 participants (one of which was
disqualified as problematic solver). ASPQ is not far from xb-qst occupying the fourth
position, whereas areqs (the winner of the track) solves 20% more instances. We thus
note that the straight application of ASP solving techniques lead to a fairly efficient
2QBF solver, outperforming 15 solvers designed explicitly for solving QBF formulas,
which is a remarkable result. Moreover, 2QBF instances from the QBFEval can be used
as a reference benchmark for improving ASP solvers on hard problems for the second
level of the polynomial hierarchy.</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>
        The main goal of this paper was to provide an assessment of the applicability of ASP
solver technology for solving 2QBF formulas. The resulting solver, called ASPQ,
entered as non-competitive partecipant the QBF competition in 2016 obtaining a fairly
acceptable result in the 2QBF track, that is (virtually) the fifth place. The solver
demonstrates that it is reasonable to exploit the capabilities of state-of-the-art ASP solvers for
solving 2QBF instances. At the same time, it confirms that 2QBF instances can be
used to provide a hard benchmark to assess and improve the performance of ASP
systems [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. As far as future work is concerned, we are considering to tune our system by
improving the encoding in ASP and exploring the possibility of using techniques from
ASP portfolios for further improving the performance of our system.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Alviano</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dodaro</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faber</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>WASP: A native ASP solver based on constraint learning</article-title>
          .
          <source>In: LPNMR. LNCS</source>
          , vol.
          <volume>8148</volume>
          , pp.
          <fpage>54</fpage>
          -
          <lpage>66</lpage>
          . Springer (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Alviano</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dodaro</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Advances in WASP</article-title>
          .
          <source>In: LPNMR. LNCS</source>
          , vol.
          <volume>9345</volume>
          , pp.
          <fpage>40</fpage>
          -
          <lpage>54</lpage>
          . Springer (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Amendola</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eiter</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fink</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moura</surname>
          </string-name>
          , J.:
          <article-title>Semi-equilibrium models for paracoherent answer set programs</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>234</volume>
          ,
          <fpage>219</fpage>
          -
          <lpage>271</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Amendola</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Greco</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Veltri</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Modeling and reasoning about NTU games via answer set programming</article-title>
          .
          <source>In: IJCAI</source>
          . pp.
          <fpage>38</fpage>
          -
          <lpage>45</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Balduccini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gelfond</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Watson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nogueira</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The USA-Advisor: A Case Study in Answer Set Planning</article-title>
          .
          <source>In: LPNMR. LNCS</source>
          , vol.
          <volume>2173</volume>
          , pp.
          <fpage>439</fpage>
          -
          <lpage>442</lpage>
          . Springer (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Biere</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lonsing</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seidl</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Blocked clause elimination for QBF</article-title>
          .
          <source>In: CADE. LNCS</source>
          , vol.
          <volume>6803</volume>
          , pp.
          <fpage>101</fpage>
          -
          <lpage>115</lpage>
          . Springer (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bravo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bertossi</surname>
            ,
            <given-names>L.E.</given-names>
          </string-name>
          :
          <article-title>Logic programs for consistently querying data integration systems</article-title>
          .
          <source>In: IJCAI</source>
          . pp.
          <fpage>10</fpage>
          -
          <lpage>15</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Brewka</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eiter</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Truszczynski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Answer set programming at a glance</article-title>
          .
          <source>Commun. ACM</source>
          <volume>54</volume>
          (
          <issue>12</issue>
          ),
          <fpage>92</fpage>
          -
          <lpage>103</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Calimeri</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gebser</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maratea</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Design and results of the Fifth Answer Set Programming Competition</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>231</volume>
          ,
          <fpage>151</fpage>
          -
          <lpage>181</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Eiter</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gottlob</surname>
          </string-name>
          , G.:
          <article-title>On the computational cost of disjunctive logic programming: Propositional case</article-title>
          .
          <source>Ann. Math. Artif. Intell</source>
          .
          <volume>15</volume>
          (
          <issue>3-4</issue>
          ),
          <fpage>289</fpage>
          -
          <lpage>323</lpage>
          (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Gebser</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaminski</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Kaufmann,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Romero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Schaub</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          :
          <article-title>Progress in clasp Series 3</article-title>
          . In: LPNMR. LNCS, vol.
          <volume>9345</volume>
          , pp.
          <fpage>368</fpage>
          -
          <lpage>383</lpage>
          . Springer (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Gelfond</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lifschitz</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Classical Negation in Logic Programs</article-title>
          and
          <string-name>
            <given-names>Disjunctive</given-names>
            <surname>Databases</surname>
          </string-name>
          . New Generation Comput.
          <volume>9</volume>
          (
          <issue>3</issue>
          /4),
          <fpage>365</fpage>
          -
          <lpage>386</lpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Grasso</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manna</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>ASP at work: Spin-off and applications of the DLV system</article-title>
          .
          <source>In: Logic Programming</source>
          ,
          <source>Knowledge Representation, and Nonmonotonic Reasoning. LNCS</source>
          , vol.
          <volume>6565</volume>
          . Springer (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Koponen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oikarinen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janhunen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sa</surname>
          </string-name>
          ¨ila¨, L.:
          <article-title>Optimizing phylogenetic supertrees using answer set programming</article-title>
          .
          <source>TPLP</source>
          <volume>15</volume>
          (
          <issue>4-5</issue>
          ),
          <fpage>604</fpage>
          -
          <lpage>619</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Manna</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Terracina</surname>
          </string-name>
          , G.:
          <article-title>Taming primary key violations to query large inconsistent data via ASP</article-title>
          .
          <source>TPLP</source>
          <volume>15</volume>
          (
          <issue>4-5</issue>
          ),
          <fpage>696</fpage>
          -
          <lpage>710</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Maratea</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ricca</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faber</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
          </string-name>
          , N.:
          <article-title>Look-back techniques and heuristics in DLV: implementation, evaluation, and comparison to QBF solvers</article-title>
          .
          <source>J. Algorithms</source>
          <volume>63</volume>
          (
          <issue>1-3</issue>
          ),
          <fpage>70</fpage>
          -
          <lpage>89</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>