<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Summary of Inference in Probabilistic Answer Set Programs with Imprecise Probabilities via Optimization</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Damiano Azzolini</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fabrizio Riguzzi</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Environmental and Prevention Sciences - University of Ferrara</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Mathematics and Computer Science - University of Ferrara</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Credal probabilistic facts and credal annotated disjunctions have been recently introduced in the Probabilistic Answer Set Programming framework to manage imprecise probabilities. In a recent paper, inference within this formalism has been cast as a constrained non-linear optimization problem. In this paper, we review that contribution. Probabilistic Answer Set Programming (PASP) combines the efectiveness in solving combinatorial problems of Answer Set Programming with the flexibility in modelling complex distributions of Probabilistic Programming. Recently [1], PASP has been extended with primitives called credal probabilistic facts and credal annotated disjunctions to model imprecise probabilities, i.e., probabilities described by a range, rather than a sharp value. Here, we summarize the paper “Inference in Probabilistic Answer Set Programs with Imprecise Probabilities via Optimization” presented at the UAI 2024 conference [2], where we considered the inference task as a constrained non-linear optimization problem. Empirical results showed the efectiveness of this approach. The paper is structured as follows: Section 2 surveys the background knowledge, Section 3 shows how to cast inference as an optimization problem and discusses the experimental evaluation, and Section 4 concludes the paper.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Probabilistic Answer Set Programming</kwd>
        <kwd>Optimization</kwd>
        <kwd>paper formatting</kwd>
        <kwd>Imprecise Probabilities</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
    </sec>
    <sec id="sec-2">
      <title>2. Background</title>
      <p>
        Probabilistic facts [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] are of the form  ::  with the meaning that  is the probability associated with
the fact . According to the distribution semantics [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], a world is identified by including or not each
probabilistic fact in the program.  (), the probability of a world , is computed as:
      </p>
      <p>
        A probabilistic answer set program under the credal semantics (PASP) is composed by an answer set
program extended with probabilistic facts [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The credal semantics describes the probability of a query
, i.e., a conjunction of ground atoms, with a range [P(), P()] where
 () = ∏︁   ∏︁ (1 −  ).
      </p>
      <p>∈ ̸∈
P() =
P() =</p>
      <p>∑︁
|∀∈(), |=</p>
      <p>∑︁
|∃∈(), |=
 (),
 ().</p>
      <p>
        P() and P() are called, respectively, lower and upper probability. The credal semantics requires
that every world has at least one answer set [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Inference in these programs can be cast as a Second
Level Algebraic Model Counting (2AMC) problem [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. aspcs is a framework that extends aspmc [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
allowing inference in PASP, that converts the program into a Negation Normal Form (NNF, which
is a rooted directed acyclic graph where internal nodes are labeled with AND (conjunction) and OR
(disjunction) and leaves are associated with literals), via a process called knowledge compilation [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
This representation allows fast inference.
      </p>
      <p>
        Credal probabilistic facts and credal annotated disjunctions (ADs) are two possible constructs to
model imprecise probabilities [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Their syntaxes are, respectively,
      </p>
      <p>[,  ] :: 
with 0 ≤  ≤  ≤ 1 and</p>
      <p>[ 1,  1] :: ℎ1; . . . ; [ ,  ] :: ℎ : − 1, . . . , 
with 0 ≤   ≤   ≤ 1,   + ∑︀̸=   ≥ 1,   + ∑︀̸=   ≤ 1, ∀ ∈ {1, . . . , }. We will refer to PASP
extended with either one of the two constructs as PASP with imprecise probabilities.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Inference via Optimization</title>
      <p>We proposed to perform inference in PASP with uncertain probabilities via optimization. Briefly,
we extract a symbolic formula from the NNF representation of the program where the probabilities
associated with credal facts and credal AD are kept symbolic and then call an optimization solver
to minimize/maximize such formulas subject to constraints deriving from the structure of credal
probabilistic facts and credal ADs. Namely, if () and () are the formulas for the lower
and upper probability for a query  and  = { 1, . . .  } denotes the set of probability parameters
associated with credal probabilistic facts, the lower and upper probability of a query can be computed,
respectively, as
and</p>
      <p>()
s.t .   ∈ [, ], ∀ ∈ {1, . . . , }</p>
      <p>()
s.t .   ∈ [, ], ∀ ∈ {1, . . . , }.</p>
      <p>Let us clarify this with an example.</p>
      <p>Example 1. Consider the following PASP with two credal facts.
[0.3,0.4]::a.
[0.4,0.9]::b.
q:- a.
q ; r :- b.</p>
      <p>First, we convert it into
pa::a.
pb::b.
q:- a.
q ; r :- b.
where  and  are parameters. By traversing the NNF for the query  we obtain two equations:
() =  for the lower probability, and (, ) =  −  · ( − 1) for the upper probability.
P() is computed by minimizing () with  ∈ [0.3, 0.4], obtaining 0.3. For P(), we need
to maximize (, ) with  ∈ [0.3, 0.4] and  ∈ [0.4, 0.9]. In this case, we obtain 0.94. So,
[P(), P()] = [0.3, 0.94].</p>
      <p>
        If credal ADs are present, the optimization process becomes more involved and first it requires
converting each credal AD into a combination of probabilistic facts and normal rules [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. For example,
[0.1,0.3]::red;[0.2,0.4]::green;[0.4,0.6]::blue.
is expanded into
p1::f1.
p2::f2.
red :- f1.
green :- not f1, f2.
blue :- not f1, not f2.
      </p>
      <p>Then, the optimization process also needs to consider constraints on the probabilities on the credal
facts.</p>
      <p>With  credal ADs, the optimization problem for the lower probability is
  ()
..   · ∏︁(1 −   ) −   ≥ 0,</p>
      <p>&lt;
  −   · ∏︁(1 −   ) ≥ 0,</p>
      <p>&lt;
∀ ∈ {1, . . . , }, ∀ ∈ {1, . . . , }
assuming   = 1, where   is the probability associated with the -th probabilistic fact related to the
-th head of the -th AD and  is the number of disjuncts in the -th AD. This requires imposing 2 · 
constraints for each credal AD with  heads. The problem to solve for the computation of the upper
probability is analogous. More concretely, with the credal AD shown above, we have the following
set of constraints: 1 − 0.1 ≥ 0, 0.3 −  1 ≥ 0, (1 −  1) ·  2 − 0.2 ≥ 0, 0.4 − (1 −  1) ·  2 ≥ 0,
(1 −  1) · (1 −  2) − 0.4 ≥ 0, and 0.6 − (1 −  1) · (1 −  2) ≥ 0.</p>
      <p>The overall algorithm is as follows: first, credal facts and credal ADs are converted to remove ranges.
Then, the program is converted into a NNF, and two equations are extracted, which are simplified to
reduce the number of operations involved. Lastly, these are sent to a non-linear optimization solver
that can manage non-linear constraints.</p>
      <p>
        The algorithm was implemented in Python and the experimental evaluation was conducted by
considering SymPy [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to simplify equations and SciPy [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] as optimization solver with the COBYLA [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]
and SLSQP [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] algorithms. Empirical results showed that: i) solving the optimization problem by
considering a simplified version of the equations is much faster than considering the equations directly
extracted from the NNF, even if the simplification process may be slow (for larger datasets, this takes
more than 50% of the total execution time); ii) this approach is much faster than already existing solver
based on enumeration [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]; iii) COBYLA is often more eficient and efective than SLSQP.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>
        In this paper, we summarized [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] where inference in probabilistic answer set programs under the credal
semantics with imprecise probabilities has been cast as a constrained non-linear optimization problem.
Empirical results against an already existing solver based on enumeration shows the efectiveness of
this approach.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D. D.</given-names>
            <surname>Mauá</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. G.</given-names>
            <surname>Cozman</surname>
          </string-name>
          ,
          <article-title>Specifying credal sets with probabilistic answer set programming</article-title>
          ,
          <source>in: International Symposium on Imprecise Probabilities and Their Applications</source>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D.</given-names>
            <surname>Azzolini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Riguzzi</surname>
          </string-name>
          ,
          <article-title>Inference in probabilistic answer set programs with imprecise probabilities via optimization</article-title>
          , in: N.
          <string-name>
            <surname>Kiyavash</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          <string-name>
            <surname>Mooij</surname>
          </string-name>
          (Eds.),
          <source>Proceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence</source>
          , volume
          <volume>244</volume>
          <source>of Proceedings of Machine Learning Research, PMLR</source>
          ,
          <year>2024</year>
          , pp.
          <fpage>225</fpage>
          -
          <lpage>234</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>L.</given-names>
            <surname>De Raedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kimmig</surname>
          </string-name>
          , H. Toivonen,
          <article-title>ProbLog: A probabilistic Prolog and its application in link discovery</article-title>
          , in: M. M.
          <string-name>
            <surname>Veloso</surname>
          </string-name>
          (Ed.),
          <source>20th International Joint Conference on Artificial Intelligence (IJCAI</source>
          <year>2007</year>
          ), volume
          <volume>7</volume>
          , AAAI Press,
          <year>2007</year>
          , pp.
          <fpage>2462</fpage>
          -
          <lpage>2467</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>T.</given-names>
            <surname>Sato</surname>
          </string-name>
          ,
          <article-title>A statistical learning method for logic programs with distribution semantics</article-title>
          , in: L.
          <string-name>
            <surname>Sterling</surname>
          </string-name>
          (Ed.),
          <string-name>
            <surname>Logic</surname>
            <given-names>Programming</given-names>
          </string-name>
          ,
          <source>Proceedings of the Twelfth International Conference on Logic Programming</source>
          , Tokyo, Japan, June 13-16,
          <year>1995</year>
          , MIT Press,
          <year>1995</year>
          , pp.
          <fpage>715</fpage>
          -
          <lpage>729</lpage>
          . doi:
          <volume>10</volume>
          .7551/mitpress/ 4298.003.0069.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>F. G.</given-names>
            <surname>Cozman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. D.</given-names>
            <surname>Mauá</surname>
          </string-name>
          ,
          <article-title>The joy of probabilistic answer set programming: Semantics, complexity</article-title>
          , expressivity, inference,
          <source>International Journal of Approximate Reasoning</source>
          <volume>125</volume>
          (
          <year>2020</year>
          )
          <fpage>218</fpage>
          -
          <lpage>239</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.ijar.
          <year>2020</year>
          .
          <volume>07</volume>
          .004.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Brewka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Eiter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Truszczyński</surname>
          </string-name>
          ,
          <article-title>Answer set programming at a glance</article-title>
          ,
          <source>Communications of the ACM</source>
          <volume>54</volume>
          (
          <year>2011</year>
          )
          <fpage>92</fpage>
          -
          <lpage>103</lpage>
          . doi:
          <volume>10</volume>
          .1145/2043174.2043195.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>D.</given-names>
            <surname>Azzolini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Riguzzi</surname>
          </string-name>
          ,
          <article-title>Inference in probabilistic answer set programming under the credal semantics</article-title>
          , in: R.
          <string-name>
            <surname>Basili</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Lembo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Limongelli</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Orlandini (Eds.),
          <source>AIxIA 2023 - Advances in Artificial Intelligence</source>
          , volume
          <volume>14318</volume>
          <source>of Lecture Notes in Artificial Intelligence</source>
          , Springer, Heidelberg, Germany,
          <year>2023</year>
          , pp.
          <fpage>367</fpage>
          -
          <lpage>380</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -47546-7_
          <fpage>25</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>T.</given-names>
            <surname>Eiter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hecher</surname>
          </string-name>
          , R. Kiesel, aspmc:
          <article-title>New frontiers of algebraic answer set counting</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>330</volume>
          (
          <year>2024</year>
          )
          <article-title>104109</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.artint.
          <year>2024</year>
          .
          <volume>104109</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Darwiche</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Marquis</surname>
          </string-name>
          ,
          <article-title>A knowledge compilation map</article-title>
          ,
          <source>Journal of Artificial Intelligence Research</source>
          <volume>17</volume>
          (
          <year>2002</year>
          )
          <fpage>229</fpage>
          -
          <lpage>264</lpage>
          . doi:
          <volume>10</volume>
          .1613/jair.989.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>L. De Raedt</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Demoen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Fierens</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Gutmann</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Janssens</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kimmig</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Landwehr</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Mantadelis</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Meert</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Rocha</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Costa</surname>
            ,
            <given-names>I. Thon</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vennekens</surname>
          </string-name>
          ,
          <article-title>Towards digesting the alphabet-soup of statistical relational learning</article-title>
          ,
          <source>in: NIPS 2008 Workshop on Probabilistic Programming</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Meurer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. P.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Paprocki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Čertík</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. B.</given-names>
            <surname>Kirpichev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Rocklin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kumar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ivanov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. K.</given-names>
            <surname>Moore</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Rathnayake</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Vig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. E.</given-names>
            <surname>Granger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. P.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bonazzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Gupta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Vats</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Johansson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Pedregosa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Curry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Terrel</surname>
          </string-name>
          , v. Roučka,
          <string-name>
            <given-names>A.</given-names>
            <surname>Saboo</surname>
          </string-name>
          , I. Fernando,
          <string-name>
            <given-names>S.</given-names>
            <surname>Kulal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Cimrman</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . Scopatz, SymPy: symbolic computing in python,
          <source>PeerJ Computer Science</source>
          <volume>3</volume>
          (
          <year>2017</year>
          )
          <article-title>e103</article-title>
          . doi:
          <volume>10</volume>
          .7717/peerj-cs.
          <volume>103</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>P.</given-names>
            <surname>Virtanen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gommers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. E.</given-names>
            <surname>Oliphant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Haberland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Reddy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Cournapeau</surname>
          </string-name>
          , E. Burovski,
          <string-name>
            <given-names>P.</given-names>
            <surname>Peterson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Weckesser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bright</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. J. van der Walt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brett</surname>
          </string-name>
          , J. Wilson,
          <string-name>
            <given-names>K. J.</given-names>
            <surname>Millman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Mayorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. R. J.</given-names>
            <surname>Nelson</surname>
          </string-name>
          , E. Jones,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kern</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Larson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Carey</surname>
          </string-name>
          , İ. Polat,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Feng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. W.</given-names>
            <surname>Moore</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. VanderPlas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Laxalde</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Perktold</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Cimrman</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          <string-name>
            <surname>Henriksen</surname>
            ,
            <given-names>E. A.</given-names>
          </string-name>
          <string-name>
            <surname>Quintero</surname>
            ,
            <given-names>C. R.</given-names>
          </string-name>
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>A. M.</given-names>
          </string-name>
          <string-name>
            <surname>Archibald</surname>
            ,
            <given-names>A. H.</given-names>
          </string-name>
          <string-name>
            <surname>Ribeiro</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Pedregosa</surname>
          </string-name>
          , P. van Mulbregt,
          <source>SciPy 1</source>
          .0 Contributors, SciPy
          <volume>1</volume>
          .
          <article-title>0: Fundamental Algorithms for Scientific Computing in Python</article-title>
          ,
          <source>Nature Methods</source>
          <volume>17</volume>
          (
          <year>2020</year>
          )
          <fpage>261</fpage>
          -
          <lpage>272</lpage>
          . doi:
          <volume>10</volume>
          .1038/ s41592-019-0686-2.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>M. J. D. Powell</surname>
          </string-name>
          ,
          <article-title>A direct search optimization method that models the objective and constraint functions by linear interpolation</article-title>
          , in: S. Gomez, J.-P. Hennart (Eds.),
          <source>Advances in Optimization and Numerical Analysis</source>
          , Springer Netherlands, Dordrecht,
          <year>1994</year>
          , pp.
          <fpage>51</fpage>
          -
          <lpage>67</lpage>
          . doi:
          <volume>10</volume>
          .1007/
          <fpage>978</fpage>
          -94-015-8330-
          <issue>5</issue>
          _
          <fpage>4</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D.</given-names>
            <surname>Kraft</surname>
          </string-name>
          , Algorithm 733:
          <article-title>TOMP-fortran modules for optimal control calculations</article-title>
          ,
          <source>ACM Transactions on Mathematical Software</source>
          <volume>20</volume>
          (
          <year>1994</year>
          )
          <fpage>262</fpage>
          -
          <lpage>281</lpage>
          . doi:
          <volume>10</volume>
          .1145/192115.192124.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>R. L.</given-names>
            <surname>Geh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Goncalves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. C.</given-names>
            <surname>Silveira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. D.</given-names>
            <surname>Maua</surname>
          </string-name>
          ,
          <string-name>
            <surname>F. G.</surname>
          </string-name>
          <article-title>Cozman, dPASP: A comprehensive diferentiable probabilistic answer set programming environment for neurosymbolic learning and reasoning</article-title>
          , arXiv (
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>