<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Kai Sauerwald[</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>On Using Model Checking for the Certification of Iterated Belief Changes</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>FernUniversita ̈t in Hagen</institution>
          ,
          <addr-line>58084 Hagen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>0000</year>
      </pub-date>
      <volume>0002</volume>
      <fpage>23</fpage>
      <lpage>33</lpage>
      <abstract>
        <p>The theory of iterated belief change investigates how epistemic states are changed according to new beliefs. This is typically done by focussing on postulates that govern how epistemic states are changed. A common realisation of epistemic states are total preorders over possible worlds. In this paper, we consider the problem of certifying whether an operator over total preorders satisfies a given postulate. We introduce the first-order fragment FOTPC for expressing belief change postulates and present a way to encode information on changes into an FOTPCstructure. As a result, the question of whether a belief change fulfils a postulate becomes a model checking problem. We developed Alchourron, an implementation of our approach, consisting of an extensive Java library, and also of a web interface, which suits didactic purposes and experimental studies. For Alchourron, we also present an evaluation of the running time with respect to logical properties.</p>
      </abstract>
      <kwd-group>
        <kwd>Belief Change</kwd>
        <kwd>Total Preorder</kwd>
        <kwd>Implementation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        A fundamental problem for intelligent agents is adapting their world-view to
potentially new and conflicting information. Iterated belief change discusses
properties of operators that model transition of currently held beliefs under newly
received information. The field has a large body of literature with di↵erentiated
results for a large variety of di↵erent types of operations, e.g., revision [
        <xref ref-type="bibr" rid="ref5 ref6">6,5</xref>
        ],
contraction [
        <xref ref-type="bibr" rid="ref12 ref19 ref8">8,12,19</xref>
        ], expansion, the area of non-prioritized change [
        <xref ref-type="bibr" rid="ref11 ref22 ref3">11,3,22</xref>
        ] and
many more [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
      </p>
      <p>
        The research on (iterated) belief change is focussed on propositional logic (but
not limited to). Often, total preorders over interpretations [
        <xref ref-type="bibr" rid="ref11 ref12 ref19 ref21 ref22 ref22 ref3 ref6">6,11,3,21,19,22,12,22</xref>
        ]
or refinements thereof [
        <xref ref-type="bibr" rid="ref5 ref8">8,5</xref>
        ] are considered as a representation formalism for
epistemic states.
      </p>
      <p>
        A common aspect of many approaches in the area of iterated belief change is
that a class of operators is given by syntactic postulates, constraining how to
change, and that representation theorems show, which semantic postulates exactly
reconstruct that class of operators in the realm of total preorders. The typical
structure of postulates, regardless of whether they are syntactic or semantic
postulates; is that they focus on a single (but arbitrary) epistemic state and
constrain the result of subsequent changes on that state. When total preorders
are considered as epistemic states, then very often, the so-called faithfulness
condition and a representation theorem connects the syntactic viewpoint with
the semantic perspective, e.g. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Given the large variety of di↵erent postulates and types of operations, it
is tedious and cumbersome to check manually whether a given specific change
satisfies a certain postulate, or to decide whether the change falls into a certain
category of type of operation.</p>
      <p>
        This leads to the general problem of checking whether a belief change operator
or a singular change satisfies a given syntactic or semantic postulate, which we
call the certification problem. The certification problem got not much
attention, notable exceptions are results about the complexity for specific operations
[
        <xref ref-type="bibr" rid="ref13 ref16 ref20">16,13,20</xref>
        ] and results about inexpressibility [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. Furthermore, there seems to be
no implementation for the certification problem for the area of iterated belief
change.
      </p>
      <p>In this paper, we propose an approach to grasp the certification problem
for the case where total preorders are used as epistemic states and provide
an implementation. The approach consists of defining the first-order fragment
FOTPC, which is meant as a language for semantic postulates. To focus on
semantic postulates seems to be only a minor restriction, as, given the many
representation theorems, many syntactic postulates are known to be expressible
by semantic postulates in the total preorder realm. Second, we describe how
an FOTPC-structure can be constructed for a belief change operator or for a
singular belief change. The certification problem then becomes a first-order
modelchecking problem. Third, we provide an implementation of the approach, which
is publicly available on the web. We present an evaluation of the di↵erent steps
of the approach according to the computation time with respect to the signature
size and quantifier rank of postulates.</p>
      <p>
        This paper extends recent work [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] by an empirical evaluation.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Belief Change on Epistemic States</title>
      <p>
        Let L be a propositional language over a finite signature of propositional variables
⌃ , and ⌦ its corresponding set of interpretations. Following the framework of
Darwiche and Pearl [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], we deal with belief changes over epistemic states and
propositions. An epistemic state is an abstract entity from a set E , where each
2 E is equipped with a deductively closed set Bel( ). A belief change operator
is a function : E ⇥ L ! E . In this paper, we only consider operators satisfying
the following syntax-independence condition for each 2 E and ↵, 2 L :
(sAGM5es*) if ↵ ⌘
, then
      </p>
      <p>
        ↵ =
Here (sAGM5es*) is a stronger version of the extensionality postulate from the
revision approach by Alchourr´on, G¨ardenfors and Makinson [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] (AGM).
      </p>
      <p>
        The framework by Darwiche and Pearl is di↵erent from the classical setup for
belief revision theory by AGM [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], where deductively closed sets (called belief
sets) are used as states [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. However, the richer structure of epistemic states is
necessary to include the information required to capture the change strategy of
iterative belief change [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        There are many possible instantiations of E ; however, we will stick here to the
popular one by total preorders. More precisely, we consider total preorders over
⌦ that fulfil the so-called faithfulness condition [
        <xref ref-type="bibr" rid="ref10 ref6">10,6</xref>
        ], stating that the minimal
elements of each total preorder  = 2 E are exactly the models of Bel( ), i.e.,
Mod(Bel( )) = min(⌦,  ). Thus, in the scope of this paper, each total preorder
is assumed to describe an epistemic state entirely.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Problem Statement</title>
      <p>
        Postulates are central objects in the area of (iterative) belief change and are
grouped together to define classes of belief change operators in a descriptive way.
The problem we address is to check whether a given operator satisfies a postulate,
i.e., belongs to a class of change operators specified by postulates. We call this
particular problem the certification problem (which could be considered as a
generalisation of the revision problem [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]):
Certification-Problem
Given: A belief change operator and a postulate P
Question: Does satisfy the postulate P ?
      </p>
      <p>Clearly, information about a whole belief change operator is available or even
finitely representable only in few application scenarios. This gives rise to several
sub-problems depending on how much information of the particular operator
is known. Apart from the full operator , we consider the certification of the
following cases:
– A singular belief change from to 0 by ↵ , i.e.: Does
– A sequence of belief changes 1 ↵ 1 = 2, and 2 ↵ 2 =
– All singular belief changes on a state , i.e. the set {( 1, ↵,
↵ = 0 hold?
3, and . . .
2) 2 |
= 1}</p>
      <p>In the next section we present a model-checking based formalisation of the
Certification-Problem.
4</p>
    </sec>
    <sec id="sec-4">
      <title>The Approach</title>
      <p>In belief change, postulates are usually described by common mathematical
language, which is close to (first-order) predicate logic. In the following, we use
the toolset of first-order logic to formalise the Certification-Problem as a
first-order model-checking problem.</p>
      <p>
        Language for Postulates. As an initial study, we considered several postulates
from the literature on iterated belief change, e.g. [
        <xref ref-type="bibr" rid="ref15 ref2 ref4 ref6 ref9">6,4,9,2,15</xref>
        ], and selected the
most common predicates and functions used. We compiled them into a fragment of
first-order logic with equality over a fixed set of predicates and function symbols1,
1 Note that we could also use a fragment of many-sorted first-order logic. However,
some predicates are ”overloaded” in respect to sorts.
      </p>
      <sec id="sec-4-1">
        <title>Predicate</title>
      </sec>
      <sec id="sec-4-2">
        <title>Intended meaning M od(w, x) w is a model of x</title>
        <p>LessEQ(w1, w2, e) w1  w2 in e
Int(w) w is an interpretation
ES(e) e is an epistemic state
F orm(a) a is a formula
Function
op(e0, a)
or(a, b)
not(a)</p>
      </sec>
      <sec id="sec-4-3">
        <title>Intended meaning</title>
        <p>op(e0, a) is a result of changing e0 by a
propositional disjunction
propositional negation</p>
      </sec>
      <sec id="sec-4-4">
        <title>Exemplary appearance</title>
        <p>! 2 Mod( ), ! 2 Mod(↵ )
!1  !2
! 2 ⌦</p>
        <p>2 E
↵ 2 L
Exemplary appearance
Bel(</p>
        <p>↵ = 0
(↵ _ )) = . . .
¬↵ /2 Bel( ↵ )
denoted by FOTPC (Total Preorder Change), with the intention to describe
changes over total preorders. Figure 1 summarises the permitted symbols and
describes only the minimal required set.</p>
        <p>Several common predicates and functions used in postulates are expressible
by the means of FOTPC by employing this minimal set, e.g. logical entailment,
semantic equality, the strict part of a total preorder, checking whether a formula
has no model, etc. For a specific example, consider the following:</p>
        <p>LogImpl(x, y):=8 w.Int(w)! (M od(w, x)! M od(w, y))
where LogImpl(x, y) describes that x logically implies y.</p>
        <p>
          For illustration, we consider some aspects about belief change postulates.
First, belief change postulates are typically formulated with a locality aspect;
every postulate focusses on an initial state and a change formula ↵ , describing a
condition for this change. As prominent examples, the following postulates are
an excerpt of the AGM revision postulates [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]:
(AGM2*) ↵ 2 Bel(
(AGM7*) Bel( (↵ ^
↵ )
)) ✓ Cn(Bel(
↵ )[{
})
In FOTPC, we address this by reserving e0 and a as special terms, where e0 denotes
the initial state and a denotes the formula representing the new information.
        </p>
        <p>Postulates for (iterated) belief change typically come in two fashions: Semantic
postulates describe changes in a semantic domain, such as faithful total preorders.
For example, consider the following postulate:
(CR1) if !1, !22 Mod(↵ ), then !1
!2 , !1
↵ !2
This could be expressed in FOTPC by the following formula 'CR1:
'CR1 = 8 w1, w2. (Int(w1) ^ Int(w2) ^ M od(w1, a) ^ M od(w2, a))
! (LessEQ(w1, w2, e0) $ LessEQ(w1, w2, op(e0, a)))</p>
      </sec>
      <sec id="sec-4-5">
        <title>Universe</title>
        <p>U AC = ⌦ [ {</p>
        <p>0, 1} [ P (⌦ )
Predicates</p>
        <p>M odAC = {(!, x) | x 2 P (⌦ ) [ {</p>
        <p>IntAC = ⌦</p>
        <p>ESAC = { 0, 1}</p>
        <p>F ormAC = P(⌦ )
LessEQAC = {(!1, !2, i) | !1  i !2}
Functions
orAC = ↵ 1, ↵ 2. ↵ 1 [ ↵ 2
notAC = ↵ 1. ⌦ \ ↵ 1
opAC = ({( , , ) | 2 P (⌦ ), 2 {
0, 1}, ! 2 Mod(x)}}
eAC = 0
0
aAC = Mod(↵ )
0, 1}} \ {( 0, ↵,
0}) [ { ( 0, ↵,
1)}</p>
        <p>
          On the other hand, syntactic postulates describe changes of Bel( ). Aside
of the AGM revision postulates, prominent examples are the Darwiche-Pearl
postulates for revision [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] such as:
(DP1) if
|= ↵ , then Bel(
↵
) = Bel(
)
Several representation results in the literature show how syntactic and semantic
postulates are interrelated. For instance, it is well-known that, given is an
AGM revision operator, (CR1) holds if and only if (DP1) holds [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. Moreover,
the semantic and syntactic domains are of course related, which allows us to
describe many predicates used in the syntactic realm by semantic means. For
example, a statement like Bel( ↵ ) = Bel( ) is expressible in FOTPC by
employing the following formula:
        </p>
        <p>Bel(a, e) := (F orm(a) ^ ES(e)) ! (8 x.M od(x, a) $ M od(x, e))</p>
        <p>We describe now how objects like belief change operators, singular changes
and so on are related to FOTPC formulas.</p>
        <p>Encoding as Model-Checking. Internally, we use the standard truth-functional
semantics of first-order logic for FOTPC. Therefore, we translate a belief change
operator, or the known part of it, into a first-order structure.</p>
        <p>The general idea is to define a structure A by the following pattern: The
universe U A consists of all propositional interpretations ⌦ , all formulas from L
and all considered epistemic states from , i.e., the total preorders over ⌦ . We
represent formulas by their models, i.e., by elements of2 P(⌦ ). The rationale
is that, because of (sAGM5es*), the considered belief change operators are
insensitive to syntactic variations. Additionally, predicates are interpreted in the
straight-forward manner, e.g., the predicate Int is interpreted as all propositional
interpretations, IntA = ⌦ , and LessEQ allows access to the total preorder
of each epistemic state, LessEQA = {(!1, !2, i) | (!1, !2) 2 i}. Depending
2 P(·) is the powerset function.
on whether a full change operator, a singular change, or another sub-problem is
considered, some special treatment is necessary.</p>
        <p>For instance, consider the signature ⌃ = {a, b}, yielding the interpretations
⌦ = {ab, ab, ab, ab}. Moreover, consider the singular change C = ( 0, ↵, 1),
where 0 =  0 is the total preorder treating every interpretation to be equally
plausible, i.e., ab =0 ab =0 ab =0 ab. Furthermore, let ↵ = a. The total preorder
1 =  1 treats all a-models to be equally plausible, but prefers them over all non
a-models, which are considered to be equally plausible, i.e.,  1 is the unique total
preorder with ab =1 ab and ab &lt;1 ab and ab =1 ab. We construct a structure AC
as follows: The universe is given by U AC = ⌦ [ { 0, 1} [ P (⌦ ). The predicates
and function symbols are interpreted according to Figure 2. The terms e0 and a
are interpreted as e0AC = 0 and aAC = Mod(↵ ).</p>
        <p>In summary, the Certification-Problem of whether C satisfies (CR1) is
expressed as a model-checking problem for FOTPC, i.e., a change C satisfies
the postulate (CR1) if AC |= 'CR1 holds, where '(CR1) is the formula given in
Equation (4).
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Implementation</title>
      <p>We provide an implementation, called Alchourron, of the approach by combining
independent, self-developed Java libraries. Whereby the implementation consists
of two main parts: First, an implementation of the model-checking based approach
to the certification problem and its sub-problems and second, a user interface
realized via web-frontend.</p>
      <p>Our implementation of the certification problem makes use of a domain
specific modelling of the area of iterated belief change. This contains the
representation of postulates, belief change operators and belief changes, and the
translation thereof into FOTPC-structures. The model-checking algorithm is
currently straight-forward and is part of an extensive institution-inspired
implementation, called Logical Systems3, which allows representation and evaluation of
a variety of di↵erent logics in a unified way. Preconfigured postulates are stored
in TPTP syntax and parsed from there4, mapping TPTP specified formula into
our internal representation. Some parts of the implementation are currently only
available upon request.</p>
      <p>
        The user interface is publicly accessible by a web-frontend5, which expands
on the previous work by Sauerwald and Haldimann [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The currently available
version allows the specification of a singular belief change using a browser-based
client. First, the user decides on a propositional signature for the language of
the belief change. Then a prior total preorder, an input formula, as well as the
posterior total preorder is entered. Figure 3 illustrates the belief change input.
      </p>
      <p>
        After specifying the change, the web-interface allows the user to check whether
several preconfigured belief change postulates are satisfied. Optionally, a user
3 Sauerwald, K.: Logical Systems, 2021, github.com/Landarzar/logical-systems.
4 Steen, A.: Scala TPTP parser, 2021. DOI: 10.5281/zenodo.4672395.
5 Visit: https://www.fernuni-hagen.de/wbs/alchourron/
can also enter her own postulate by defining a first-order formula using FOTPC.
Formulas are described in TPTP syntax [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], e.g., the postulate (CR1) from
Section 4 can be expressed as follows:
! [W1,W2] : ((int(W1) &amp; int(W2) &amp; mod(W1, A) &amp; mod(W2, A))
      </p>
      <p>=&gt; (lesseq(W1, W2, E0) &lt;=&gt; lesseq(W1, W2, op(E0, A))))</p>
      <p>Internally, the user interface make use of a client-server architecture. In
particular, postulate checking via compilation into a model-checking problem as
described in Section 4 is happening completely on the server side. The
implementation is highly modularized, and we expect reusability of components for further
projects.</p>
      <p>
        The client is implemented in TypeScript and utilizes the React framework.
Display of total preorders is provided by open-source web components6 that can
also represent ordinal conditional functions [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], which for instance implement
total preorders, but provide also more fine-grained representations of epistemic
states.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Empirical Evaluation and Improvements</title>
      <p>We undertook measurements of the run-time for several predefined postulates and
belief changes. For the following, remember that the implementation computes the
answer to a given certification problem in three steps: The implementation has to
parse the request (including restoring the prior epistemic state and restoring
posterior epistemic states from a textual representation), build the FOTPC-structure
AC , and perform a FOTPC-model-check to determine whether or not the belief
change satisfies a postulate.</p>
      <p>As the method for measuring the run-time, we used java.time.Instant,
while the server was running in a docker container. The same amount of resources
was provided for every run. To reduce variance, measurements were taken multiple
times and averaged. Even though concrete numbers depend on the system, overall
trends could be identified.
6 Heltweg, P.: Logic components, 2021. DOI: 10.5281/zenodo.4744650.
106
)s 105
µ
(
e
im 104
T
103
102</p>
      <p>We obtained that the run-time is mainly dominated by the size of the signature.
Figure 4 presents prototypical results of the measurements. With respect to the
size of the signature, parsing the request, as well as building the initial structure
showed only small growth. Increasing the size of the signature from |⌃ | = 1
to |⌃ | = 3 increases the time needed to parse the request by a factor of ⇠ 1.4,
building AC took ⇠ 4.6 times as long. In contrast, the run-time for performing
model-checking of all considered postulates increased from 11978 µs for |⌃ | = 1 to
12386828 µs (⇠ 12.4s) for |⌃ | = 3, a factor of ⇠ 1034. For |⌃ | = 3, most postulates
were checked in less than 100 milliseconds.</p>
      <p>
        As special cases, consider the following postulates (CR5) and (CR6) from
Darwiche and Pearl [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]:
(CR5) if !1, !3|=↵ and !2|=¬↵ , then !3 &lt;
(CR6) if !1, !3|=↵ and !2|=¬↵ , then !3 &lt;
!1 and !2 
!1 and !2 &lt;
!1 i↵ !2  ↵ !1
!1 i↵ !2 &lt; ↵ !1
Each of the postulates (CR5) and (CR6) interrelate three worlds. Thus, when
modelling them in FOTPC, corresponding formulas quantify over three
interpretations.
      </p>
      <p>
        One might note that the postulates with the high run-times are those which
contain three all-quantifiers (more than any other considered postulate). For
example for (CR5) and (CR6) we obtain the average run-times of 3161 ms and
3226 ms, respectively. We conclude that the number of quantifiers in a postulate
dominate the run-time. This coincides with theoretical results on the complexity
of first-order model-checking with respect to the quantifier rank [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>The results gave rationale to change the implementation, such that
allquantified formulas were now evaluated in parallel. This led to a speed-up of
roughly factor two for individual postulates. In an additional step, the certification
of multiple postulates in one request was also done in parallel, allowing (CR5) and
(CR6) to be evaluated at the same time and not sequentially. After performance
optimizations, certification of a belief change for |⌃ | = 3 was reduced from ⇠ 12.5
seconds to ⇠ 3.9 seconds, a speed-up factor of ⇠ 3.2.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Summary and Future Work</title>
      <p>We proposed FOTPC, a first-order fragment to describe belief change postulates,
complemented with a methodology to construct a finite structure for a belief
change operator, employing total preorders as representation of epistemic states.
With this toolset, the certification of belief change operators can be understood as
a model-checking problem. We presented our implementation, which is available
online5, as a proof of concept for our approach for singular belief changes. In
summary, we defined and formalized the certification problem and provided an
implementation thereof.</p>
      <p>
        While this is only the first proposal, we expect that this approach will be highly
flexible regarding improvements and extensions. For future work we planning to
expand our approach in several directions. First, note that our implementation
of the model-checking-based certification already supports the certification of
complete belief change operators. However, the user interface is currently limited
to the certification of single-step changes. Thus, as a natural next step, we will
investigate ways to extend the web interface such that ultimately certification
of complete belief change operators is easily possible for users. Second, we are
planning to extend the whole approach to more complex representations of
epistemic states, e.g., ranking functions by Spohn [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. Finally, we will improve
the eciency of the implementation. This involves using a more sophisticated
and specialized method of first-order model-checking.
      </p>
    </sec>
    <sec id="sec-8">
      <title>Acknowlegements</title>
      <p>We would like to thank the reviewers for their fruitful and helpful comments. Kai
Sauerwald is supported by the Deutsche Forschungsgemeinschaft (DFG, German
Research Foundation) Grant BE 1700/10-1 awarded to Christoph Beierle as part
of the priority program ”Intentional Forgetting in Organizations” (SPP 1921).
The authors also thank Christoph Beierle for his helpful comments and support.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Alchourr´on, C.E., G¨ardenfors,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Makinson</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          :
          <article-title>On the logic of theory change: Partial meet contraction and revision functions</article-title>
          .
          <source>J. Symb. Log</source>
          .
          <volume>50</volume>
          (
          <issue>2</issue>
          ),
          <fpage>510</fpage>
          -
          <lpage>530</lpage>
          (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Booth</surname>
          </string-name>
          , R.:
          <article-title>On the logic of iterated non-prioritised revision</article-title>
          . In: Kern-Isberner,
          <string-name>
            <given-names>G.</given-names>
            , Ro¨dder, W.,
            <surname>Kulmann</surname>
          </string-name>
          ,
          <string-name>
            <surname>F</surname>
          </string-name>
          . (eds.) Conditionals, Information, and Inference, International Workshop, WCII 2002, Hagen, Germany, May 13-15,
          <year>2002</year>
          ,
          <source>Revised Selected Papers. Lecture Notes in Computer Science</source>
          , vol.
          <volume>3301</volume>
          , pp.
          <fpage>86</fpage>
          -
          <lpage>107</lpage>
          . Springer (
          <year>2002</year>
          ). https://doi.org/10.1007/11408017 6
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Booth</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Ferm´e,
          <string-name>
            <given-names>E.L.</given-names>
            ,
            <surname>Konieczny</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Pino</surname>
          </string-name>
          <string-name>
            <surname>P</surname>
          </string-name>
          ´erez, R.:
          <article-title>Credibility-limited improvement operators</article-title>
          . In: Schaub,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Friedrich</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O</given-names>
            <surname>'Sullivan</surname>
          </string-name>
          ,
          <string-name>
            <surname>B</surname>
          </string-name>
          . (eds.)
          <source>ECAI 2014 - 21st European Conference on Artificial Intelligence</source>
          ,
          <fpage>18</fpage>
          -22
          <source>August</source>
          <year>2014</year>
          , Prague, Czech Republic.
          <source>Frontiers in Artificial Intelligence and Applications</source>
          , vol.
          <volume>263</volume>
          , pp.
          <fpage>123</fpage>
          -
          <lpage>128</lpage>
          . IOS Press (
          <year>2014</year>
          ). https://doi.org/10.3233/978-1-
          <fpage>61499</fpage>
          -419-0-123
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Booth</surname>
          </string-name>
          , R., Meyer, T.A.:
          <article-title>Admissible and restrained revision</article-title>
          .
          <source>J. Artif. Intell. Res</source>
          .
          <volume>26</volume>
          ,
          <fpage>127</fpage>
          -
          <lpage>151</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Booth</surname>
          </string-name>
          , R., Meyer, T.A.,
          <string-name>
            <surname>Wong</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>A bad day surfing is better than a good day working: How to revise a total preorder</article-title>
          . In: Doherty,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Mylopoulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Welty</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.A</surname>
          </string-name>
          . (eds.)
          <source>Proceedings, Tenth International Conference on Principles of Knowledge Representation and Reasoning</source>
          ,
          <source>Lake District of the United Kingdom, June 2-5</source>
          ,
          <year>2006</year>
          . pp.
          <fpage>230</fpage>
          -
          <lpage>238</lpage>
          . AAAI Press (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Darwiche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pearl</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>On the logic of iterated belief revision</article-title>
          .
          <source>Artificial Intelligence</source>
          <volume>89</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>29</lpage>
          (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. Ferm´e,
          <string-name>
            <given-names>E.L.</given-names>
            ,
            <surname>Hansson</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.O.</surname>
          </string-name>
          :
          <article-title>AGM 25 years - twenty-five years of research in belief change</article-title>
          .
          <source>J. Philosophical Logic</source>
          <volume>40</volume>
          (
          <issue>2</issue>
          ),
          <fpage>295</fpage>
          -
          <lpage>331</lpage>
          (
          <year>2011</year>
          ). https://doi.org/10.1007/s10992-011-9171-9
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Hild</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spohn</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>The measurement of ranks and the laws of iterated contraction</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>172</volume>
          (
          <issue>10</issue>
          ),
          <fpage>1195</fpage>
          -
          <lpage>1218</lpage>
          (
          <year>2008</year>
          ). https://doi.org/10.1016/j.artint.
          <year>2008</year>
          .
          <volume>03</volume>
          .002
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Jin</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thielscher</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Iterated belief revision, revised</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>171</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Katsuno</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mendelzon</surname>
            ,
            <given-names>A.O.</given-names>
          </string-name>
          :
          <article-title>Propositional knowledge base revision and minimal change</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>52</volume>
          (
          <issue>3</issue>
          ),
          <fpage>263</fpage>
          -
          <lpage>294</lpage>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Konieczny</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pino</surname>
            <given-names>P</given-names>
          </string-name>
          ´erez, R.:
          <article-title>Improvement operators</article-title>
          . In: Brewka,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Lang</surname>
          </string-name>
          ,
          <string-name>
            <surname>J</surname>
          </string-name>
          . (eds.)
          <source>Principles of Knowledge Representation and Reasoning: Proceedings of the Eleventh International Conference, KR</source>
          <year>2008</year>
          , Sydney, Australia,
          <source>September 16-19</source>
          ,
          <year>2008</year>
          . pp.
          <fpage>177</fpage>
          -
          <lpage>187</lpage>
          . AAAI Press (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Konieczny</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pino</surname>
            <given-names>P</given-names>
          </string-name>
          ´erez, R.:
          <article-title>On iterated contraction: syntactic characterization, representation theorem and limitations of the Levi identity</article-title>
          .
          <source>In: Scalable Uncertainty Management - 11th International Conference, SUM</source>
          <year>2017</year>
          , Granada, Spain, October 4-
          <issue>6</issue>
          ,
          <year>2017</year>
          ,
          <source>Proceedings. Lecture Notes in Artificial Intelligence</source>
          , vol.
          <volume>10564</volume>
          . Springer (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Liberatore</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>The complexity of iterated belief revision</article-title>
          . In: Afrati,
          <string-name>
            <given-names>F.N.</given-names>
            ,
            <surname>Kolaitis</surname>
          </string-name>
          , P.G. (eds.) Database Theory - ICDT '
          <volume>97</volume>
          , 6th International Conference, Delphi, Greece, January 8-
          <issue>10</issue>
          ,
          <year>1997</year>
          ,
          <source>Proceedings. Lecture Notes in Computer Science</source>
          , vol.
          <volume>1186</volume>
          , pp.
          <fpage>276</fpage>
          -
          <lpage>290</lpage>
          . Springer (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Libkin</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Elements of Finite Model Theory</article-title>
          . Springer (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Nayak</surname>
            ,
            <given-names>A.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pagnucco</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peppas</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Dynamic belief revision operators</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>146</volume>
          (
          <issue>2</issue>
          ),
          <fpage>193</fpage>
          -
          <lpage>228</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Nebel</surname>
          </string-name>
          , B.:
          <article-title>How Hard is it to Revise a Belief Base?</article-title>
          , pp.
          <fpage>77</fpage>
          -
          <lpage>145</lpage>
          . Springer Netherlands, Dordrecht (
          <year>1998</year>
          ). https://doi.org/10.1007/
          <fpage>978</fpage>
          -94
          <source>-011-5054-5 3</source>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Sauerwald</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haldimann</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>WHIWAP: checking iterative belief changes</article-title>
          . In: Beierle,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Ragni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Stolzenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Thimm</surname>
          </string-name>
          , M. (eds.)
          <source>Proceedings of the 8th Workshop on Dynamics of Knowledge and Belief (DKB-2019) and the 7th Workshop KI</source>
          &amp;
          <string-name>
            <surname>Kognition (KIK-2019)</surname>
          </string-name>
          , Kassel, Germany,
          <year>September 23</year>
          ,
          <year>2019</year>
          .
          <source>CEUR Workshop Proceedings</source>
          , vol.
          <volume>2445</volume>
          , pp.
          <fpage>14</fpage>
          -
          <lpage>23</lpage>
          . CEUR-WS.org (
          <year>2019</year>
          ), http: //ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2445</volume>
          /paper 2.pdf
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Sauerwald</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heltweg</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beierle</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Certification of iterated belief changes via model checking and its implementation</article-title>
          . In: Amgoud,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Booth</surname>
          </string-name>
          ,
          <string-name>
            <surname>R</surname>
          </string-name>
          . (eds.) 19th
          <source>International Workshop on Non-Monotonic Reasoning (NMR</source>
          <year>2021</year>
          ), Hanoi, Vietnam, November 2-
          <issue>5</issue>
          ,
          <year>2021</year>
          ,
          <string-name>
            <surname>Proceedings</surname>
          </string-name>
          (
          <year>2021</year>
          ),
          <article-title>(forthcoming)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Sauerwald</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kern-Isberner</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beierle</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>A conditional perspective for iterated belief contraction</article-title>
          . In: Giacomo,
          <string-name>
            <surname>G.D.</surname>
          </string-name>
          , Catala´,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Dilkina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Milano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Barro</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          , Bugar´ın,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Lang</surname>
          </string-name>
          ,
          <string-name>
            <surname>J</surname>
          </string-name>
          . (eds.)
          <source>ECAI 2020 - 24nd European Conference on Artificial Intelligence, August 29th - September 8th</source>
          ,
          <year>2020</year>
          , Santiago de Compostela, Spain. pp.
          <fpage>889</fpage>
          -
          <lpage>896</lpage>
          . IOS Press (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Schwind</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konieczny</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lagniez</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marquis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>On computational aspects of iterated belief change</article-title>
          . In: Bessiere,
          <string-name>
            <surname>C</surname>
          </string-name>
          . (ed.)
          <source>Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence</source>
          ,
          <string-name>
            <surname>IJCAI</surname>
          </string-name>
          <year>2020</year>
          . pp.
          <fpage>1770</fpage>
          -
          <lpage>1776</lpage>
          (
          <year>2020</year>
          ). https://doi.org/10.24963/ijcai.
          <year>2020</year>
          /245
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Schwind</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konieczny</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marquis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>On belief promotion</article-title>
          . In: Thielscher,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Toni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Wolter</surname>
          </string-name>
          ,
          <string-name>
            <surname>F</surname>
          </string-name>
          . (eds.)
          <source>Principles of Knowledge Representation and Reasoning: Proceedings of the Sixteenth International Conference, KR</source>
          <year>2018</year>
          , Tempe, Arizona,
          <volume>30</volume>
          <fpage>October</fpage>
          - 2
          <source>November</source>
          <year>2018</year>
          . pp.
          <fpage>297</fpage>
          -
          <lpage>307</lpage>
          . AAAI Press (
          <year>2018</year>
          ), https://aaai.org/ ocs/index.php/KR/KR18/paper/view/18025
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Schwind</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konieczny</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <string-name>
            <surname>Non-Prioritized Iterated</surname>
          </string-name>
          Revision:
          <article-title>Improvement via Incremental Belief Merging</article-title>
          .
          <source>In: Proceedings of the 17th International Conference on Principles of Knowledge Representation and Reasoning</source>
          . pp.
          <fpage>738</fpage>
          -
          <lpage>747</lpage>
          (9
          <year>2020</year>
          ). https://doi.org/10.24963/kr.2020/76, https://doi.org/10.24963/kr.2020/76
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Spohn</surname>
          </string-name>
          , W.:
          <article-title>Ordinal conditional functions: a dynamic theory of epistemic states</article-title>
          . In: Harper,
          <string-name>
            <given-names>W.</given-names>
            ,
            <surname>Skyrms</surname>
          </string-name>
          ,
          <string-name>
            <surname>B</surname>
          </string-name>
          . (eds.)
          <article-title>Causation in Decision, Belief Change</article-title>
          , and Statistics, II, pp.
          <fpage>105</fpage>
          -
          <lpage>134</lpage>
          . Kluwer Academic Publishers (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24. Sutcli↵e, G.:
          <article-title>The TPTP Problem Library and Associated Infrastructure. From CNF to TH0</article-title>
          ,
          <source>TPTP v6.4.0. Journal of Automated Reasoning</source>
          <volume>59</volume>
          (
          <issue>4</issue>
          ),
          <fpage>483</fpage>
          -
          <lpage>502</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Tur</surname>
          </string-name>
          ´an, G.,
          <string-name>
            <surname>Yaggie</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>Characterizability in belief revision</article-title>
          .
          <source>In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI</source>
          <year>2015</year>
          ,
          <string-name>
            <given-names>Buenos</given-names>
            <surname>Aires</surname>
          </string-name>
          , Argentina,
          <source>July 25-31</source>
          ,
          <year>2015</year>
          . pp.
          <fpage>3236</fpage>
          -
          <lpage>3242</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>