<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>On Non-normal Modal Description Logics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tiziano Dalmonte</string-name>
          <email>tiziano.dalmonte@etu.univ-amu.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrea Mazzullo</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ana Ozaki</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Aix Marseille Univ, Université de Toulon</institution>
          ,
          <addr-line>CNRS, LIS, Marseille</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Free University of Bozen-Bolzano</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Non-normal modal logics based on neighbourhood semantics can be used to formalise normative, epistemic and coalitional reasoning in autonomous and multi-agent systems, since they do not validate principles known to be problematic in applications. These principles, satisfied by all modal logics interpreted over relational frames, also affect several modal description logics (MDLs) used in knowledge representation. We study non-normal MDLs, obtained by extending ALC-based languages with non-normal modal operators. These logics increase the expressive power of their propositional counterparts, and allow for complex modelling of obligations, beliefs, abilities and strategies. On the computational side, standard reasoning tasks are not more difficult than in basic normal MDLs, with a NExpTime upper bound for satisfiability that can be lowered further in fragments with modal operators only over axioms.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Several approaches to the formal study of normative, epistemic and action-based
notions are based on modal logic (ML) operators [
        <xref ref-type="bibr" rid="ref14 ref16 ref9">9, 14, 16</xref>
        ]. In the normative
setting, for instance, the so-called standard deontic logic (SDL) extends
propositional logic with unary operators, intuitively interpreted as ‘it is obligatory’
and ‘it is permitted’. First-order extensions have been considered as well [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
Research on autonomous systems [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], machine ethics [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and normative
multiagent systems [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] is drawing attention to challenging application scenarios for
deontic logics in computer science. Other motivations come from knowledge
management in legal domains (e.g. legal ontologies and expert systems [
        <xref ref-type="bibr" rid="ref13 ref8">8, 13</xref>
        ]),
Semantic Web applications (e.g. legislative XML and RuleML [
        <xref ref-type="bibr" rid="ref18 ref5">5, 18</xref>
        ]), as well as
verification of normative systems, and modelling of the normative behaviour of
organisations (e.g. company policies specifications or contracting [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]).
      </p>
      <p>
        The semantics of MLs, and of SDL in particular, is traditionally based on
relational frames, consisting of a set of possible worlds endowed with a binary
accessibility relation [
        <xref ref-type="bibr" rid="ref16 ref9">9, 16</xref>
        ]. These structures, used to interpret modal operators
(e.g. deontic, epistemic, dynamic, etc.), represent the connections between
possible situations. For instance, in SDL, a proposition is said to be obligatory in some
possible world w, if it holds in all worlds related to w, interpreted as morally
ideal alternatives to w. However, all the so-called normal MLs, based on this
semantics, face the problem of validating principles that, in several applications,
can be hardly associated with an acceptable meaning. In SDL, these principles
lead to several counter-intuitive conclusions, often presented in the form of
deontic paradoxes. For instance, if it is obligatory to perform an action, and if this
action always implies a negative consequence, then we are forced to conclude
that also the latter is obligatory. Problematic arguments like this one represent
a strong limitation to the applicability of SDL to normative reasoning [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>
        To overcome these problems, a different semantics, based on neighbourhood
(or minimal ) models, has been proposed [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Instead of using a set of worlds
endowed with an accessibility relation, this approach associates to each situation w
a family of sets of worlds. These sets intuitively represent the propositions that
are obligatory (or believed, brought about, etc.) in w. MLs based on this
semantics can satisfy weaker principles, without validating those axioms and rules that
are common to all normal MLs. For this reason, they are called non-normal MLs.
At the propositional level, non-normal MLs based on neighbourhood semantics
have received considerable attention [
        <xref ref-type="bibr" rid="ref10 ref20">20, 10</xref>
        ], with results reducing validity in
propositional non-normal MLs to validity in normal ones [
        <xref ref-type="bibr" rid="ref15 ref17">17, 15</xref>
        ]. To increase
the expressive power of these formalisms, first-order non-normal MLs based on
neighbourhood semantics have been considered as well [
        <xref ref-type="bibr" rid="ref27 ref3 ref7">27, 3, 7</xref>
        ].
      </p>
      <p>
        Not much has been done yet in applications of non-normal MLs to
knowledge representation, in particular, to normative automated reasoning. Most of
the modal description logics (MDLs) considered in the literature are based on
the standard relational semantics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Modal extensions of ALC with
neighbourhood semantics have been introduced as a basis of coalition logic [
        <xref ref-type="bibr" rid="ref22 ref24">22, 24</xref>
        ]
and agent communication [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] languages for reasoning over structured domains.
However, in normative settings, these MDLs still share several problems of
propositional normal MLs. Failing to address this issue can lead to serious drawbacks
to normative reasoning in knowledge-based systems. In this paper we study
nonnormal MDLs, interpreted over neighbourhood models, satisfying only minimal
requirements on the modal operators. With these formalisms, counter-intuitive
inferences in normative scenarios can be blocked, while still retaining the
expressive power needed in knowledge representation.
      </p>
      <p>
        In Section 2 we present MDLs, both recalling the standard relational
semantics, and introducing the neighbourhood models used for non-normal MDLs. In
Section 3 we model with MDLs a scenario involving normative notions, discussing
deontic paradoxes due to relational semantics, and how they can be blocked using
neighbourhood models. Then, in Section 4, we study the complexity of the
formula satisfiability problem for non-normal MDLs. We prove NExpTime-upper
bounds for the complexity of the satisfiability problem, showing that reasoning is
not harder than in basic (normal) modal DLs with the relational semantics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
Directions for future work are discussed in Section 5.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Preliminaries</title>
      <p>We start by introducing the required notation for normal and non-normal MDLs.
Syntax. Let NC, NR and NI be countably infinite and pairwise disjoint sets
of concept names, role names, and individual names, respectively. An MLnALC
concept is an expression of the form C; D ::= A j :C j C u D j 9r:C j 2iC;
where A 2 NC, r 2 NR, and 2i, with 1 i n, are modal operators called
boxes. An MLnALC atom is either a concept inclusion (CI ) of the form C v D,
oAr 2anNaCs,serrt2ionNRo,f athned fao;rbm2A(NaI). AornrM(aL;bnA)L,CwhfoerrmeuCl a;Dis aarne MexLpAreLsCsiocnonocfeptthse,
form '; ::= j :' j ' ^ j 2i'; where is an MLnALC atom, and 1 i
n. We will use the following standard definitions for concepts: ? A u :A,
&gt; :?; 8r:C :9r::C; (C t D) :(:C u :D); 3iC :2i:C (3i are
called diamonds). Concepts of the form 2iC, 3iC are called modalised concepts.
Analogous conventions also hold for formulas. In particular, we write C =_ D for
C v D ^ D v C.</p>
      <p>Relational Semantics. A relational frame (or R-frame) is a structure F =
(W; fRigi2[1;n]), where W is a non-empty set and each Ri is a binary relation
on W . An MLnALC relational model (or R-model ) based on an R-frame F is a
structure M = (F; ; I), where is a non-empty set, called the domain of M ,
and I is a function associating with every w 2 W an ALC interpretation (or
model ) I(w) = ( ; I(w)) having domain , and where I(w) is a function such
that: for all A 2 NC, AI(w) ; for all r 2 NR, rI(w) ; for all a 2 NI,
aI(w) 2 , and for all u; v 2 W , aI(u) = aI(v)(denoted by aI ). Given an R-model
M = (F; ; I) and a world w in F , the interpretation of a concept C in w,
written CI(w), is defined by taking:
(:C)I(w) =</p>
      <p>n CI(w);
(9r:C)I(w) = fd 2</p>
      <p>A concept C is satisfied in M if there is w in F s.t. CI(w) 6= ;, and that C
is satisfiable (over R-models) if there is an R-model in which it is satisfied. The
satisfaction of a MLALC formula ' in w of M , written M; w j= ', is defined as:
M; w j= C v D iff CI(w)</p>
      <p>DI(w);
M; w j= A(a) iff aI 2 AI(w);</p>
      <p>M; w j= r(a; b) iff (aI ; bI ) 2 rI(w);
M; w j= :' iff</p>
      <p>M; w 6j= '; M; w j= ' ^ iff M; w j= ' and M; w j= ;</p>
      <p>M; w j= 2i' iff for all v 2 W : if wRiv, then M; v j= ':
Given an R-frame F = (W; fRigi2[1;n]) and an R-model M = (F; ; I), we say
that ' is satisfied in M if there is w 2 W s.t. M; w j= ', and that ' is satisfiable
(over R-models) if it is satisfied in some R-model. Also, ' is said to be valid in
M , M j= ', if it is satisfied in all w of M , and it is valid on F if, for all M based
on F , ' is valid in M , writing F j= '. Moreover, ' logically implies a formula
, writing ' j= , if M; w j= ' implies M; w j= , for every M and every w in
M . Recall that the concept satisfiability problem can be reduced to the formula
satisfiability problem, since C is satisfiable iff :(C v ?) is satisfiable.</p>
      <p>Neighbourhood Semantics. A neighbourhood frame (or N-frame) is a pair
F = (W; fNigi2[1;n]), where W is a non-empty set and, for each 1 i n,</p>
      <sec id="sec-2-1">
        <title>Ni : W ! P(P(W)) is called a neighbourhood function. A frame is supplemented</title>
        <p>if for all ; W, 2 Ni(w) and implies 2 Ni(w); it is closed
under intersection if 2 Ni(w) and 2 Ni(w) implies \ 2 Ni(w); and
it contains the unit if for all w 2 W; W 2 Ni(w). An MLnALC neighbourhood
model (or N-model ) based on an N-frame F is a triple M = (F ; ; I), where
F = (W; fNigi2[1;n]) is a neighbourhood frame, is a non-empty set called
the domain of M, and I is a function associating with every w 2 W an ALC
interpretation I(w) = ( ; I(w)), defined as above. Given a model M = (F ; ; I)
and a world w in F , the interpretation of a concept C in w, written CI(w), is
defined as for the relational semantics, except from:
where, for all d 2 , the set [C]dM = fv 2 W j d 2 CI(v)g is called the truth
set of C with respect to d. We say that a concept C is satisfied in M if there is
w in F s.t. CI(w) 6= ;, and that C is satisfiable (over N-models) if there is an
N-model in which it is satisfied. The satisfaction of an MLALC formula ' in w
of M, written M; w j= ', is defined analogously to relational semantics, and as
follows for modalised formulas:</p>
        <p>M; w j= 2i'
iff
[']M 2 Ni(w);
where [ ]M denotes the set fv 2 W j M; v j= g of the worlds v that satisfy ,
also called the truth set of . As a consequence of the above definition, we obtain
the following condition for diamond formulas: M; w j= 3i' iff [:']M 2= Ni(w).
Given an N-frame F = (W; fNigi2[1;n]) and an N-model M = (F ; ; I), we say
that ' is satisfied in M if there is w 2 W s.t. M; w j= ', and that ' is satisfiable
(over N-models) if it is satisfied in some N-model. Other semantical definitions
can be easily adapted from the relational semantics case.</p>
        <p>
          Frames and Satisfiability Problems. In the following, we use F to stand
either for an N- or R-frame, and M for a N- or R-model. To define the MLnALC
formula satisfiability problems studied in this paper, we consider the principles
listed in Table 1 (where C; D and '; are MLnALC concepts and formulas,
respectively). Here, S is either a frame F, or a model M. For a principle P , if
S = F (respectively, S = M), we say that P holds on F (respectively, in M). On
the correspondence between the principles in Table 1 and conditions over frames
and models, we have the following result (see e.g. [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] for the propositional case).
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Theorem 1. Given an N-frame F , we have that: (i) congruence holds on F ;</title>
        <p>(ii) monotonicity holds on F iff F is supplemented; (iii) agglomeration holds on</p>
      </sec>
      <sec id="sec-2-3">
        <title>F iff F is closed under intersection; (iv) necessitation holds on F iff F contains</title>
        <p>the unit. Given an R-frame F , congruence, monotonicity, agglomeration, and
necessitation hold on F ; moreover, for every R-model M , they hold in M .
(Monotonicity)
(Agglomeration)
(Necessitation)</p>
        <p>S j= C =_ D implies S j= 2iC =_ 2iD.</p>
        <p>S j= ' $ implies S j= 2i' $ 2i .</p>
        <p>S j= C v D implies S j= 2iC v 2iD.</p>
        <p>S j= ' ! implies S j= 2i' ! 2i .</p>
        <p>S j= 2iC u 2iD v 2i(C u D).</p>
        <p>S j= 2i' ^ 2i ! 2i( ^ ).</p>
        <p>S j= &gt; v C implies S j= &gt; v 2iC.</p>
        <p>S j= ' implies S j= 2i'.
or RB-y) ftrhaemMesLCnALwCe fmoremanultahesaptriosfibalebmilitoyf dperocibdleinmg
iwnhaethclearsasnoMf(LrenAsLpCecftoivrmelyu,laNissatisfied in a (respectively, N- or R-) model based on a frame in C. The formula
satisfiability problem for EnALC , MnALC , and KnALC is the MLnALC formula
satisfiability problem in the class of N-frames, supplemented N-frames, and R-frames,
respectively.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Modelling</title>
      <p>
        In this section we model well-known paradoxes that normal MLs with relational
semantics have to face in normative applications [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Firstly, the MDLs language
introduced in Section 2 is used to provide a running example, that also illustrates
more expressive (with respect to the propositional case) features of the language.
Then, we show how principles validated by all normal MLs, and thus also by
the standard MDLs based on relational models, can affect reasoning in deontic
settings. We focus on the problems associated with necessitation, agglomeration,
and monotonicity in normal MDLs, claiming that the flexibility of neighbourhood
semantics represents an advantage in blocking problematic inferences.
Modelling Scenario. Consider the following variant of the classical trolley
problem scenario [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. A tram is moving towards a toddler lying on the tracks.
Although it is not possible to stop the trolley, an agent (called signaller ), possibly
an autonomous control system, can activate a switch that would divert it on a
side track, saving the toddler’s life. However, on the side track lies an elderly
that would be killed with the activation of the switch. Therefore, the switching
system has to decide among two (horrible) alternatives: (1) do not activate the
switch, allowing the tram to kill the toddler; (2) activate the switch, saving the
toddler’s life and allowing an elderly to be killed instead.
      </p>
      <p>For modelling purposes, it is crucial to have a formalism that allows to specify
both the factual features of the setting, and the ethical or legal aspects involved.
We assume that the domain consists of objects (e.g. a switch, a signaller, a
toddler, etc.), performing some actions (e.g. activating a switch) and bringing
about some consequences (e.g. to save, to kill) on each other. We represent classes
of objects with (unary) concepts, such as Switch, Signaller and Toddler, while
actions and consequences are formalised using (binary) roles, e.g., activates, saves
and kills. Obligations and permissions are indicated using 2 and 3, respectively.
For instance, the concept 9activates:Switch intuitively denotes the set of objects
that activate some switch, whereas 29activates:Switch is the set of entities that
are obliged to do so. The following example shows a simple N-model interpreting
these latter concepts according to the definitions given in Section 2.
Example 1. Let M = (F ; ; I) be a MLALC N-model, where F = (W; N ) is such
that W = fw; vg and N (w) = ffvgg, N (v) = ffwgg. Moreover, = fd1; d2; d3g,
and let SwitchI(w) = SwitchI(v) = fd2g, activatesI(w) = ;, and activatesI(v) =
f(d1; d2)g. We have (9activates:Switch)I(w) = ;, (9activates:Switch)I(v) = fd1g.
Moreover, [9activates:Switch]dM1 = fvg and [9activates:Switch]dMi = ;, for i 2
f2; 3g. Thus, (29activates:Switch)I(w) = fd1g and (29activates:Switch)I(v) = ;.</p>
      <p>Non-normal MDLs allow also for a meaningful distinction between de re
(applied to concepts) and de dicto (applied to formulas) modalities. For instance,
a signaller can be defined as an agent with the permission to activate a switch,
and a guard as an agent having the duty to check the rails, i.e.,
Signaller =_ Agent u 39activates:Switch;
Guard =_ Agent u 29checks:Rail:
Using modal operators over formulas, it is possible to express additional
normative specifications. For example, stating that it is obligatory that a guard who
detects some dangerous situation must alert a station agent, which in turn has
the duty to alert an emergency service:</p>
      <sec id="sec-3-1">
        <title>2 Guard u 9detects:DangerousSituation v 29alerts:(StationAgent u 29alerts:EmergencyService) :</title>
        <p>This flexibility in the application of modal operators allows us to assign different
sets of duties to the agents involved, while still enforcing these statements as
obligatory. To see this, compare the above definition of Guard with the case of a
bystander that happens to detect a situation of danger while checking the rails.
We could expect that it is obligatory for them to alert an emergency service,
without requiring that they ought to alert a station manager to do so. Namely,</p>
      </sec>
      <sec id="sec-3-2">
        <title>2(9checks:Rail u 9detects:DangerousSituation v 29alerts:EmergencyService):</title>
        <p>Problems for Necessitation. Consider the CI, valid on every frame, that
signallers either save a toddler, or they do not, i.e.,</p>
        <p>Signaller v 9saves:Toddler t :9saves:Toddler:
By Theorem 1, we have that on R-frames this formula is also obligatory:</p>
      </sec>
      <sec id="sec-3-3">
        <title>2(Signaller v 9saves:Toddler t :9saves:Toddler):</title>
        <p>
          This conclusion violates what is known in the literature as the principle of
deontic contingency [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ], according to which what ought to be the case cannot be
enforced within a deontic system by virtue of logical validity alone.
        </p>
        <p>More in general, given a formula ' that is valid in a R-model, we always have
that some logically implied formula is obligatory, even when ' contains only
factual statements describing the domain of interest. For instance, suppose that
the following formula , stating that a toddler is a person, and that no person
is a trolley, is valid in a R-model M :</p>
        <p>Toddler v Person ^ Person v :Trolley:
The formula specifies only some of the factual features of the trolley problem
scenario, without any reference to normative notions, and it logically implies
Toddler v :Trolley. However, since is assumed to be valid in M , we are forced
to conclude that also the latter is valid in M , and thus, due to Theorem 1,
we have that 2(Toddler v :Trolley) is valid in M . Although true as a factual
statement, it is not clear why it should be inferred that this ought to be the case.
Problems for Agglomeration. Given the following concept D describing a
moral dilemma,</p>
        <p>29activates:Switch u 2:9activates:Switch;
(that is, the obligation to activate a switch and the obligation not to do it), by
Theorem 1 we have that the following CI is valid on all R-frames:</p>
      </sec>
      <sec id="sec-3-4">
        <title>D v 2(9activates:Switch u :9activates:Switch):</title>
        <p>
          In other words, all objects incurring in a moral dilemma are also objects that are
obligated to do something inconsistent. This issue is sometimes presented in the
literature as the problem of self-inconsistent obligations for deontic agents [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ].
Problems for Monotonicity. Since ? v C, for any MLnALC concept C, is valid
on R-frames, by Theorem 1 we have for instance that on R-frames it is valid
        </p>
      </sec>
      <sec id="sec-3-5">
        <title>2(9activates:Switch u :9activates:Switch) v 29kills:Toddler</title>
        <p>
          Together with the CI discussed in the previous paragraph, we obtain that an
object in the extension of a moral dilemma (such as the one described by D) is
an object for which anything is obligatory, hence the names of universal
obligatoriness problem [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ], or deontic explosion [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
        </p>
        <p>Another problematic inference is known in the literature as the Ross’s
paradox. We have for instance that the following CI is valid on all R-frames:
9saves:Toddler v 9saves:Toddler t 9kills:Toddler:
If the concept 29saves:Toddler, denoting the set of objects for which it is
obligatory to save a toddler, is satisfiable, by Theorem 1 we obtain that the following
concept is satisfiable as well:</p>
      </sec>
      <sec id="sec-3-6">
        <title>2(9saves:Toddler t 9kills:Toddler):</title>
        <p>
          In other words, there can be individuals for which it is obligatory to save some
toddlers or to kill them. However, it is not easy to explain why the obligation to
save some toddlers should imply another obligation that can be fulfilled by killing
some of them. Indeed, if it is not possible for an agent to fulfil the obligation
to save some toddlers, it is still possible that they could partially attend to
their duties by respecting other normative constraints. An obligation that can
be fulfilled by killing some toddlers is a highly undesirable consequence that
could not be used as a partial justification in case the former goal (to save a
toddler) is not reachable. Therefore, it should not be derived in the normative
system [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ].
        </p>
        <p>
          Another similar difficulty related to monotonicity is known as the Good
Samaritan paradox [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. Suppose that the deontic concept 29activates:Switch,
denoting the set of entities for which it is obligatory to activate the switch, is
satisfied in a R-model M , and that 9activates:Switch v 9kills:Elderly, (meaning
that if someone activates the switch, then they kill some elderly) is valid in that
model. By Theorem 1, we have that also the following is valid in M :
29activates:Switch v 29kills:Elderly
Thus, the concept 29kills:Elderly is satisfied in M , i.e., there is an object for
which it is obligatory to kill an elderly. Although the killing of an elderly is a
consequence implied by the activation of the switch, the obligation to do so is a
consequence that a trustworthy moral agent should not be able to draw.
Example 2. In the N-model of Example 1, let killsI(w) = killsI(v) = f(d1; d3)g
and ElderlyI(w) = ElderlyI(v) = fd3g. For all u of M, M; u j= 9activates:Switch v
9kills:Elderly. For the concept 29kills:Elderly, we have [9kills:Elderly]dM1 = fw; vg,
and [9kills:Elderly]dM3 = ;. Since fw; vg 2= N (w), (29kills:Elderly)I(w) = ;.
Similarly, ; 2= N (v), and so (29kills:Elderly)I(v) = ;. Therefore, in particular, the
concept 29activates:Switch is satisfied in M, and the formula 9activates:Switch v
9kills:Elderly is satisfied in all worlds of M. However, the concept 29kills:Elderly
is not satisfied in M. Hence, the Good Samaritan paradox does not apply.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Satisfiability in Non-normal Modal Description Logics</title>
      <p>
        At the propositional level, logics En and Mn have both been used as a
basis for weak deontic systems [
        <xref ref-type="bibr" rid="ref1 ref9">1, 9</xref>
        ] (although Mn suffers from several problems
discussed in Section 3), as well as to interpret praxeological operators, such as
‘agent i has the ability to bring about '’ [
        <xref ref-type="bibr" rid="ref20 ref6">6, 20</xref>
        ]. Moreover, Mn has been
combined with ALC, as a basis for further coalition logic extensions of description
logic languages [
        <xref ref-type="bibr" rid="ref23 ref24">24, 23</xref>
        ], and En modal operators have been applied over ALC
axioms to formalise reasoning about agents’ intentions [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] (however, without
establishing tight complexity results). In this section we study the complexity of
the formula satisfiability problem in EnALC and MnALC . This result is then
lowered for fragments, denoted by Enjg and Mnjg , in which the modal operators
      </p>
      <p>ALC ALC
are applied globally, i.e., over ALC axioms only.
Satisfiability in EnALC and MnALC . We provide a NExpTime upper bound by
tursainngslaatrioenducytfiroonm,liMfteLdnAfLrComtotMheLp3ArnLoCpoissitdieofinnaeldcaasse,fotlolomwusl[t1i-7m,1o5d]a:l KAmLC . The
Ay = A;
(: )y = : y;
(9r:C)y = 9r:Cy;</p>
      <p>
        (C v D)y = Cy v Dy;
(
)y = y
y;
(2i )y = 3i1 (2i2 y
(#)y = #;
2i3 : y)
owrheforermAu2lasN, Ca, nrd2 NR2, #f uis; a^ng.asUsesritnigont,hisantrdansalaretibonot,hoeniethcearnMsLhnAoLwC tchoantcetphtes
satisfiability problem in N-frames is reducible to the formula satisfiability in the
relational case [
        <xref ref-type="bibr" rid="ref15 ref17">17, 15</xref>
        ]. Since satisfiability in K3AnLC is known to be
NExpTimecomplete [14, Theorem 15.15], we obtain the following complexity result.
Theorem 2. Satisfiability in EnALC is in NExpTime.
      </p>
      <p>Proof (Sketch). Let ' be an MLnALC formula s.t. M; w j= ', for some N-model
M = (F ; ; I) and some w in F = (W; fNigi2[1;n]). We define an R-frame
F = (W; fRij gi2[1;n];j2[1;3]) and an ML3n</p>
      <p>ALC R-model M = (F; ; I) s.t.:
– W = f(w; 0) j w 2 Wg [ f( ; 1) j 2 Sv2W Ni(v)g
– Ri1 = f((w; 0); ( ; 1)) j 2 Ni(w)g;
– Ri2 = f(( ; 1); (w; 0)) j w 2 g
– Ri3 = f(( ; 1); (w; 0)) j w 62 g
– for every (w; 0) 2 W , I(w; 0) = I(w); for every ( ; 1) 2 W , XI( ;1) = ;, for
all X 2 NC [ NR, and aI( ;1) = aI , for all a 2 NI.</p>
      <p>The pairs (w; 0); ( ; 1) are used to ensure that W is the disjoint union of the
sets of worlds w and subsets of W. By induction on concept and formulas
occurring in ', one can show that M; (w; 0) j= 'y. Conversely, given a ML3n
formula 'y s.t. M; w j= 'y, for some ML3AnLC R-model M = (F; ; I) basedALonC
F = (W; fRij gi2[1;n];j2[1;3]), and some w 2 W , we define a MLnALC N-model
M = (F ; ; I) based on F = (W; fNigi2[1;n]) s.t. W = W , and for all w 2 W :
– 2 Ni(w) iff there is v 2 W s.t. wRi1 v and: (i) for all u 2 W , vRi2 u ) u 2
, and (ii) for all u 2 W , vRi3 u ) u 62 ;
– I(w) = I(w).</p>
      <p>Again, by induction, we obtain that M; w j= '.</p>
      <p>
        The translation z from MLnALC to ML2AnLC is defined as y on all concepts and
formulas, except from the modalised concepts or formulas [
        <xref ref-type="bibr" rid="ref15 ref17">17, 15</xref>
        ]:
tu
(2i )z = 3i1 2i2 z:
f1Wo4re]m.oubltaaisnataisnfiuabpiplietrybporuonbdleman afolorgMounAsLtoC tthoethoneesafomreEpnArLobClebmy aforredKu2AcntLioCn[1o7f,t1h5e,
Theorem 3. Satisfiability in MnALC is in NExpTime.
      </p>
      <p>Proof (Sketch). The proof is similar to the one of Theorem 2. Given an N-model
bMaLse2dn on a supplemented N-frame satisfying an MLnALC formula ', we define an</p>
      <p>
        ALC R-model satisfying 'z as above, by using relations Ri1 and Ri2 only. To
prove the inductive step for modalised formulas 2i occurring in ', we use the
fact that, in N-models M based on supplemented N-frames F = (W; fNigi2[1;n]),
M; w j= 2i is equivalent to: there is 2 Ni(w) s.t. [ ]M. Conversely,
given a ML2AnLC R-model M = (F; ; I) based on F = (W; fRij gi2[1;n];j2[1;2])
and satisfying 'z, we define a MLnALC N-model M = (F ; ; I) based on F =
(W; fNigi2[1;n]) s.t. W = W and, for all w 2 W : I(w) = I(w); 2 Ni(w) iff
there is v 2 W s.t. wRi1 v and for all u 2 W , vRi2 u ) u 2 . The N-frame F
so defined is supplemented: for all w 2 W , if 2 Ni(w) and W , then
there is v 2 W s.t. wRi1 v and for all u 2 W , vRi2 u ) u 2 , i.e., 2 Ni(w).
Moreover, by induction, we have that M satisfies '. tu
SEanAtjLgiCsfiaanbdilMitynAjLgiCn uEsinAnjLggCthaenndotMionAnjLgoCf.a Wpreopnooswitsiohnoawl atibgshttraccotmiopnleoxf iatyforremsuulltas (faosr
in, e.g., [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]). Here, one can separate the satisfiability test into two parts, one for
the description logic dimension and one for the dimension of the neighbourhood
frame. The propositional abstraction 'prop of an EnAjLgC formula ' is the result
of replacing each ALC atom in ' by a propositional variable, so that there is a
1 : 1 relationship between the ALC atoms occurring in ' and the propositional
letters p used for the abstraction. The semantics of 'prop is given in terms of
propositional N-models (W; fNigi2[1;n]; V) for En, where (W; fNigi2[1;n]) is a
N-frame and V : NP ! P(W) is a function mapping propositional variables
in NP to sets of worlds (see [
        <xref ref-type="bibr" rid="ref26 ref9">9, 26</xref>
        ]). We denote by NP(') the set fp 2 NP j
is an ALC atom in 'g. Given an Enjg formula ', we say that a propositional
      </p>
      <p>ALC
N-model MP = (W; fNigi2[1;n]; V) of 'prop is '-consistent if, for all w 2 W, the
following ALC formula is satisfiable</p>
      <p>V
p 2NP(w)
^ V
p 2NP(w) :
where NP(w) = fp 2 NP(') j w 2 V(p )g and NP(w) = NP(') n NP(w). We
anbowstrfaocrtmioanlsisweitthhethcoenfnoellcotwioinngbleetmwmeean. EnAjLgC formulas and their propositional
LEenmmmodael1.. A formula ' is EnAjLgC satisfiable iff 'prop is satisfied in a '-consistent</p>
      <p>We assume that the primitive connectives used to build propositional
formulas are : and ^ (_ is expressed using : and ^), and we denote by sub('prop)
the set of subformulas of 'prop closed under single negation. A valuation for a
propositional ML formula 'prop is a function : sub('prop) ! f0; 1g that satisfies
the following conditions: (1) for all : 2 sub('prop), ( ) = 1 iff (: ) = 0;
(2) for all 1 ^ 2 2 sub('prop), ( 1 ^ 2) = 1 iff ( 1) = 1 and ( 2) = 1;
and (3) ('prop) = 1. We say that a valuation for 'prop is '-consistent if any
N-model of the form (fwg; fNigi2[1;n]; V) satisfying w 2 V(p ) iff (p ) = 1, for
all p 2 NP('), is '-consistent. We now establish that satisfiability of 'prop in a
'-consistent model is characterized by the existence of a '-consistent valuation
satisfying the property described in Lemma 2.</p>
      <sec id="sec-4-1">
        <title>Lemma 2. A formula 'prop is satisfied in a '-consistent En model iff there is a</title>
        <p>'-consistent valuation for 'prop such that if 2i 1 and 2i 2 are in sub('prop),
(2i 1) = 1, and (2i 2) = 0, then ( 1 ^ : 2) _ (: 1 ^ 2) is satisfied in a
'-consistent En model.</p>
        <p>
          To determine satisfiability of 'prop in a '-consistent model, we use Lemma 2
and the fact that there are only quadratically many formulas of the form 1 ^
: 2, where 1 and 2 are subformulas of 'prop. We observe that satisfiability in
ALC is ExpTime-complete [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] and so, one can determine in exponential time
whether a valuation is '-consistent. For an ExpTime upper bound, one can
deterministically compute all possible '-consistent valuations for 1 ^ : 2 and
decide satisfiability of 'prop by a '-consistent model using a bottom-up strategy
(as in [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]). As satisfiability in ALC is ExpTime-hard our upper bound is tight.
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Theorem 4. Satisfiability in Enjg</title>
        <p>ALC</p>
        <p>is ExpTime-complete.</p>
        <p>Regarding the proof for Mnjg , we first point out that Lemma 1 can be easily</p>
        <p>ALC
adapted to MnAjLgC . The proof for our ExpTime result for MnAjLgC is analogous to
the one given for Enjg , except that here we use a variant of Lemma 2 tailored</p>
        <p>
          ALC
for Mn (see Proposition 3.8 in [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]). Thus, we obtain also the following result.
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>Theorem 5. Satisfiability in Mnjg</title>
        <p>ALC
is ExpTime-complete.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>We have studied non-normal MDLs based on neighbourhood models, showing
how to express normative specifications in a deontic scenario, and highlighting
the differences with relational semantics. We have established complexity results
ftohreitrhreesspaetcistfiivaebiflriatygmpernotbsleEmnAjLignC tahned nMonnA-jLngCo,rmwaitlhMmDoLdsalEonApeLrCataonrds aMppnAliLeCd, oannldy
over the description logic axioms. These logics represent the basis for further
extensions in deontic, epistemic, and dynamic contexts. As future work, we plan
to study logics interpreted over suitably constrained neighbourhood frames, so to
provide additional reasoning capabilities in multi-agent systems. MDLs extended
with non-normal dyadic modal operators, to express conditional obligations or
beliefs, such as ‘it is obligatory/believed that ', given ’, represent another
direction for further research.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Anglberger</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gratzl</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roy</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Obligation, free choice, and the logic of weakest permissions</article-title>
          .
          <source>Rev. Symb. Logic</source>
          <volume>8</volume>
          (
          <issue>4</issue>
          ),
          <fpage>807</fpage>
          -
          <lpage>827</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Arkoudas</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bringsjord</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bello</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Toward ethical robots via mechanized deontic logic</article-title>
          .
          <source>In: AAAI fall symposium on machine ethics</source>
          . pp.
          <fpage>17</fpage>
          -
          <lpage>23</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Arló-Costa</surname>
            ,
            <given-names>H.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pacuit</surname>
          </string-name>
          , E.:
          <article-title>First-order classical modal logic</article-title>
          .
          <source>Stud. Logica</source>
          <volume>84</volume>
          (
          <issue>2</issue>
          ),
          <fpage>171</fpage>
          -
          <lpage>210</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ghilardi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>LTL over description logic axioms</article-title>
          .
          <source>ACM T. Comput. Logic</source>
          <volume>13</volume>
          (
          <issue>3</issue>
          ),
          <volume>21</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>21</lpage>
          :
          <fpage>32</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Boer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Winkels</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vitali</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Metalex XML and the legal knowledge interchange format</article-title>
          .
          <source>In: Computable Models of the Law</source>
          , pp.
          <fpage>21</fpage>
          -
          <lpage>41</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , M.A.:
          <article-title>On the logic of ability</article-title>
          .
          <source>J. Philos. Logic</source>
          <volume>17</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Calardo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rotolo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Quantification in some non-normal modal logics</article-title>
          .
          <source>J. Philos. Logic</source>
          <volume>46</volume>
          (
          <issue>5</issue>
          ),
          <fpage>541</fpage>
          -
          <lpage>576</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Casellas</surname>
          </string-name>
          , N.: Legal Ontology Engineering. Springer (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Chellas</surname>
            ,
            <given-names>B.F.</given-names>
          </string-name>
          :
          <article-title>Modal logic: an introduction</article-title>
          . Cambridge University Press (
          <year>1980</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Dalmonte</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Olivetti</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Negri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Non-normal modal logics: Bi-neighbourhood semantics and its labelled calculi</article-title>
          .
          <source>In: AiML</source>
          . pp.
          <fpage>159</fpage>
          -
          <lpage>178</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Dennis</surname>
            ,
            <given-names>L.A.</given-names>
          </string-name>
          , Fisher,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Slavkovik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Webster</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>Formal verification of ethical choices in autonomous systems</article-title>
          .
          <source>Robot. Auton. Syst</source>
          .
          <volume>77</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Erdur</surname>
            ,
            <given-names>R.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seylan</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>The design of a semantic web compatible content language for agent communication</article-title>
          .
          <source>Expert Syst</source>
          .
          <volume>25</volume>
          (
          <issue>3</issue>
          ),
          <fpage>268</fpage>
          -
          <lpage>294</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Francesconi</surname>
          </string-name>
          , E.:
          <article-title>A description logic framework for advanced accessing and reasoning over normative provisions</article-title>
          .
          <source>Artif. Intell. Law</source>
          <volume>22</volume>
          (
          <issue>3</issue>
          ),
          <fpage>291</fpage>
          -
          <lpage>311</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Gabbay</surname>
            ,
            <given-names>D.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kurucz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zakharyaschev</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Many-dimensional Modal Logics: Theory and Applications</article-title>
          . Elsevier (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Gasquet</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herzig</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>From classical to normal modal logics</article-title>
          .
          <source>In: Proof theory of modal logic</source>
          , pp.
          <fpage>293</fpage>
          -
          <lpage>311</lpage>
          . Springer (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Hansson</surname>
            ,
            <given-names>S.O.</given-names>
          </string-name>
          :
          <article-title>Alternative semantics for deontic logic</article-title>
          .
          <source>In: Handbook of Deontic Logic and Normative Systems</source>
          , pp.
          <fpage>445</fpage>
          -
          <lpage>497</lpage>
          . College Publication (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Kracht</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Normal monomodal logics can simulate all others</article-title>
          .
          <source>J. Symbolic Logic</source>
          <volume>64</volume>
          (
          <issue>1</issue>
          ),
          <fpage>99</fpage>
          -
          <lpage>138</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Lam</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hashmi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Enabling reasoning with LegalRuleML</article-title>
          .
          <source>TPLP</source>
          <volume>19</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. Meyer,
          <string-name>
            <given-names>J.C.</given-names>
            ,
            <surname>Wieringa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.J.</given-names>
            ,
            <surname>Dignum</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          :
          <article-title>The role of deontic logic in the specification of information systems</article-title>
          .
          <source>In: Logics for Databases and Information Systems</source>
          . pp.
          <fpage>71</fpage>
          -
          <lpage>115</lpage>
          . Kluwer (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Pacuit</surname>
          </string-name>
          , E.:
          <article-title>Neighborhood Semantics for Modal Logic</article-title>
          . Springer (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Pigozzi</surname>
            , G., van der Torre,
            <given-names>L.W.N.</given-names>
          </string-name>
          :
          <article-title>Multiagent deontic logic and its challenges from a normative systems perspective</article-title>
          .
          <source>FLAP</source>
          <volume>4</volume>
          (
          <issue>9</issue>
          ),
          <fpage>2929</fpage>
          -
          <lpage>2993</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Seylan</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Erdur</surname>
          </string-name>
          , R.C.
          <article-title>: A tableau decision procedure for ALC with monotonic modal operators and constant domains</article-title>
          .
          <source>ENTCS 231</source>
          ,
          <fpage>113</fpage>
          -
          <lpage>130</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Seylan</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jamroga</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Coalition description logic with individuals</article-title>
          .
          <source>ENTCS 262</source>
          ,
          <fpage>231</fpage>
          -
          <lpage>248</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Seylan</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jamroga</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>Description logic for coalitions</article-title>
          .
          <source>In: AAMAS</source>
          . pp.
          <fpage>425</fpage>
          -
          <lpage>432</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Thomson</surname>
            ,
            <given-names>J.J.:</given-names>
          </string-name>
          <article-title>The Trolley Problem</article-title>
          .
          <source>Yale LJ</source>
          <volume>94</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1395</fpage>
          -
          <lpage>1415</lpage>
          (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Vardi</surname>
          </string-name>
          , M.Y.:
          <article-title>On the complexity of epistemic reasoning</article-title>
          .
          <source>In: LICS</source>
          . pp.
          <fpage>243</fpage>
          -
          <lpage>252</lpage>
          (
          <year>1989</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Waagbø</surname>
          </string-name>
          , G.:
          <article-title>Quantified modal logic with neighborhood semantics</article-title>
          .
          <source>Math. Logic Quart</source>
          .
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <fpage>491</fpage>
          -
          <lpage>499</lpage>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>