<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">A Metamodel for Verifying Institutions</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author role="corresp">
							<persName><forename type="first">Francesco</forename><surname>Viganò</surname></persName>
							<email>francesco.vigano@lu.unisi.ch</email>
							<affiliation key="aff0">
								<orgName type="institution">Università della Svizzera italiana</orgName>
								<address>
									<addrLine>via G. Buffi 13</addrLine>
									<postCode>6900</postCode>
									<settlement>Lugano</settlement>
									<country key="CH">Switzerland</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">A Metamodel for Verifying Institutions</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">1591CA47807FC10A92FF61E5B5F91A47</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-24T14:54+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>To investigate the interdependencies existing among deontic positions (like powers and obligations) and the ontology defined by an institution, we have proposed to model institutions in terms of status functions imposed on agents and defined as aggregates of deontic positions. In this paper we present a metamodel of institutional reality which introduces a set of concepts necessary to describe an institution and their intended meaning. A main advantage of our approach resides in the fact that institutions modelled in terms of such concepts can be verified by applying model checking techniques. In particular, in our framework it is possible to state and verify a set of properties stemming from our metamodel to enhance the development of sound institutions.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Introduction</head><p>Institutions and normative systems have been put forward as a means for regulating open interaction systems where agents' internal states cannot be accessed or agents are implemented by different parties. In such systems, norms play a fundamental role because they create positive expectations in the outcomes of interactions and make more predictable the behavior of other agents which are assumed to be autonomous <ref type="bibr" target="#b6">[7,</ref><ref type="bibr" target="#b14">15,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b9">10,</ref><ref type="bibr" target="#b21">22,</ref><ref type="bibr" target="#b25">26]</ref>. But while in <ref type="bibr" target="#b6">[7]</ref> institutions define only norms, following <ref type="bibr" target="#b24">[25]</ref> in <ref type="bibr" target="#b8">[9]</ref> we have suggested that institutions also describe the ontology of the interaction context. For instance, the institution of the English Auction defines the very concept of winning an auction, which also implies that the winner ought to follow a set of norms.</p><p>To investigate the interdependencies existing among deontic positions (like institutionalized powers <ref type="bibr" target="#b15">[16]</ref> and obligations) and the ontology defined by an institution, in <ref type="bibr" target="#b27">[28]</ref> we have proposed to model institutions in terms of status functions imposed on agents and defined as aggregates of deontic positions. Our main tenet is that institutional facts are such only because they provide agents with possibilities of actions which are attributed to them only thanks to the common agreement of a community of agents. In particular, we characterize institutional events in terms of what status functions they impose or revoke, which reflect the powers and obligations created or cancelled in the system.</p><p>Once we have formalized an institution, we have also to ensure that it is sound and allows agents to reach the desired states of affairs. Furthermore, as soon as institutions become complex, without the aid of an automated techniques it is prohibitive to foresee all possible evolutions and states in which a system may evolve. For this reason in <ref type="bibr" target="#b27">[28]</ref> we have defined FIEVeL (Functions for Institutionalized Environments Verification Language), a high level language to model institutions in terms of status functions and which is amenable to model checking <ref type="bibr" target="#b3">[4]</ref>, either by translating it into the input language of an existing tool (e.g. Promela, the input language of SPIN <ref type="bibr" target="#b13">[14]</ref> as in <ref type="bibr" target="#b27">[28]</ref>) or by implementing a new model checker.</p><p>In this paper we focus our attention on the definition of a metamodel of institutions which defines a set of legal and philosophical concepts that we perceive as essential to describe institutional reality. In our framework, institutions are described with FIEVeL, a modelling language which provides a concrete syntax to formalize institutions in terms of such concepts. For this reason we say that such set of concepts and their relations define a metamodel <ref type="bibr" target="#b16">[17]</ref>, since they constitute a model of our modelling language. On the other hand, the institutional metamodel represents the upper ontology of institutional reality, since it introduces concepts that are extended to describe the ontology of institutions. For instance, any domain-dependent status function extends the notion of status function, which is abstractly defined as an aggregate of deontic position, by detailing what powers and obligations are associated to it.</p><p>The introduction of a metamodel allows us to define a library of domain-independent properties which not necessarily affect the functionality of an institution, but reflect the intended meaning of institutional concepts. For instance, if we empower agents participating to an auction to make bids but we always forbid them to do so, we obtain that it may be the case that agents make offers, but they will always violate the system of norms. Although such institution is functional (it allows agents to make bids), it is clearly irrational.</p><p>The remainder of this paper is structured as follows. Section 2 presents our metamodel, Section 3 discusses few domain-independent properties which can be verified by the tool presented in Section 4. In Section 5 we provide an example of verification activities that can be carried out in our framework by verifying the institution of property as it has been modelled and analyzed in <ref type="bibr" target="#b4">[5]</ref>, and finally in Section 6 we provide a comparison of our approach with related works.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">The Institutional Metamodel</head><p>Many researches on institutions and normative systems <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b9">10,</ref><ref type="bibr" target="#b21">22,</ref><ref type="bibr" target="#b25">26]</ref> share several common or strongly related notions such as the concepts of role, norms, and institutionalized powers <ref type="bibr" target="#b15">[16]</ref>. In this section we introduce our metamodel of institutions, that is, the set of concepts that we perceive as essential to specify an institution, the relationships existing between them, and their intended meaning. For the sake of brevity, we focus our attention on those aspects that are more relevant for the definition of what we call domainindependent properties, which, as we will see in Section 3, reflect important aspects of the institutional metamodel.</p><p>We express the semantics of the metamodel in terms of an order many-sorted first-order logic with temporal operators (OMSFOL). An order many-sorted first-order temporal logic is defined on a tuple S = Σ, ≤ Σ , V, C, F, P, ξ , which constitutes the signature of the logic, where Σ is a finite nonempty set of sort symbols; ≤ Σ is a partial order on Σ determining a hierarchy of sorts; V is a finite set of (individual) variables, including a denumerable variables for every sort; C is a finite set of (individual) constants; F is an finite set of function symbols; P is an finite set of predicate symbols; ξ is a function that assigns a sort to every variable and every constant, and a signature (i.e. a sequence of sorts) to every function symbol and every predicate symbol; signatures of predicate symbols may be empty sequences, while signatures of function symbols have at least one component. Sets Σ, V, C, F, and P are mutually disjoint and we will write σ 1 ≤ Σ σ 2 to say that σ 1 is a subsort of σ 2 .</p><p>Given sorts Σ, the set T σ of terms of sorts σ is the smallest set such that:</p><formula xml:id="formula_0">• v ∈ T σ if v ∈ V and ξ(v) ≤ Σ σ • c ∈ T σ if c ∈ C and ξ(c) ≤ Σ σ • f (t 1 , ..., t n ) ∈ T σ if f ∈ F, ξ(t i ) ≤ Σ [ξ(f )] i for 1 ≤ i ≤ n and [ξ(f )] 0 ≤ Σ σ</formula><p>where [ξ(q)] i refers to the i-th sort of the signature of a predicate or function symbol q. The set T of terms is the union of the sets T σ for all σ ∈ Σ and the set A of atomic formulae is the smallest set such that:</p><formula xml:id="formula_1">• (t 1 = t 2 ) ∈ A if there exists sort σ such that ξ(t 1 ) ≤ Σ σ and ξ(t 2 ) ≤ Σ σ; • P (t 1 , ..., t n ) ∈ A if P ∈ P and ξ(t i ) ≤ Σ [ξ(P )] i for 1 ≤ i ≤ n</formula><p>The set of formulae is defined according to the following grammar:</p><formula xml:id="formula_2">ϕ ::= α | ¬ϕ | ϕ ∧ ϕ | Xϕ | [ϕUϕ] | Eϕ</formula><p>where α is an atomic formula. Expressions true, false, (ϕ ∨ ψ), (ψ → ϕ), (ϕ ↔ ψ), ∃xϕ, ∃ ≤n xϕ, ∃ ≥n xϕ, Fϕ, Gϕ, Aϕ, and t 1 = t 2 are introduced as abbreviations as usual.</p><p>The semantics of an order many-sorted first-order temporal logic is defined as usual <ref type="bibr" target="#b19">[20]</ref> by providing a set of states, a total transition relation among states, a set of domains (one for each sort), and an interpretation function I which maps, for each state, constants to individuals, and function and predicate symbols to functions and relations on domains.</p><p>Despite OMSFOL models and formulae can be translated into classical first-order logic with temporal operators (FOL) or, under certain conditions, into temporal propositional logic like CTL * <ref type="bibr" target="#b3">[4]</ref> (see Section 4), we adopt OMSFOL for two main reasons: i) it represents an abbreviated form for long and complex FOL or CTL * formulae and ii) OMSFOL guarantees syntactic type checking of formulae. Moreover, institutions describe rules that typically are independent of the number of agents, objects, etc. involved in the interaction, which can be naturally expressed by allowing quantification over sorts.</p><p>In the remainder of this section we will introduce the semantics of the institutional metamodel by explaining what sorts, functions, and predicates are induced by each institutional concept. For predicates and functions we also provide their signature ξ. Figure <ref type="figure" target="#fig_0">1</ref> depicts some of the main sorts used in our approach (e.g. status function, obligation, event) and their relations, which are typically represented by introducing predicates or functions. For instance, relation actor is reflected in our logic by function actor, which refers to the actor of the current action (see below). Finally, we report a set of axioms which characterize institutional reality by imposing a set of restrictions A on the admissible valuations of institutional models <ref type="bibr" target="#b0">[1]</ref>. In the sequel we will represent such restrictions in terms of OMSFOL formulae (corresponding to LTL formulae), while in Section 3 we will introduce a set of properties that can be translated into CTL formulae.</p><p>Before starting the analysis of the concepts which constitute our metamodel, it is worth to mention few basic sorts like integers, agents (σ AID ), and objects, which are introduced to describe types of domaindependent attributes associated to status functions and events. Designers can also define context dependent basic sorts.</p><p>As shown in Figure <ref type="figure" target="#fig_0">1</ref>, our metamodel is based on the notion of agent status function, that is, a status imposed on an agent and recognized as existing by a set of agents. Typical examples of status functions are not only the concept of auctioneer, participant, or winner of an auction, but also being the owner of a good, being the husband or the wife of somebody. The concept of status function shares several features with the concept of role as it has been discussed in the literature (refer to <ref type="bibr" target="#b1">[2]</ref> for an overview). Despite that, we prefer to use the term "status function" for three reasons: (i) the term role has been used with different meanings and it has been characterized in terms of very different concepts such as mental states, tasks, duties, etc; (ii) the term status function better represents the fact that we are concerned with status whose existence depends on those agents that recognize them as existing and which are assigned to agents to create new institutional powers or to regulate their use; (iii) the concept of status function is broader than the concept of role as used, for example, in <ref type="bibr" target="#b1">[2]</ref>. In fact, it seems to be difficult to describe in terms of a "preexisting organization" being the owner of a good or being under age, while it is quite natural to regard them as status functions imposed by a group of agents.</p><p>Status functions induce sort σ SF , which represents the supertype of all status functions described by an institution. σ SF defines function subject which refers to the agent the status function has been assigned to (ξ(subject) = σ AID , σ SF ) and predicate assigned (ξ(assigned) = σ SF ) which evaluates to true  when a status function is currently assigned. Status functions are imposed (or revoked) when an institutional event happens (see below), otherwise they continue to be assigned (unassigned).</p><p>Status functions are possibly empty aggregates of deontic positions that can be expressed in terms of two main concepts, institutionalized power <ref type="bibr" target="#b15">[16]</ref> <ref type="foot" target="#foot_0">1</ref> and obligations. Obligations induce sort σ o whose individuals reify norms of institutions in such a way that it is possible to classify institutional states with respect to agents' compliance with norms, or adopting the terminology used in <ref type="bibr" target="#b18">[19,</ref><ref type="bibr" target="#b22">23,</ref><ref type="bibr" target="#b25">26]</ref>, it is possible to classify states as red (violating at least a norm) or green states (all norms are respected). Obligations can be also used to express prohibitions by specifying suitable violation expression, while we do not define a specific construct to explicitly represent the fact that an agent is permitted to perform an action as in <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b9">10,</ref><ref type="bibr" target="#b21">22]</ref>. Instead, we consider that every action, if it is not prohibited, is also permitted.</p><p>Given sort σ state , which introduces constants unf ired, activated, and inactive, obligation sort σ o is characterized by function state (ξ(state) = σ state , σ o ) and by a set of predicate (start, fulfillment, and violation of signature ξ(violation) = σ o ) which are used to specify conditional obligations and when a norm should be considered fulfilled or violated according to the state machine represented in Figure <ref type="figure" target="#fig_2">2</ref>. An obligation is created because a status function is imposed, changes its state when its conditions are satisfied, and eventually reaches a final state (inactive) either because it is fulfilled (violated) or because it is associated to a revoked status function. Figure <ref type="figure" target="#fig_2">2</ref> graphically describes a set of axioms which regulate the temporal evolution of an obligation individual: for instance, the following axiom states that if an obligation has been activated and in the following state violation or f ulf illment are evaluated to true, then the next state is inactive:</p><formula xml:id="formula_3">G∀o∀sf (state(o) = activated ∧ X(assigned(sf ) ∧ of StatusF unction(o) = sf ∧(violation(o) ∨ f ulf illment(o))) → X(state(o) = inactive))<label>(1)</label></formula><p>To record whether an obligation has been violated, we introduce predicate violated of signature ξ(violated) = σ o . Predicate violated is evaluated to true in a given state if an obligation was activated and the violation expression is evaluated to true:</p><formula xml:id="formula_4">G∀ob(state(ob) = activated ∧ Xviolation(ob) → Xviolated(ob))<label>(2)</label></formula><p>Given that at the moment our metamodel does not provide any support for the definition of recovery policies or sanctions <ref type="bibr" target="#b18">[19]</ref>, we assume that once an obligation has been violated, predicate violated is always evaluated to true. Formally:</p><formula xml:id="formula_5">G∀ob(violated(ob) → Xviolated(ob))<label>(3)</label></formula><p>The definition of axioms that regulate the temporal evolution of an obligation and when a norm is violated allows us to automatically classify states as red or green with respect to every norm, while in <ref type="bibr" target="#b22">[23]</ref> the designer is required to manually specify which states are red or green.</p><p>According to Figure <ref type="figure" target="#fig_0">1</ref>, obligations are associated to status functions and not directly to agents. In general, an agent is responsible for the state of affairs described by a fulfillment or violation expression because it has been assigned a specific status function. For this reason we introduce function liable(ob), which is defined as follows:</p><formula xml:id="formula_6">liable(ob) ↔ subject(of StatusF unction(ob))</formula><p>where given an obligation, function of StatusF unction (ξ(of StatusF unction) = σ SF , σ o ) returns the associated status function.</p><p>The metamodel defines two kinds of events, base-level events (σ BE ) and institutional events (σ ie ), which are characterized by an ontological difference: while the former exist because they reflect changes that are produced in the physical world or that are relative to lower level institutions, like time events and exchangemessage events, the latter exist because they are recognized as existing by a community of agents and cannot be directly produced by the environment or by an agent <ref type="bibr" target="#b24">[25,</ref><ref type="bibr" target="#b8">9]</ref>. Despite that, we define both types of events as subsort of sort event (σ ev ) which defines predicate happens (ξ(happens) = σ ev ) and which is evaluated to true when event ev has caused the last transition. Analogously, sort σ ia represents common features of base-level actions and of institutional actions, e.g. "actions are always performed by an actor" (ξ(actor) = AID, σ act ). For convenience we define predicate done as an abbreviation to say that "agent x has performed action act": done(act, x) ↔ (happens(act) ∧ actor(act) = x)</p><p>It is important to observe that in the literature only agent actions have been considered relevant to describe institutions <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b21">22,</ref><ref type="bibr" target="#b25">26]</ref>, and the attention has been focused on a single action type, namely the act of exchanging a message <ref type="bibr" target="#b6">[7,</ref><ref type="bibr" target="#b8">9]</ref>. In contrast, we are also interested in modelling the institutional effects of events that are not generated by agents, like for instance time events, which not only are important for the management of obligations, but also may count as institutional events. For instance, in most cultures the 18th birthday imposes new status functions on a person.</p><p>We regard time aspects in two distinct ways: (i) as in classical temporal logic, to define qualitative aspects (it is always the case that a revoked status function is associated only to inactive obligations), and (ii) as in RTTL <ref type="bibr" target="#b20">[21]</ref> to express quantitative aspects (e.g. an obligation will be violated in 2 time instants since now). To define quantitative aspects, we consider the perspective of a single centralized component which makes the institutional (normative) state evolve: therefore, we consider the existence of a unique timer that generates time events such that two consecutive time events t i and t i+1 may be separated by a sequence (possible empty) of other base-level events, which are assumed to occur at time t i . Hence the institutional state may change due to the occurrence of other events even if the timer has not generated new ticks of the clock. Although multiagent systems are distributed in nature, which makes problematic the assumption of unique notion of time or the adoption of an architecture where a single centralized manager control the evolution of the institutional state, to cope with the state explosion problem <ref type="bibr" target="#b3">[4]</ref> we decide to introduce such simplification. It is worth noticing that centralized managers of the institutional states have been also proposed in several prototypes of institutions <ref type="bibr" target="#b5">[6,</ref><ref type="bibr" target="#b10">11]</ref> and normative systems <ref type="bibr" target="#b7">[8]</ref>.</p><p>Institutional events are defined by an institution and represent changes in the institutional environment. Essentially, their occurrence means that new status functions have been imposed on agents or existing status functions have been revoked. Sort σ ie defines two predicates, prec and ef f which express the preconditions and effects of an institutional event. More precisely, for every institutional event prec (ξ(prec) = σ ie ) describes a condition that must be satisfied before institutional event ie occurs, while ef f describes a condition satisfied after ie has occurred. But how agents recognize when an institutional event happens?</p><p>Following <ref type="bibr" target="#b24">[25]</ref>, we regard the occurrence of an institutional event by subordinating it the occurrence of another event conventionally associated to it. We represent the existence of a convention 2 among two events by introducing predicate conv which associates the occurrence of an event to the occurrence of an institutional event (ξ(conv) = σ ev , σ ie ). We are now in position to define under what conditions an institutional event ie which is not also an institutional action may happen. An institutional event ie conventionally bounded to event ev happens when:</p><formula xml:id="formula_7">G∀ie∃ev(prec(ie) ∧ conv(ev, ie) ∧ Xhappens(ev) → Xhappens(ie))<label>(4)</label></formula><p>Instead, in the case of institutional actions a further condition must be satisfied, namely, the actor must be empowered to perform the institutional action <ref type="bibr" target="#b15">[16]</ref>. According to Figure <ref type="figure" target="#fig_0">1</ref> status functions are constituted by a set of powers, which are represented through predicate empowered (ξ(empowered) = σ SF , σ ia ) which means that status function sf is empowered to perform institutional actions of type ia. An institutional action happens when:</p><formula xml:id="formula_8">G∀ia∀aid∃act(prec(ia) ∧ ∃sf (subject(sf ) = aid ∧ empowered(sf, ia) ∧ assigned(sf ))</formula><p>∧X(happens(act) ∧ actor(act) = aid ∧ conv(act, ia)) → X(happens(ia))</p><p>Assuming that institutions are asynchronous systems and according to axiom <ref type="bibr" target="#b4">(5)</ref>, which ensures that if the agent that brings about action act is empowered to perform ia, then action ia is successfully performed, we require that given two action symbols act 1 and act 2 , if they are conventionally bounded and if they happen, the actor must be the same. Formally:</p><formula xml:id="formula_10">G∀act 1 ∀act 2 (conv(act 1 , act 2 ) ∧ happens(act 1 ) ∧ happens(act 2 ) → actor(act 1 ) = actor(act 2 ))<label>(6)</label></formula><p>Our treatment of the conventional generation of events extends the treatment presented in <ref type="bibr" target="#b8">[9]</ref>, since we do not take as our unique primitive to specify conventions the act of exchanging a message. Instead, any event can be used to define a new convention. In particular, our metamodel allows institutional events to be conventionally associated to other institutional events. For instance, the institutional act of transfer the possession may be conventionally bounded to the act of transfer the property.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Domain-Independent Properties</head><p>Once an institution has been defined in terms of the concepts described by our metamodel and the corresponding model has been generated by a model checker, there are two kinds of properties that a designer may want to verify, domain-independent properties and domain-dependent properties <ref type="bibr" target="#b27">[28]</ref>. Domain-dependent properties stem from peculiar features of the specified model and regard the functionality of an institution: for instance, we may want to ensure that an auctioneer cannot win an auction. Instead, domain-independent properties are defined to guarantee the rationality of an institution with respect to the intended semantics of the concepts provided by our metamodel. Notice that, in contrast with axioms discussed in Section2 which characterize the semantics of institutional concepts and cannot be falsified, domain-independent properties are verified by a model checker and may be unsatified by institutions. In this case we say that an institution is irrational with respect to such properties. For instance, a rational institution should be characterized by the fact that every institutional event must eventually happen in at least an execution:</p><formula xml:id="formula_11">∀ie EFhappens(ie)<label>(1)</label></formula><p>where ie is a variable of type σ ie . If this property does not hold, then it means that either the preconditions of an institutional event are never met or that the designer has not defined the necessary powers or conventions for its performance. Analogously, given a convention which relates events of type x and y, it should be the case that there exists a path where eventually both of them contemporary happen:</p><formula xml:id="formula_12">∀ev x ∀ev y (conv(ev x , ev y ) → EF(happens(ev x ) ∧ happens(ev y )))<label>(2)</label></formula><p>If this property does not hold, it means that agents cannot exploit the convention binding events of type x to events of type y, for instance because preconditions of such events are never contemporary satisfied or, in the case of actions, because status functions empowered to execute them are never assigned to an agent.</p><p>Let us now move our attention to a set of properties that should characterize norms. Norms are introduced in open multiagent systems to constrain possible agents' behaviour, and therefore it must be the case that each norm can be eventually activated:</p><formula xml:id="formula_13">∀obEF(state(ob) = activated)<label>(3)</label></formula><p>If we assume that agents are autonomous, it should be possible for an agent both to violate and fulfill its obligations (and prohibitions), which means that norms regulate aspects of (social) reality which are contingent. It would be irrational to define an obligation characterized by a violation expression that makes it impossible to violate it:</p><formula xml:id="formula_14">∀obAF(state(ob) = activated → Estate(ob) = activatedUviolated(ob))<label>(4)</label></formula><p>Similarly, we can specify that all obligations may be eventually fulfilled. Moreover, it should be the case that once a norm is activated, it ought to eventually reach a final state (inactive), which guarantees that the whole life-cycle of a norm is limited and regulated only by the institution that defines it:</p><formula xml:id="formula_15">AG∀ob(state(ob) = activated → A[state(ob) = activatedUstate(ob) = inactive])<label>(5)</label></formula><p>Notice that any obligation which is not characterized by a deadline (not necessarily a time expression) violates property <ref type="bibr" target="#b4">(5)</ref>. For instance, if an agent ought to maintain indefinitely a state, as a consequence the whole institution would not satisfy property <ref type="bibr" target="#b4">(5)</ref>.</p><p>Obligations are defined to indicate whether a given behaviour is accepted by an institutions and typically "involve sacrifice and renunciation" <ref type="bibr" target="#b12">[13]</ref>. For this reason, under the hypothesis that internal mental states are not accessible, it seems natural to assume that if an agent is obliged to a certain state of affairs it should not be provided with the possibility of revoking its own obligations. Otherwise, it could avoid complying with its duties without incurring in any sanction or blame. We formalize this fact as follows:</p><p>AG∀ob(state(ob) = activated → ¬EX(state(ob) = inactive ∧ ¬violation(ob) ∧¬f ulf illment(ob) ∧ ∃act done(act, liable(ob))))</p><p>The fact that an institution does not satisfy a domain-independent property does not necessarily mean that its rules prevent any successful interaction. It may be the case that all domain-dependent properties are satisfied while there are domain-independent properties that are violated. In any case, it is important that the designer becomes aware of this fact, and consider how to modify the institution. For instance, if property (1) does not hold, we can eliminate the institutional event or change powers and preconditions associated to it, otherwise its definition would be useless and the institution would be irrational.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">A Symbolic Model Checker for Verifying Institutions</head><p>Figure <ref type="figure" target="#fig_0">1</ref> represents not only the metamodel of the institutional reality, but also it constitutes the abstract syntax of FIEVeL (Functions for Institutionalized Environments Verification Language) <ref type="bibr" target="#b27">[28,</ref><ref type="bibr" target="#b28">29]</ref>, a language that has been defined to model institutions in terms of the concepts introduced by our metamodel and to verify them by applying model-checking techniques <ref type="bibr" target="#b3">[4]</ref>. As exemplified in Figure <ref type="figure" target="#fig_3">3</ref> and according to the institutional metamodel, an institution described in FIEVeL defines a set of status functions, characterized by powers and obligations, a set of institutional events and conventions for their performance. The semantics of FIEVeL constructs is given by describing how each expression affects the signature or the interpretation function of an OMSFOL logic characterized also by symbols introduced by our metamodel (see <ref type="bibr" target="#b28">[29]</ref> for more details about FIEVeL).</p><p>The adoption of an order many-sorted first-order logic to describe the semantics of FIEVeL, its metamodel, and properties of institutions, naturally rises the question about how to verify OMSFOL models by applying model-checking techniques, which usually are applied to propositional models <ref type="bibr" target="#b3">[4]</ref>. In the remainder of this section we will define an encoding E of OMSFOL models into propositional models and a translation τ of OMSFOL formulae into CTL * formulae which is exploited by our tool to verify institutions described in FIEVeL.</p><p>A propositional model is defined as a tuple M = F, AP , V where AP is a set of atomic propositions, and V is a valuation function which, given a state s ∈ S and a proposition p ∈ AP , returns a value in {0, 1}. Let be N Dσ the cardinality of domain D σ associated to sort σ: the set of atomic proposition AP is determined by introducing a set of propositions AP fx 1 ,..,xn ∈ AP of cardinality log 2 (N [ξ(f )]0 ) for every function f and for every possible valuation, and a proposition p x1,...,xn for every predicate P and for every valuation. Moreover, for every domain we associate to each individual el a natural number n el such that 0 ≤ n el &lt; N Dσ . The encoding E of an OMSFOL model into a propositional model M is defined as follows:</p><p>• each constant symbol c is encoded as a sequence of truth values corresponding to the binary representation of the number associated to the individual referenced by constant c (E[c] = binary(I(c, s)));</p><p>• each function f is encoded as the set of propositions induced by the current valuation (E[f (x 1 , ..., x n )] = AP f (x1,...,xn) );</p><p>• each predicate P is encoded as the proposition induced by the current valuation (E[P (x 1 , ..., x n )] = p x1,...,xn );</p><p>The valuation function V is such that given an interpretation function I and a state s, propositions AP fx 1 ,..,xn are evaluated as the encoding of the element referred by f (x 1 , ..., x n ) and proposition p x1,...,xn evaluates as the truth value corresponding to predicate P in state s.</p><p>Assuming that the language is rich, that is, there exists a constant symbol for each individual of every domain, and also assuming for simplicity that only variables and constants can appear as arguments of functions and predicates, the translation of a OMSFOL formula ϕ with temporal operators is defined as follows:</p><formula xml:id="formula_17">• τ [t 1 = t 2 ] = i&lt;N (ξ(t1)) i=0 ¬(E(t 1 ) i ⊕ E(t 2 ) i</formula><p>) where E(t) i refers to the i-th proposition (or equivalently the i-th truth value) corresponding to the encoding of term t;</p><formula xml:id="formula_18">• τ [P (x 1 , ..., x n )] = E(P (x 1 , ..., x n )) • τ [∀xϕ] = c∈C ξ(x) τ [ϕ[c/x]</formula><p>] where c ranges over constants of sort ξ(x) and ϕ[c/x] is the result of replacing every free occurrence of x in ϕ with an occurrence of c;</p><formula xml:id="formula_19">• τ [¬ϕ] = ¬τ [ϕ] • τ [ϕ ∧ ϕ] = τ [ϕ] ∧ τ [ϕ] • τ [Xϕ] = Xτ [ϕ] • τ [ϕUϕ] = τ [ϕ]Uτ [ϕ] • τ [Eϕ] = Eτ [ϕ]</formula><p>It can be demonstrated that:</p><p>Theorem 1 Given a model M, characterized by a OMSFOL signature and finite domains, and an OMSFOL formula ϕ, M |= ϕ if and only if</p><formula xml:id="formula_20">E[M] |= τ [ϕ].</formula><p>To verify domain-dependent and domain-independent properties we have implemented a symbolic model checker based on the CUDD library <ref type="bibr" target="#b26">[27]</ref>. Our tool takes as its input an institution modelled with FIEVeL, a list of individuals composing each basic domain, and a set of status functions which are assumed to be imposed at the first state. Domain-dependent properties are specified in a separate file, while domainindependent properties are selected by interacting with the tool. Starting from these inputs, the tool applies translation τ and encoding E to construct the corresponding Kripke structure, whose states and transition relation are symbolically represented as OBDDs <ref type="bibr" target="#b2">[3]</ref>. To verify properties whose translation corresponds to CTL formulae, that is, formulae where path quantifiers (A and E) are immediately followed by temporal operators (X, F, and G), the tool applies symbolic algorithms as described in <ref type="bibr" target="#b3">[4]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>basic-types:</head><p>priceD  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5">Modelling and Verifying the Institution of Property</head><p>In this section we report the results obtained during the verification process of the institution of property as it has been defined in <ref type="bibr" target="#b4">[5]</ref>. During the formalization of such institution (see Figure <ref type="figure" target="#fig_3">3</ref>) we have slightly modified certain features of the original specification to adapt them to our concepts. Despite these changes, results obtained with our formalization can be extended to the institutions described in <ref type="bibr" target="#b4">[5]</ref>. For the sake of brevity we will focus on those aspects that our analysis has shown to be problematic and which we deem highlight the importance of the definition of a metamodel of institutions.</p><p>In <ref type="bibr" target="#b4">[5]</ref> the institution of property defines an institutional action, transfer ownership, which is "empowered if the initiator of the transfer is the owner of the object being transferred". Furthermore a set of institutional actions are introduced, like requestGoods which allows a customer to request a good, sendPayment which can be performed by a customer to send a payment, refuseRequest which allows the merchant to refuse a request, and finally sendGoods which empowers the merchant to send a good. Notice that in <ref type="bibr" target="#b4">[5]</ref> it is not required that institutional actions happen because agents have performed basic actions conventionally bounded to them, which obliged us to introduce a set of base-level events and conventions to enable agents to perform institutional actions described above.</p><p>According to <ref type="bibr" target="#b4">[5]</ref> "sending a request for goods creates an obligation on the merchant to have sent the goods before the interaction ends" but "sending the refusal cancels the merchant's obligation to send goods". Therefore, the merchant can cancel an obligation of itself which intuitively violates property (6) discussed in the previous section.</p><p>Let us now consider how agents can execute action transfer good, which is defined in such a way that it can be successfully performed at time t if and only if either the merchant sends the good at time t and the customer has payed at time t 1 &lt; t, or the customer pays at time t and the merchant has sent the good at time t 1 &lt; t. Given such description it seems natural to introduce two conventions: conv 1 which states that the performance of the institutional act sendGood counts as transf er property if the customer has payed, and conv 2 such that sendP ayment counts as tranf er property if the merchant has sent the good. Such conventions reflect the fact that in <ref type="bibr" target="#b4">[5]</ref> the execution of sending a good (or similarly sending a Figure <ref type="figure">4</ref>: The report generated by our tool during the verification of domain-independent properties discussed in Section 3. payment) implies the transfer of property. At this point it is important to notice that if transf er property, sendGoods, and sendP ayment are institutional actions, then they are successfully executed only if the actor is empowered (see axiom <ref type="bibr" target="#b4">(5)</ref> which is similar to an inference rule in <ref type="bibr" target="#b4">[5]</ref>). The concept of power adopted by <ref type="bibr" target="#b4">[5]</ref> is similar to the one presented here, since it is defined as "the capability of an agent to bring about a change" in the institutional state. But, the act of paying is performed by the customer, while the transfer of property is empowered to the merchant, and they cannot be the same agent in a given transaction. These considerations rise a problem of agency of the institutional actions: how can a payment of agent a count as an action performed by agent b? It would be possible if agent b had delegated its power to agent a, but the authors do not introduce delegation of powers in their formalization. Therefore, we should expect that property (2) does not hold, since according to axiom (6) the convention among the payment and the transfer of property can never produce the successful performance of both acts.</p><p>Figure <ref type="figure">4</ref> shows the verification results generated by our tool when it has been asked to verify properties described in Section 3 and where we can observe that properties (2) and ( <ref type="formula" target="#formula_10">6</ref>) are violated. The generation of the transition system corresponding to the institution of property and the verification of all domainindependent properties required 0.25 seconds on a laptop with installed Linux and equipped with a pentium 1.66 GHz and 1 GB of RAM.</p><p>When a domain-independent property is not satisfied by an institution, we can consider what specific features of the metamodel it reflects to get some clue about how to modify an institution in order to satisfy it. For instance, we know that all institutional events may eventually happen as ensured by property <ref type="bibr" target="#b0">(1)</ref>. Therefore, as we have also noted in the previous informal analysis, a way to satisfy property (2) is to change the institutional power of agents. In particular, here we propose to not classify the exchange of the property as an action but as an institutional event. This solution immediately solves the agency problem and eliminates the power attributed to the owner of a good.</p><p>To satisfy property <ref type="bibr" target="#b5">(6)</ref>, that is, agents cannot cancel their own obligations, we propose to model the act of requesting a good in such a way that it does not create an obligation for the merchant to send the good, but it creates an obligation to agree or reject the request of the customer. In both cases, an answer of the merchant satisfies its obligation; in particular, a positive answer imposes on the involved agents a set of status functions which represent the obligation to transfer the possession (or perform the payment) and the powers to do so. Notice that such a formalization better represents the fact that a directive act (like a request) does not create obligations to the performance of the requested act <ref type="bibr" target="#b23">[24]</ref>, while a commissive (like the agree communicative act) commits the agent to the performance of the agreed action (see also <ref type="bibr" target="#b8">[9]</ref>).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6">Discussion and Conclusions</head><p>In this paper we have presented a metamodel for verifying institutional reality based on the notion of status function, which is regarded as a (possibly empty) aggregate of deontic positions (powers, obligation, etc.). This approach provides for a unified view of institutional facts and deontic positions, which have been usually analyzed separately <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b21">22]</ref>, and is motivated by the fact that institutional reality is such only because it is constituted by deontic positions attributed to agents. We have introduced the semantics of our institutional metamodel in terms of an order many-sorted first-order logic, which allows us to formalize both axioms regulating the metamodel and a set of domain-independent properties which reflect the intended meaning of concepts defined by our metamodel. Finally, we have tested our approach by verifying the institution presented in <ref type="bibr" target="#b4">[5]</ref> with respect to a set of domain-independent properties and shown that the verification of such properties enhances the formalization of sound institutions.</p><p>In the literature there are several attempts to model and verify institutions and normative systems. In <ref type="bibr" target="#b8">[9]</ref> </p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Figure 1 :</head><label>1</label><figDesc>Figure 1: The institutional metamodel.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_2"><head>Figure 2 :</head><label>2</label><figDesc>Figure 2: Life cycle of an obligation.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_3"><head>Figure 3 :</head><label>3</label><figDesc>Figure 3: Fragments of the institution of property.</figDesc></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0">In[9,  </note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="28" xml:id="foot_1">] we used to name institutionalized power "authorization", but to enhance a comparison with other works we adopt the more widely used term "power"<ref type="bibr" target="#b15">[16,</ref><ref type="bibr" target="#b4">5,</ref><ref type="bibr" target="#b21">22,</ref><ref type="bibr" target="#b25">26]</ref>.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_2">As studied in<ref type="bibr" target="#b15">[16,</ref><ref type="bibr" target="#b11">12]</ref> conventions are related to the counts-as relation, which tipically is defined relative to a certain institution. The extension of our approach to the treatment of multiple institutions is an interesting topic of research that we intend to tackle in our future works. For the purpose of this paper we limit our attention to a single institution, and therefore we omit the institution in which such relation holds.</note>
		</body>
		<back>

			<div type="acknowledgement">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>the authors rely on an intuitive semantics to model institutional reality in terms of entities, roles, and norms. Instead, the approach presented in this paper provides a formal semantics of institutional concepts such that we can apply model checking techniques to verify institutions.</p><p>In <ref type="bibr" target="#b21">[22]</ref> normative systems are described by using the Event Calculus <ref type="bibr" target="#b17">[18]</ref>. The absence of an institutional metamodel, which for instance provides an axiom to state that every institutional action must be authorized in order to be successfully executed, obliges the authors of <ref type="bibr" target="#b21">[22]</ref> to specify this fact for every single action and for every role. Therefore, the definition of a metamodel provides a significant advantage, especially when many status functions (or roles, using the terminology of <ref type="bibr" target="#b21">[22]</ref>) are authorized to perform the same institutional action. Furthermore, the definition of an encoding of institutions described in FIEVeL into propositional models allows us to verify our systems, while in <ref type="bibr" target="#b21">[22]</ref> the authors must rely on "systematic runs".</p><p>In <ref type="bibr" target="#b14">[15]</ref> the authors propose a framework to model check electronic institutions, a formalism proposed in <ref type="bibr" target="#b6">[7]</ref> and which describes institutions as finite automata. Starting from this point, in <ref type="bibr" target="#b14">[15]</ref> the authors limit their attention on the verification of properties of finite automata (e.g. "it is always possible to reach a final state"). It is important to notice that in <ref type="bibr" target="#b14">[15]</ref> arcs of electronic institutions (which in principle represent permitted acts <ref type="bibr" target="#b6">[7]</ref>) are interpreted as obligatory moves of agents, which may lead the model checker to answer that a given property holds in an institution while it is not the case and vice versa.</p><p>We plan to extend our metamodel, and consequently our modelling language, to model different interdependent institutions like in <ref type="bibr" target="#b29">[30]</ref>, which raises, among others, two interesting research problems: first, how to model interdependencies among different contexts, and second, how to design an institution which somehow depends on another institution.</p><p>Acknowledgments This research has been supported by Swiss National Science Foundation project 200020-109525, "Artificial Institutions: specification and verification of open distributed interaction frameworks". The author would like to thank his Ph.D. advisor, Marco Colombetti, for fruitful discussions and criticisms about the contents presented in this paper and Alessio Lomuscio for his advices regarding the implementation of the tool discussed in the paper.</p></div>
			</div>

			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">Modal Logic</title>
		<author>
			<persName><forename type="first">P</forename><surname>Blackburn</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>De Rijke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Venema</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2001">2001</date>
			<publisher>Cambridge University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">The ontological properties of social roles: Definitional dependence, powers and roles playing roles</title>
		<author>
			<persName><forename type="first">G</forename><surname>Boella</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Van Der Torre</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the ICAIL05 Workshop on Legal Ontologies and Artificial Intelligence Techniques</title>
				<meeting>the ICAIL05 Workshop on Legal Ontologies and Artificial Intelligence Techniques</meeting>
		<imprint>
			<date type="published" when="2005">2005</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">Graph-based algorithms for boolean function manipulation</title>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">E</forename><surname>Bryant</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">IEEE Trans. Comput</title>
		<imprint>
			<biblScope unit="volume">35</biblScope>
			<biblScope unit="issue">8</biblScope>
			<biblScope unit="page" from="677" to="691" />
			<date type="published" when="1986">1986</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<monogr>
		<title level="m" type="main">Model Checking</title>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">M</forename><surname>Clarke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Grumberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Peled</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1999">1999</date>
			<publisher>MIT Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">Specifying and Analysing Agent-based Social Institutions using Answer Set Programming</title>
		<author>
			<persName><forename type="first">O</forename><surname>Cliffe</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">D</forename><surname>Vos</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Padget</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Coordination, Organization, Institutions and Norms in Agent Systems I, number 3913 in LNCS</title>
				<imprint>
			<date type="published" when="2005">2005</date>
			<biblScope unit="page" from="99" to="113" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">AMELI: An Agent-based Middleware for Electronic Institutions</title>
		<author>
			<persName><forename type="first">M</forename><surname>Esteva</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodríguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Rosell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">L</forename><surname>Arcos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 3rd International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2004)</title>
				<editor>
			<persName><forename type="first">N</forename><forename type="middle">R</forename><surname>Jennings</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">L</forename><surname>Sonenberg</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">M</forename><surname>Tambe</surname></persName>
		</editor>
		<meeting>the 3rd International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2004)</meeting>
		<imprint>
			<publisher>ACM Press</publisher>
			<date type="published" when="2004">2004</date>
			<biblScope unit="page" from="236" to="243" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">On the Formal Specification of Electronic Institutions</title>
		<author>
			<persName><forename type="first">M</forename><surname>Esteva</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodríguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Garcia</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">L</forename><surname>Arcos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Agent Mediated Electronic Commerce, The European AgentLink Perspective</title>
				<imprint>
			<date type="published" when="1991">1991. 2001</date>
			<biblScope unit="page" from="126" to="147" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Using the Event Calculus for Tracking the Normative State of Contracts</title>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">D H</forename><surname>Farrell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">J</forename><surname>Sergot</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Sallé</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Bartolini</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Cooperative Information Systems</title>
		<imprint>
			<biblScope unit="volume">14</biblScope>
			<biblScope unit="issue">2-3</biblScope>
			<biblScope unit="page" from="99" to="129" />
			<date type="published" when="2005">2005</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">Agent Communication and Institutional Reality</title>
		<author>
			<persName><forename type="first">N</forename><surname>Fornara</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Viganò</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Colombetti</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Agent Communication</title>
				<imprint>
			<date type="published" when="2005">2005</date>
			<biblScope unit="volume">3396</biblScope>
			<biblScope unit="page" from="1" to="17" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<analytic>
		<title level="a" type="main">Implementing norms in electronic institutions</title>
		<author>
			<persName><forename type="first">A</forename><surname>Garcia-Camino</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Noriega</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodríguez-Aguilar</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 4th International Joint Conference on Autonomous agents and Multi-Agent Systems</title>
				<meeting>the 4th International Joint Conference on Autonomous agents and Multi-Agent Systems</meeting>
		<imprint>
			<date type="published" when="2005">2005</date>
			<biblScope unit="page" from="667" to="673" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b10">
	<analytic>
		<title level="a" type="main">A distributed architecture for norm-aware agent societies</title>
		<author>
			<persName><forename type="first">A</forename><surname>García-Camino</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodríguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><forename type="middle">W</forename><surname>Vasconcelos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Declarative Agent Languages and Technologies III (DALT 2005</title>
				<imprint>
			<publisher>Springer</publisher>
			<date type="published" when="2005">2005</date>
			<biblScope unit="volume">3904</biblScope>
			<biblScope unit="page" from="89" to="105" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b11">
	<analytic>
		<title level="a" type="main">Counts-as: Classification or constitution? an answer using modal logic</title>
		<author>
			<persName><forename type="first">D</forename><surname>Grossi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J.-J</forename><forename type="middle">C</forename><surname>Meyer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Dignum</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 8th International Workshop on Deontic Logic in Computer Science</title>
				<meeting>the 8th International Workshop on Deontic Logic in Computer Science</meeting>
		<imprint>
			<date type="published" when="2006">2006</date>
			<biblScope unit="volume">4048</biblScope>
			<biblScope unit="page" from="115" to="130" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b12">
	<monogr>
		<title level="m" type="main">The Concept of Law</title>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">L A</forename><surname>Hart</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1961">1961</date>
			<publisher>Oxford University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b13">
	<monogr>
		<title level="m" type="main">The SPIN Model Checker: Primer and Reference Manual</title>
		<author>
			<persName><forename type="first">G</forename><surname>Holzmann</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2003">2003</date>
			<publisher>Addison Wesley</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b14">
	<analytic>
		<title level="a" type="main">Model Checking Electronic Institutions</title>
		<author>
			<persName><forename type="first">M.-P</forename><surname>Huget</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Esteva</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Phelps</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Wooldridge</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the ECAI Workshop on Model Checking and Artificial Intelligence (MoChArt I)</title>
				<meeting>the ECAI Workshop on Model Checking and Artificial Intelligence (MoChArt I)</meeting>
		<imprint>
			<date type="published" when="2002">2002</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b15">
	<analytic>
		<title level="a" type="main">A formal characterisation of institutionalised power</title>
		<author>
			<persName><forename type="first">A</forename><surname>Jones</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">J</forename><surname>Sergot</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of the IGPL</title>
		<imprint>
			<biblScope unit="volume">4</biblScope>
			<biblScope unit="issue">3</biblScope>
			<biblScope unit="page" from="429" to="445" />
			<date type="published" when="1996">1996</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b16">
	<monogr>
		<title level="m" type="main">MDA Explained: The Model Driven Architecture-Practice and Promise</title>
		<author>
			<persName><forename type="first">A</forename><surname>Kleppe</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Warmer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Bast</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2003">2003</date>
			<publisher>Addison-Wesley Professional</publisher>
			<pubPlace>Reading, Massachusetts, USA</pubPlace>
		</imprint>
	</monogr>
	<note>1 edition</note>
</biblStruct>

<biblStruct xml:id="b17">
	<analytic>
		<title level="a" type="main">A Logic-based Calculus of Events</title>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">A</forename><surname>Kowalski</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">J</forename><surname>Sergot</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">New Generation Computing</title>
		<imprint>
			<biblScope unit="volume">4</biblScope>
			<biblScope unit="page" from="67" to="95" />
			<date type="published" when="1986">1986</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b18">
	<analytic>
		<title level="a" type="main">A formulation of violation, error recovery, and enforcement in the bit transmission problem</title>
		<author>
			<persName><forename type="first">A</forename><surname>Lomuscio</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Sergot</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Applied Logic (Selected articles from DEON02 -London)</title>
		<imprint>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="93" to="116" />
			<date type="published" when="2002">2002</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b19">
	<monogr>
		<title level="m" type="main">Many-sorted logic and its applications</title>
		<author>
			<persName><forename type="first">K</forename><surname>Meinke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">V</forename><surname>Tucker</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1993">1993</date>
			<publisher>John Wiley &amp; Sons, Inc</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b20">
	<analytic>
		<title level="a" type="main">Deciding properties of timed transition models</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">S</forename><surname>Ostroff</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">IEEE Transactions on Parallel Distributed Systems</title>
		<imprint>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="170" to="183" />
			<date type="published" when="1990">1990</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b21">
	<analytic>
		<title level="a" type="main">Formalization of a voting protocol for virtual organizations</title>
		<author>
			<persName><forename type="first">J</forename><surname>Pitt</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Kamara</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Sergot</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Artikis</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 4th International Joint Conference on Autonomous agents and Multi-Agent Systems (AAMAS 2005)</title>
				<meeting>the 4th International Joint Conference on Autonomous agents and Multi-Agent Systems (AAMAS 2005)</meeting>
		<imprint>
			<date type="published" when="2005">2005</date>
			<biblScope unit="page" from="373" to="380" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b22">
	<analytic>
		<title level="a" type="main">Automatic verification of deontic interpreted systems by model checking via OBDDs</title>
		<author>
			<persName><forename type="first">F</forename><surname>Raimondi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Lomuscio</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Applied Logic</title>
		<imprint/>
	</monogr>
	<note>To appear</note>
</biblStruct>

<biblStruct xml:id="b23">
	<monogr>
		<title level="m" type="main">Speech Acts: An Essay in the Philosophy of Language</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">R</forename><surname>Searle</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1969">1969</date>
			<publisher>Cambridge University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b24">
	<monogr>
		<title level="m" type="main">The construction of social reality</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">R</forename><surname>Searle</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1995">1995</date>
			<publisher>Free Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b25">
	<analytic>
		<title level="a" type="main">The Deontic Component of Action Language nC+</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">J</forename><surname>Sergot</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Craven</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 8th International Workshop on Deontic Logic in Computer Science</title>
				<meeting>the 8th International Workshop on Deontic Logic in Computer Science</meeting>
		<imprint>
			<date type="published" when="2006">2006</date>
			<biblScope unit="volume">4048</biblScope>
			<biblScope unit="page" from="222" to="237" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b26">
	<monogr>
		<author>
			<persName><forename type="first">F</forename><surname>Somenzi</surname></persName>
		</author>
		<ptr target="http://vlsi.colorado.edu/fabio/CUDD/" />
		<title level="m">Cudd: Cu decision diagram package</title>
				<imprint/>
	</monogr>
</biblStruct>

<biblStruct xml:id="b27">
	<analytic>
		<title level="a" type="main">A Framework for Model Checking Institutions</title>
		<author>
			<persName><forename type="first">F</forename><surname>Viganò</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the ECAI Workshop on Model checking and Artificial Intelligence (MoChArt IV)</title>
				<meeting>the ECAI Workshop on Model checking and Artificial Intelligence (MoChArt IV)</meeting>
		<imprint>
			<date type="published" when="2006">2006</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b28">
	<monogr>
		<title level="m" type="main">FIEVeL, a Language for the Specification and Verification of Institutions</title>
		<author>
			<persName><forename type="first">F</forename><surname>Viganò</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2006">2006</date>
		</imprint>
		<respStmt>
			<orgName>Institute for Communication Technologies, Università della Svizzera Italiana</orgName>
		</respStmt>
	</monogr>
	<note type="report_type">Technical Report 3</note>
</biblStruct>

<biblStruct xml:id="b29">
	<analytic>
		<title level="a" type="main">An Event Driven Approach to Norms in Artificial Institutions</title>
		<author>
			<persName><forename type="first">F</forename><surname>Viganò</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Fornara</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Colombetti</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Coordination, Organization, Institutions and Norms in Multi-Agent Systems</title>
				<imprint>
			<publisher>Springer</publisher>
			<date type="published" when="2006">2006</date>
			<biblScope unit="volume">3913</biblScope>
			<biblScope unit="page" from="142" to="154" />
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
