<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">A Roadmap for Self-Evolving Communities</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Nardine</forename><surname>Osman</surname></persName>
							<affiliation key="aff0">
								<orgName type="department">Artificial Intelligence Research Institute (IIIA-CSIC)</orgName>
								<address>
									<settlement>Bellaterra, Barcelona</settlement>
									<country key="ES">Spain</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Carles</forename><surname>Sierra</surname></persName>
							<affiliation key="aff0">
								<orgName type="department">Artificial Intelligence Research Institute (IIIA-CSIC)</orgName>
								<address>
									<settlement>Bellaterra, Barcelona</settlement>
									<country key="ES">Spain</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">A Roadmap for Self-Evolving Communities</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">7C2CA16AFDC2326DBDC0E5771B90E68A</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-25T04:04+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>norms</term>
					<term>interaction protocols</term>
					<term>self-evolution</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>Self-organisation and self-evolution is evident in physics, chemistry, biology, and human societies. Despite the existing literature on the topic, we believe self-organisation and self-evolution is still missing from the IT tools (whether online or offline) we are building and using. In the last decade, human interactions have been moving more and more towards social media. The time we spend interacting with others in virtual communities and networks is tremendous. Yet, the tools supporting those interactions remain rigid. This position paper argues the need for self-evolving software-enabled communities, and proposes a roadmap for achieving this required self-evolution. The proposal is based on building normative-based communities, where community interactions are regulated by norms and community members are free to discuss and modify their community's norms. The evolution of communities is then dictated by the evolution of its norms.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Motivation</head><p>The concept of social self-organisation has deep roots in political theory. In the Leviathan, Hobbes expresses the idea that the social structure, the State or res publica, is the result of a social contract or pact. The social contract is an agreement among free individuals in order to surrender power to a central authority in order to get a guarantee of peace. In essence, a social contract is the implicit acceptance of self-limiting individual freedom in order to guarantee self-preservation and a better life. The concept of social contract implies that individuals reflect on the community governance in order to decide on the means to reach commonwealth.</p><p>This capacity of individuals to reflect and decide on community governance is missing in the IT tools we are currently building. How individuals interact is decided by groups of engineers that design tools, determine the individuals' privacy levels, hinder some from performing certain tasks, and all this without the individuals having a say. We argue that it is time for us to take control of the evolution of our own virtual communities, which we refer to as softwareenabled communities -examples of such communities are those based on social networks or any other community whose management relies on software, such as customer relationship management systems (CRMs) or conference management systems. To address this issue, we propose normative-based communities, where community interactions are regulated by norms and community members are free to discuss and modify their community's norms (or social contracts), while respecting their free will. The roadmap for self-evolution is then dictaded by the lifecycle of norms, and the research required for supporting this lifecycle is varied and multidisciplinary -from social sciences and legal studies, to learning mechanisms, agreement technologies, natural language processing, formal logics, norm enforcement and regimentation, human computer interaction, and other software engineering techniques.</p><p>It is true that the notion of self-organisation is not new. Self-organisation, in general, refers to how a system reorganises to adapt to changes to its goals or environment, where the reorganisation is driven from within the system as opposed to some external control. In many cases, self-organisation is associated with emergence, where a structure appears at a higher level without it being represented at a lower level. Self-organisation has been studied in a number of areas, such as biology, chemistry, geology, sociology, as well as information technology <ref type="bibr" target="#b25">[26]</ref>. In AI, self-organisation has mostly been inspired by naturally existing self-organisation models, although some new mechanisms have been designed specifically for software applications <ref type="bibr" target="#b26">[27]</ref>. For example, self-organisation may be found in bio-inspired robot teams, where insect-based technology is used to aid robots self-organise to accomplish a task <ref type="bibr" target="#b43">[44]</ref>. Another example is intrusion detection in network security, which is inspired from the natural immune system <ref type="bibr" target="#b19">[20]</ref>. Swarm intelligence may be used to mimic insect foraging behaviour on the coordination and control of data network traffic <ref type="bibr" target="#b47">[48]</ref>. With the notions of self-adaptability and long-lasting evolvability in mind, it has also been proposed that natural ecosystems can inspire building ecosystems of services <ref type="bibr" target="#b46">[47]</ref>.</p><p>In this paper, however, we do not propose to follow traditional self-organisation AI techniques, but to open a new direction in AI research with a novel method for self-evolving software-enables communities. The proposed research is original in the sense that we do not simply talk about self-organising software that usually imitates existing natural systems, but we study how the human users' evolving needs consciously direct evolution. We essentially propose to provide the human users with learning mechanisms that help them learn the best evolution path, along with agreement technologies that help them discuss, argue, and agree on their preferred path of evolution. The system then takes care of the formalisation, operationalisation, and enforcement of the agreed upon norms. This is a fundamentally different approach from existing self-organising systems.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">Roadmap for Self-Evolving Communities</head><p>In this paper, we argue that it is time for us to take control of the evolution of our own virtual communities. To address this issue, we propose normativebased communities, where community interactions are regulated by norms and community members are free to discuss and modify their community's norms.</p><p>Norms are the rules that govern behaviour in groups and societies <ref type="bibr" target="#b7">[8]</ref>. They motivate and influence individual actions by dictating what values, beliefs, atti-tudes, and behaviours are deemed appropriate or not. Social norms have been extensively studied by anthropologists, sociologists, philosophers, and economists in the hope of understanding how they motivate individual actions, influence market behaviour, and so on. In multiagent systems, the study of norms gained tremendous attention due to the critical issue of coordinating agent behaviour and actions. Although, unlike other social sciences, the distinction between social and legal norms has not been concrete in the field of computer science.</p><p>We adopt the idea of using norms to control, or mediate, community behaviour. This is motivated by the fact that software is usually engineered based on some notion of norms in mind; furthermore, the use of norms allows human users to discuss their interactions without the need for any technical knowledge about the software actually mediating their interactions. We note that by specifying a community through its norms, the evolution of the community becomes dictated by the evolution of its norms. As such, the evolution of software-enabled communities may be depicted by the lifecycle of norms, as illustrated by Figure <ref type="figure" target="#fig_0">1</ref>. We divide the lifecycle of norms in a software-enabled community into four different stages. In the first stage, community members discuss and agree on their community's norms. If community members do agree on a new set of norms, then the norms' lifecycle enters its second stage, where the agreed upon norms are automatically translated into some formal specification. Given the formal specification of norms, the lifecycle then enters the third stage, where the softwareenabled community interactions are modified to operationalise the new norms. Finally, as the software runs to mediate community interactions, norms are enforced by ensuring that community interactions follow the agreed upon norms. The details of these four stages are presented next.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1">Birth of Norms</head><p>In this stage, community members propose norm modifications (including the abandoning and adoption of norms), discuss the different proposals amongst themselves, and collectively agree on their community's new (or modified) set of norms.</p><p>An interdisciplinary research is highly recommended at this stage. For example, social sciences can help understand the emergence of norms, their social function, their impact on behviour, as well as understand the possible deviance from norms. Legal studies can help understand the legal aspects of norms, such as the enforcement of norms, the effectivity and validity of norms, and the resolve of conflicting norms. Learning mechanisms can help learn from a community's past experience, or a similar community's past experience, and suggest norm modifications accordingly. Finally, to aid the collective agreement on community norms, agreement technologies will be needed.</p><p>Concerning learning mechanisms, learning from data has been one of the main subfields of artificial intelligence <ref type="bibr" target="#b1">[2]</ref>, yet the literature lacks the in-depth study of learning the best norms for multiagent interactions. In multiagent systems, some work has been carried out on norm synthesis <ref type="bibr" target="#b39">[40]</ref>. Most norm synthesis (online) approaches, such as <ref type="bibr" target="#b37">[38,</ref><ref type="bibr" target="#b45">46,</ref><ref type="bibr" target="#b36">37,</ref><ref type="bibr" target="#b22">23]</ref>, are based on norm emergence techniques that require agents to collaborate to synthesise their own norms. <ref type="bibr" target="#b28">[29]</ref> does not require the active participation of agents in norm synthesis as norms are synthesised from the observation of agents' interactions. The norm synthesis of <ref type="bibr" target="#b29">[30]</ref> is based on the capability of generalising norms, which allows characterising necessary conditions for coordination, avoiding over-regulation.</p><p>Concerning agreement technologies, we note that this field is one of the vibrant and active fields in multiagent systems. Agreement technologies aim at helping individuals collaboratively reach a decision, which is crucial when individuals are intelligent and autonomous, having their own goals and agendas to fulfil. The field is based on a number of models and mechanisms, such as argumentation and negotiation mechanisms, social choice theory and voting mechanisms, and trust and reputation models.</p><p>Argumentation theory uses logical reasoning to illustrate how conclusions may be drawn in cases of uncertainty and conflict. Argumentation frameworks in multiagent systems <ref type="bibr" target="#b31">[32]</ref> have mostly been built on Dung's theory of abstract argumentation <ref type="bibr" target="#b16">[17]</ref>, where a directed graph is used to represent arguments (the nodes of the graph) and the attack relations between them (the directed links of the graph). A 'calculus of opposition' is then applied to help determine the winning argument. Dung's framework has been extended in a number of directions, such as adding preferences <ref type="bibr" target="#b2">[3]</ref>, allowing attacks on attacks <ref type="bibr" target="#b6">[7]</ref>, and adding weights to attacks <ref type="bibr" target="#b17">[18]</ref>. One interesting extension to Dungs framework is one that incorporates social voting and is used in social networks <ref type="bibr" target="#b24">[25,</ref><ref type="bibr" target="#b10">11]</ref>.</p><p>Social choice theory is concerned with the representation and aggregation of individual preferences. Voting mechanisms and ranking systems are considered to fall under the social choice category. Social choice theory studies a variety of aspects, such as the manipulation of a voting rule <ref type="bibr" target="#b9">[10]</ref>, the use of combinatorial domains where voters may specify a list of preferences <ref type="bibr" target="#b8">[9]</ref>, and the efficiency and fairness of voting rules <ref type="bibr" target="#b18">[19]</ref>.</p><p>A common issue that arises in building open distributed systems is the issue of trust and reputation. Trust has become an increasingly important concept in computer science <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b21">22]</ref>. For example, there have been studies on the development of trust in e-commerce <ref type="bibr" target="#b33">[34]</ref>, on mechanisms to determine which sources to trust when faced with multiple conflicting information sources <ref type="bibr" target="#b53">[54]</ref>, and mechanisms for identifying which individuals to trust based on their past activity <ref type="bibr" target="#b0">[1]</ref>. Trust is an especially important issue from the perspective of autonomous agents and multiagent systems <ref type="bibr" target="#b41">[42]</ref>. In multiagent interactions, agents will have to reason about how much should they trust other entities (in various contexts). For reviews on trust in multiagent systems, we refer the reader to <ref type="bibr" target="#b32">[33,</ref><ref type="bibr" target="#b35">36]</ref>.</p><p>Roadmap: In the context of self-evolving communities, research in the information and computer Science field should focus on two main issues. <ref type="bibr" target="#b0">(1)</ref> We should aim at building a system that is capable of automatically suggesting norms that can help improve the quality of interactions in a community, based on learning from similar past experiences. Improving the quality of interactions may refer to a number of issues, such as improving the individual user satisfaction, or improving the efficiency of the interactions by helping community members achieve their goals faster and easier. We note that learning mechanisms may also be combined with other techniques, such as analogical reasoning <ref type="bibr" target="#b44">[45]</ref> or coherence theory <ref type="bibr" target="#b42">[43]</ref>. <ref type="bibr" target="#b1">(2)</ref> We should investigate the combination of different agreement technologies to help community members agree on how should their community evolve. For example, it would be interesting to study the combination of trust and argumentation mechanisms, for instance, by modifying the reasoning process to consider reputation/trust based measures of the strengths of arguments. It would also be interesting to study voting algorithms mediated by trust, with votes potentially weighted by the trustworthiness or degree of involvement in the community. The outcome of this research work would be to aid community members in agreeing on their community norms.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2">Automated Formalisation of Norms</head><p>Norms agreed upon by community members need to be formalised in a language that can be understood by the system mediating community interactions. We expect community members to be non-technical people who discuss and specify norms in natural language. An automatic translator is then needed to translate the norms from their natural language specification to some formal specification that is comprehensible by the system.</p><p>The research that should support this stage should focus on natural language processing, which will help perform the automatic translation, and formal logics, which will define the formal language used to specify norms.</p><p>Concerning natural language processing, machine translation <ref type="bibr" target="#b48">[49]</ref> is a subfield that translates one natural language into another. This sub-field has been well studied and it has been even used in commercial applications, such as Google Translate or Yahoo's Babel Fish. The translation from a natural language to some logic, on the other hand, has attracted much less attention in the natural language processing field. Nevertheless, important research has been carried in that direction. <ref type="bibr" target="#b49">[50,</ref><ref type="bibr" target="#b51">52]</ref> illustrates and discusses the use of existing state-of-the-art in the automatic translation of regulatory rules in natural language into a machine readable formal representation. <ref type="bibr" target="#b38">[39]</ref> translates a complete set of pediatric guideline recommendations into a controlled language (Attempto Controlled English -ACE). <ref type="bibr" target="#b50">[51]</ref> adopts and applies a controlled natural language to constrain the domain of discourse in a sample discussion from an on-line discussion forums for e-government policy-making. The controlled natural language helps eliminate ambiguity and unclarity, and allows a logical representation of statements. Each of the policy statements is then automatically translated into first-order logic. <ref type="bibr" target="#b52">[53]</ref> presents a linguistically-oriented, rule-based approach, for extracting conditional and deontic rules from regulations specified in natural language. Finally, <ref type="bibr" target="#b3">[4,</ref><ref type="bibr" target="#b5">6]</ref> present approaches for the logical representation of regulations.</p><p>Concerning the formal specification of norms, existing approaches may be divided into two main categories: declarative approaches and procedural ones. We note that in this paper, we refer to the declarative approaches as norms and the procedural ones as interaction models. Declarative formalisms are concerned with the expressiveness of norms, the formal semantics, and how to resolve conflicts arising from an inconsistent set of norms. Declarative approaches are usually based on deontic logic, which is the logic of duties. They deal with concepts like permissions, prohibitions, and obligations, which help specify who can do what, under what conditions, and so on.</p><p>Deontic-based policy languages have been used widely in hardware systems and networks for security reasons, trust negotiation, access control, authorisation, and so on. <ref type="bibr" target="#b40">[41]</ref> defines policies to be "one aspect of information which influences the behaviour of objects within the system". <ref type="bibr" target="#b12">[13]</ref> categorises policies into two types. The first type covers obligation policies for managing actions, which are usually event triggered condition-action rules. The basic concept is that specific events trigger specific actions, and the actions may only be executed if a predefined set of conditions is satisfied. The second type covers authorisation policies, which are usually used for access control.</p><p>In multiagent systems, several deontic based formal logics have been proposed for defining a normative specification of agents interaction, such as <ref type="bibr" target="#b30">[31]</ref> and <ref type="bibr" target="#b13">[14]</ref>. In <ref type="bibr" target="#b30">[31]</ref>, it is proposed that a community should be defined whenever a group of agents have some common goals and they need to act as a whole within the society in order to fulfil those goals. They propose to define the roles within the community, the relationships among them, which actions each role can do, and how the obligations are distributed among the roles. Each role has associated deontic notions that describe the role obligations, permissions and prohibitions. <ref type="bibr" target="#b13">[14]</ref> extends the BDI model of agents to include goals, obligations, and norms; the proposal is based on providing a formal definitions of norms by means of some variation of deontic logic that includes conditional and temporal aspects.</p><p>Roadmap: In the context of self-evolving communities, research should focus on two main issues. <ref type="bibr" target="#b0">(1)</ref> We should aim at building an automatic translator that can translate norms specified in a natural language into some formal logic. <ref type="bibr" target="#b1">(2)</ref> We should select, or design, a logic that fulfills the following three requirements: i) it should be expressive enough to capture the community members' needs; ii) it should be compatible with the natural language processing technique that needs to translate norms specified in natural language into the logic; and iii) it should be compatible with the software system that needs to operationalise those norms. The outcome of this research work would be to have the agreed upon norms translated into some formal logic that is ready to be operationalised by the system.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.3">Automated Operationalisation of Norms</head><p>Given a formal specification of norms, the ultimate goal is to enforce those norms. One approach to achieve this is through what is known as norm regimentation. In other words, the system mediating community interactions needs to be modified in order to operationalise those norms.</p><p>The literature provides a variety of solutions that deal with specifying and regulating interactions in multiagent systems based on the concept of following social norms <ref type="bibr" target="#b39">[40]</ref>, such as having contracts and commitments <ref type="bibr" target="#b14">[15]</ref>, organisational approaches <ref type="bibr" target="#b23">[24]</ref>, electronic institutions <ref type="bibr" target="#b15">[16]</ref>, distributed dialogues <ref type="bibr" target="#b34">[35]</ref>, and so on.</p><p>Two specifically interesting approaches are electronic institutions <ref type="bibr" target="#b15">[16]</ref> and the lightweight coordination calculus <ref type="bibr" target="#b34">[35]</ref>. In <ref type="bibr" target="#b15">[16]</ref>, it is argued that open multiagent systems can be effectively designed and implemented as agent mediated electronic institutions where heterogeneous (human and software) agents can participate, playing different roles and interacting by means of speech acts. An institution is defined by a set of roles that agents participating in the institution will play, a common language to allow heterogenous agents to exchange knowledge, the valid interactions that agents may have structured in conversations, and the consequences of agents' actions within an institution, captured by obligations that agents acquire and fulfil.</p><p>The lightweight coordination calculus (LCC) <ref type="bibr" target="#b34">[35]</ref> is a process calculus, based on logic programming, that provides means of achieving coordination in distributed systems by enforcing social norms. The process calculus specifies what actions agents can perform, when they can perform such actions, under what conditions these actions may be carried out, and so on. However, unlike electronic institutions, there are no 'governors' that ensure that agents abide by norms. Of course, like all the approaches above, these rules are associated with roles rather than physical agents; and agents can play more than one role in more than one interaction. This provides an abstraction for the interaction model from the individual agents that might engage in such an interaction.</p><p>In the context of self-evolution, it is important to build a system whose interaction models can operationalise norms requested by its uers. We note, however, that not all norms are capable of being operationalised. For example, in an e-commerece context, the system can operationalise the norm that states that a buyer cannot rate the seller more than once, as the system can actually prevent the buyer from doing so. However, the system cannot operationalise a norm that states that only people with sufficient credit can bid, as credit is private information that cannot be accessed and assessed by the system. To deal with norms that cannot be operationalised, alternative norm enforcement methods will need to be applied, such as applying sanctions (punishments and rewards). 12  In this case, the system will need to ensure the enforcement of un-operationalised norms by checking the members' abidance to those norms and enforcing the appropriate sanctions accordingly. To achieve this, it is important to design a lightweight computational norm enforcement model that allows for the detection of norm violations and the application of remedial actions. This work may build upon existing work, as the literature is rich with norm engines that may be used for resolving conflicting norms and applying appropriate sanctions <ref type="bibr" target="#b20">[21,</ref><ref type="bibr" target="#b27">28,</ref><ref type="bibr" target="#b11">12]</ref>.</p><p>Roadmap: In summary, in the context of self-evolution, research should focus on two main issues: (1) building a mechanism that allows the system to operationalise the norms agreed upon by the community members; and (2) building a norm enforcement model that can check members' abidance to unoperationalised norms and enforce appropriate sanctions accordingly. The outcome of this research work would be to have a system that is capable of enforcing the norms agreed upon by the community members.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.4">Automated Enforcement of Norms</head><p>Finally, running the software that mediates community interactions will allow members of the community to interact, while ensuring the enforcement of the norms. The research that will support this stage will need to focus on human computer interaction techniques that are required to ensure an intuitive, user friendly interaction for non-technical community members. Research will also need to focus on software engineering techniques to ensure efficient community interactions. However, the context of self-evolution imposes an additional and critical challenge: how can the system be modified at runtime when different members may still be interacting together? Indeed, it is very unrealistic to assume that all members will need to complete their current interactions successfully and pause any future interactions for the system to get modified (as future interactions will need to follow the new norms). As such, research will need to address the issue of seamlessly adapting the system at runtime, and it may take inspiration from existing software compatibility models that allow different versions of an application to continue to communicate and collaborate.</p><p>Roadmap: In summary, in the context of self-evolution, research should focus on two main issues: (1) building a user friendly interface that would allow community member to interact, following the norms, without any knowledge of their interactions and their complexity, and in cases when users need to discuss norms, norms and norm violations will need to be visualised in a user friendly and comprehensible manner; and (2) engineering the system in such a way that ensures efficient interactions and permits evolution at runtime in a seamless manner that does not interrupt community interactions. The outcome of this research work would be to have the system run and manage evolving normativebased community interactions in an efficient, userfriendly, and seamless manner.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Conclusion</head><p>We argue that just like human communities, e-communities (or virtual communities) also need to self-evolve. Instead of creating numerous rigid systems, which is very common in online social systems, what we should aim at instead is providing tools for creating self-evolving systems that adapt to the community's needs. We believe different communities should be governed by different rules. These rules should be an ever evolving set resulting from the aspirations of its members, and not a rigid set defined by a corporation (or a system designer) that does not take the community members' interests at heart. Furthermore, for the community's rules to be effective, they need to be tailored to the specific community, such as considering the character traits of the community's members.</p><p>We believe that the notion of self-evolving communities will revolutionise the way how software is build, as well as how we interact with software. We say that in the context of social interactions, software does not need to be rigid, nor customised for the individual, but adaptable to the group. Software engineers will need to design intelligent software that is capable of evolving according to the needs of the community as a whole, and users (or community members) should become more active in shaping their community by discussing and agreeing on their community rules.</p><p>In summary, the proposal is based on the traditional notion of mediating social interactions via norms. The roadmap for self-evolution is then dictaded by the lifecycle of norms, which we divide into four different stages (see Figure <ref type="figure" target="#fig_0">1</ref>): (1) the birth of norms, (2) the automated formalisation of norms, (3) the automated operationalisation of norms, and (4) the automated enforcement of norms. Varied, and even interdisciplinary, research will be required for supporting these four stages, from social sciences and legal studies, to learning mechanisms, agreement technologies, natural language processing, formal logics, norm enforcement and regimentation, human computer interaction, and other software engineering techniques.</p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Fig. 1 .</head><label>1</label><figDesc>Fig. 1. The lifecycle of norms lays out the roadmap for self-evolving communities</figDesc></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0">The literature usually refers to the operationalisation of norms as 'norm regimentation', and alternative norm enforcement methods (such as the application of sanctions) as 'norm enforcement'. In this paper, however, we overload the word 'enforce' as we use it to describe both</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_1">approaches.<ref type="bibr" target="#b1">2</ref> It may be argued that punishment and reward is not always the right approach for motivating the abidance to norms. Furthermore, what may be considered a punishment for one may be viewed as a reward for another. In this paper, although we talk about punishments and rewards, we concur that sanctions may be labeled more generally as the post-conditions of abiding with or breaking a norm.</note>
		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<analytic>
		<title level="a" type="main">A content-driven reputation system for the Wikipedia</title>
		<author>
			<persName><forename type="first">B</forename><forename type="middle">T</forename><surname>Adler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>De Alfaro</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 16th International World Wide Web Conference</title>
				<meeting>the 16th International World Wide Web Conference<address><addrLine>Banff, Alberta, Canada</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2007-05">May 2007</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<monogr>
		<title level="m" type="main">Introduction to machine learning</title>
		<author>
			<persName><forename type="first">E</forename><surname>Alpaydin</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2004">2004</date>
			<publisher>MIT press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">A reasoning model based on the production of acceptable arguments</title>
		<author>
			<persName><forename type="first">L</forename><surname>Amgoud</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Cayrol</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Annals of Mathematics and Artificial Intelligence</title>
		<imprint>
			<biblScope unit="volume">34</biblScope>
			<biblScope unit="issue">1-3</biblScope>
			<biblScope unit="page" from="197" to="215" />
			<date type="published" when="2002-03">Mar 2002</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">On the modelling and analysis of regulations</title>
		<author>
			<persName><forename type="first">G</forename><surname>Antoniou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Antoniou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Billington</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Governatori</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Maher</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the Australian Conference on Information Systems</title>
				<meeting>the Australian Conference on Information Systems</meeting>
		<imprint>
			<date type="published" when="1999">1999</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">A survey of trust in computer science and the semantic web</title>
		<author>
			<persName><forename type="first">D</forename><surname>Artz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Gil</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">J. of Web Semantics</title>
		<imprint>
			<biblScope unit="volume">5</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="58" to="71" />
			<date type="published" when="2007">2007</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">OA-SIS LegalRuleML</title>
		<author>
			<persName><forename type="first">T</forename><surname>Athan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Boley</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Governatori</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Palmirani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Paschke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Wyner</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">International Conference on Artificial Intelligence and Law, ICAIL &apos;13</title>
				<editor>
			<persName><forename type="first">E</forename><surname>Francesconi</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">B</forename><surname>Verheij</surname></persName>
		</editor>
		<imprint>
			<publisher>ACM</publisher>
			<date type="published" when="2013">2013</date>
			<biblScope unit="page" from="3" to="12" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">AFRA: Argumentation framework with recursive attacks</title>
		<author>
			<persName><forename type="first">P</forename><surname>Baroni</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Cerutti</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Giacomin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Guida</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">International Journal of Approximate Reasoning</title>
		<imprint>
			<biblScope unit="volume">52</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="19" to="37" />
			<date type="published" when="2011-01">Jan 2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Social norms</title>
		<author>
			<persName><forename type="first">C</forename><surname>Bicchieri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Muldoon</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">The Stanford Encyclopedia of Philosophy. The Metaphysics Research Lab</title>
				<editor>
			<persName><forename type="first">E</forename><forename type="middle">N</forename><surname>Zalta</surname></persName>
		</editor>
		<meeting><address><addrLine>Stanford, CA, USA</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2011">spring 2011. 2011</date>
		</imprint>
		<respStmt>
			<orgName>Stanford University</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">The paradox of multiple elections</title>
		<author>
			<persName><forename type="first">S</forename><surname>Brams</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Kilgour</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Zwicker</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Social Choice &amp; Welfare</title>
		<imprint>
			<biblScope unit="volume">15</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="211" to="236" />
			<date type="published" when="1998">1998</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<analytic>
		<title level="a" type="main">How many candidates are needed to make elections hard to manipulate?</title>
		<author>
			<persName><forename type="first">V</forename><surname>Conitzer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Lang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Sandholm</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 9th Conference on Theoretical Aspects of Rationality and Knowledge</title>
				<meeting>the 9th Conference on Theoretical Aspects of Rationality and Knowledge</meeting>
		<imprint>
			<publisher>ACM</publisher>
			<date type="published" when="2003">2003</date>
			<biblScope unit="page" from="201" to="214" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b10">
	<analytic>
		<title level="a" type="main">On the efficient implementation of social abstract argumentation</title>
		<author>
			<persName><forename type="first">M</forename><surname>Correia</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Cruz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Leite</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">21st European Conference on Artificial Intelligence, ECAI 2014. Frontiers in Artificial Intelligence and Applications</title>
				<editor>
			<persName><forename type="first">T</forename><surname>Schaub</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">G</forename><surname>Friedrich</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">B</forename><surname>O'sullivan</surname></persName>
		</editor>
		<imprint>
			<publisher>IOS Press</publisher>
			<date type="published" when="2014">2014</date>
			<biblScope unit="volume">263</biblScope>
			<biblScope unit="page" from="225" to="230" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b11">
	<analytic>
		<title level="a" type="main">MaNEA: A distributed architecture for enforcing norms in open MAS</title>
		<author>
			<persName><forename type="first">N</forename><surname>Criado</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Argente</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Noriega</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><forename type="middle">J</forename><surname>Botti</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Eng. Appl. of AI</title>
		<imprint>
			<biblScope unit="volume">26</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="76" to="95" />
			<date type="published" when="2013">2013</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b12">
	<monogr>
		<title level="m" type="main">A survey of policy specification approaches</title>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">C</forename><surname>Damianou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">K</forename><surname>Bandara</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">S</forename><surname>Sloman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">C</forename><surname>Lupu</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2002">2002</date>
			<pubPlace>London, UK</pubPlace>
		</imprint>
		<respStmt>
			<orgName>Department of Computing, Imperial College of Science Technology and Medicine</orgName>
		</respStmt>
	</monogr>
	<note type="report_type">Tech. rep.</note>
</biblStruct>

<biblStruct xml:id="b13">
	<analytic>
		<title level="a" type="main">From desires, obligations and norms to goals</title>
		<author>
			<persName><forename type="first">F</forename><surname>Dignum</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Kinny</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Sonenberg</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Cogn. Sci. Quarterly</title>
		<imprint>
			<biblScope unit="volume">2</biblScope>
			<biblScope unit="page" from="407" to="430" />
			<date type="published" when="2002">2002</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b14">
	<analytic>
		<title level="a" type="main">Towards an organizational model for agent societies using contracts</title>
		<author>
			<persName><forename type="first">V</forename><surname>Dignum</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">J</forename><surname>Meyer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Weigand</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of AAMAS 2002</title>
				<meeting>AAMAS 2002<address><addrLine>New York, NY, USA</addrLine></address></meeting>
		<imprint>
			<publisher>ACM</publisher>
			<date type="published" when="2002">2002</date>
			<biblScope unit="page" from="694" to="695" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b15">
	<analytic>
		<title level="a" type="main">Communicating open systems</title>
		<author>
			<persName><forename type="first">M</forename><surname>Inverno</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Luck</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Noriega</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodriguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Artificial Intelligence</title>
		<imprint>
			<biblScope unit="volume">186</biblScope>
			<biblScope unit="page" from="38" to="94" />
			<date type="published" when="2012-07">Jul 2012</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b16">
	<analytic>
		<title level="a" type="main">On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games</title>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">M</forename><surname>Dung</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Artificial Intelligence</title>
		<imprint>
			<biblScope unit="volume">77</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="321" to="357" />
			<date type="published" when="1995-09">Sep 1995</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b17">
	<analytic>
		<title level="a" type="main">Weighted argument systems: Basic definitions, algorithms, and complexity results</title>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">E</forename><surname>Dunne</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Hunter</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Mcburney</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Parsons</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Wooldridge</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Artificial Intelligence</title>
		<imprint>
			<biblScope unit="volume">175</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="457" to="486" />
			<date type="published" when="2011-02">Feb 2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b18">
	<analytic>
		<title level="a" type="main">Negotiating socially optimal allocations of resources</title>
		<author>
			<persName><forename type="first">U</forename><surname>Endriss</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Maudet</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Sadri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Toni</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Artificial Intelligence Research</title>
		<imprint>
			<biblScope unit="volume">25</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="315" to="348" />
			<date type="published" when="2006-03">Mar 2006</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b19">
	<analytic>
		<title level="a" type="main">IDReAM: Intrusion detection and response executed with agent mobility architecture and implementation</title>
		<author>
			<persName><forename type="first">N</forename><surname>Foukia</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of AAMAS 2005</title>
				<meeting>AAMAS 2005</meeting>
		<imprint>
			<publisher>ACM</publisher>
			<date type="published" when="2005">2005</date>
			<biblScope unit="page" from="264" to="270" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b20">
	<analytic>
		<title level="a" type="main">Distributed norm management in regulated multiagent systems</title>
		<author>
			<persName><forename type="first">D</forename><surname>Gaertner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Garcia-Camino</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Noriega</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodriguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Vasconcelos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems</title>
				<meeting>the 6th International Joint Conference on Autonomous Agents and Multiagent Systems<address><addrLine>New York, NY, USA</addrLine></address></meeting>
		<imprint>
			<publisher>ACM</publisher>
			<date type="published" when="2007">2007</date>
			<biblScope unit="volume">90</biblScope>
			<biblScope unit="page" from="1" to="90" />
		</imprint>
	</monogr>
	<note>AAMAS &apos;07</note>
</biblStruct>

<biblStruct xml:id="b21">
	<analytic>
		<title level="a" type="main">A survey of trust in internet applications</title>
		<author>
			<persName><forename type="first">T</forename><surname>Grandison</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Sloman</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">IEEE Commun. Surveys Tuts</title>
		<imprint>
			<biblScope unit="volume">4</biblScope>
			<biblScope unit="issue">4</biblScope>
			<biblScope unit="page" from="2" to="16" />
			<date type="published" when="2000">2000</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b22">
	<analytic>
		<title level="a" type="main">Norm Emergence in Tag-Based Cooperation</title>
		<author>
			<persName><forename type="first">N</forename><surname>Griffiths</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Luck</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of COIN</title>
				<meeting>COIN</meeting>
		<imprint>
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b23">
	<analytic>
		<title level="a" type="main">A survey of multi-agent organizational paradigms</title>
		<author>
			<persName><forename type="first">B</forename><surname>Horling</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Lesser</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Knowl. Eng. Rev</title>
		<imprint>
			<biblScope unit="volume">19</biblScope>
			<biblScope unit="page" from="281" to="316" />
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b24">
	<analytic>
		<title level="a" type="main">Social abstract argumentation</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Leite</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Martins</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence</title>
				<meeting>the Twenty-Second International Joint Conference on Artificial Intelligence</meeting>
		<imprint>
			<publisher>AAAI Press</publisher>
			<date type="published" when="2011">2011</date>
			<biblScope unit="page" from="2287" to="2292" />
		</imprint>
	</monogr>
	<note>IJCAI&apos;11</note>
</biblStruct>

<biblStruct xml:id="b25">
	<analytic>
		<title level="a" type="main">Self-organising systems</title>
		<author>
			<persName><forename type="first">G</forename><surname>Marzo Serugendo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">P</forename><surname>Gleizes</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Karageorgos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Self-organising Software</title>
				<editor>
			<persName><forename type="first">Di</forename><surname>Marzo Serugendo</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">G</forename><surname>Gleizes</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">M</forename><forename type="middle">P</forename><surname>Karageorgos</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">A</forename></persName>
		</editor>
		<imprint>
			<publisher>Springer</publisher>
			<date type="published" when="2011">2011</date>
			<biblScope unit="page" from="7" to="32" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b26">
	<analytic>
		<title level="a" type="main">Engineering Self-Organising Systems</title>
		<author>
			<persName><forename type="first">G</forename><surname>Marzo Serugendo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Karageorgos</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Rana</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Zambonelli</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="s">Lecture Notes in Computer Science</title>
		<imprint>
			<biblScope unit="volume">2977</biblScope>
			<date type="published" when="2004">2004</date>
			<publisher>Springer</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b27">
	<analytic>
		<title level="a" type="main">A framework for monitoring agent-based normative systems</title>
		<author>
			<persName><forename type="first">S</forename><surname>Modgil</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Faci</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Meneguzzi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Oren</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Miles</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Luck</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems</title>
				<meeting>The 8th International Conference on Autonomous Agents and Multiagent Systems<address><addrLine>Richland, SC</addrLine></address></meeting>
		<imprint>
			<publisher>International Foundation for Autonomous Agents and Multiagent Systems</publisher>
			<date type="published" when="2009">2009</date>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="page" from="153" to="160" />
		</imprint>
	</monogr>
	<note>AAMAS &apos;09</note>
</biblStruct>

<biblStruct xml:id="b28">
	<analytic>
		<title level="a" type="main">Using Experience to Generate New Regulations</title>
		<author>
			<persName><forename type="first">J</forename><surname>Morales</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>López-Sánchez</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Esteva</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">IJCAI</title>
				<imprint>
			<date type="published" when="2011">2011</date>
			<biblScope unit="page" from="307" to="312" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b29">
	<analytic>
		<title level="a" type="main">Automated synthesis of normative systems</title>
		<author>
			<persName><forename type="first">J</forename><surname>Morales</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Lopez-Sanchez</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Rodriguez-Aguilar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Wooldridge</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Vasconcelos</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">AAMAS</title>
		<imprint>
			<biblScope unit="page" from="483" to="490" />
			<date type="published" when="2013">2013. 2013</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b30">
	<analytic>
		<title level="a" type="main">A role based model for the normative specification of organized collective agency and agents interaction</title>
		<author>
			<persName><forename type="first">O</forename><surname>Pacheco</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Carmo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Autonomous Agents and Multi-Agent Systems</title>
		<imprint>
			<biblScope unit="volume">6</biblScope>
			<biblScope unit="page" from="145" to="184" />
			<date type="published" when="2003-03">March 2003</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b31">
	<monogr>
		<title level="m" type="main">Argumentation in Artificial Intelligence</title>
		<author>
			<persName><forename type="first">I</forename><surname>Rahwan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><forename type="middle">R</forename><surname>Simari</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2009">2009</date>
			<publisher>Springer</publisher>
		</imprint>
	</monogr>
	<note>1st edn</note>
</biblStruct>

<biblStruct xml:id="b32">
	<analytic>
		<title level="a" type="main">Trust in multi-agent systems</title>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">D</forename><surname>Ramchurn</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Huynh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">R</forename><surname>Jennings</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Knowledge Engineering Review</title>
		<imprint>
			<biblScope unit="volume">19</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="1" to="25" />
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b33">
	<analytic>
		<title level="a" type="main">Trust among strangers in Internet transactions: Empirical analysis of eBay&apos;s reputation system</title>
		<author>
			<persName><forename type="first">P</forename><surname>Resnick</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Zeckhauser</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">The Economics of the Internet and E-Commerce</title>
				<editor>
			<persName><forename type="first">M</forename><forename type="middle">R</forename><surname>Baye</surname></persName>
		</editor>
		<imprint>
			<publisher>Elsevier Science</publisher>
			<date type="published" when="2002">2002</date>
			<biblScope unit="page" from="127" to="157" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b34">
	<analytic>
		<title level="a" type="main">A lightweight method for coordination of agent oriented web services</title>
		<author>
			<persName><forename type="first">D</forename><surname>Robertson</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of AAAI Spring Symposium on Semantic Web Services</title>
				<meeting>AAAI Spring Symposium on Semantic Web Services<address><addrLine>Stanford</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b35">
	<analytic>
		<title level="a" type="main">Review on computational trust and reputation models</title>
		<author>
			<persName><forename type="first">J</forename><surname>Sabater</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Sierra</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">AI Review</title>
		<imprint>
			<biblScope unit="volume">23</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="33" to="60" />
			<date type="published" when="2005-09">September 2005</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b36">
	<analytic>
		<title level="a" type="main">Effects of social network topology and options on norm emergence</title>
		<author>
			<persName><forename type="first">O</forename><surname>Sen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Sen</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of COIN</title>
				<meeting>COIN</meeting>
		<imprint>
			<date type="published" when="2010">2010</date>
			<biblScope unit="page" from="211" to="222" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b37">
	<analytic>
		<title level="a" type="main">Emergence of norms through social learning</title>
		<author>
			<persName><forename type="first">S</forename><surname>Sen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Airiau</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">IJCAI</title>
				<imprint>
			<date type="published" when="2007">2007</date>
			<biblScope unit="page" from="1507" to="1512" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b38">
	<analytic>
		<title level="a" type="main">Writing clinical practice guidelines in controlled natural language</title>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">N</forename><surname>Shiffman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Michel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Krauthammer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">E</forename><surname>Fuchs</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Kaljurand</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Kuhn</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 2009 Conference on Controlled Natural Language</title>
				<meeting>the 2009 Conference on Controlled Natural Language<address><addrLine>Berlin, Heidelberg</addrLine></address></meeting>
		<imprint>
			<publisher>Springer-Verlag</publisher>
			<date type="published" when="2010">2010</date>
			<biblScope unit="page" from="265" to="280" />
		</imprint>
	</monogr>
	<note>CNL&apos;09</note>
</biblStruct>

<biblStruct xml:id="b39">
	<analytic>
		<title level="a" type="main">On social laws for artificial agent societies: off-line design</title>
		<author>
			<persName><forename type="first">Y</forename><surname>Shoham</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Tennenholtz</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Artif. Intell</title>
		<imprint>
			<biblScope unit="volume">73</biblScope>
			<biblScope unit="page" from="231" to="252" />
			<date type="published" when="1995">1995</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b40">
	<analytic>
		<title level="a" type="main">Policy driven management for distributed systems</title>
		<author>
			<persName><forename type="first">M</forename><surname>Sloman</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Network and Systems Management</title>
		<imprint>
			<biblScope unit="volume">2</biblScope>
			<biblScope unit="page" from="333" to="360" />
			<date type="published" when="1994">1994</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b41">
	<analytic>
		<title level="a" type="main">Sequential decision making with untrustworthy service providers</title>
		<author>
			<persName><forename type="first">W</forename><surname>Teacy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Chalkiadakis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Rogers</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">R</forename><surname>Jennings</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems</title>
				<meeting>the 7th International Conference on Autonomous Agents and Multiagent Systems</meeting>
		<imprint>
			<date type="published" when="2008">2008</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b42">
	<monogr>
		<title level="m" type="main">Coherence in thought and action</title>
		<author>
			<persName><forename type="first">P</forename><surname>Thagard</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2002">2002</date>
			<publisher>MIT Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b43">
	<analytic>
		<title level="a" type="main">BEES: Exploring mars with bioinspired technologies</title>
		<author>
			<persName><forename type="first">S</forename><surname>Thakoor</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">M</forename><surname>Morookian</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Chahl</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Hine</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Zornetzer</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Computer</title>
		<imprint>
			<biblScope unit="volume">37</biblScope>
			<biblScope unit="issue">9</biblScope>
			<biblScope unit="page" from="38" to="47" />
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b44">
	<monogr>
		<title level="m" type="main">Planning and learning by analogical reasoning</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">M</forename><surname>Veloso</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1994">1994</date>
			<publisher>Springer</publisher>
			<biblScope unit="volume">886</biblScope>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b45">
	<analytic>
		<title level="a" type="main">Social instruments for robust convention emergence</title>
		<author>
			<persName><forename type="first">D</forename><surname>Villatoro</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Sabater-Mir</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Sen</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">IJCAI</title>
				<imprint>
			<date type="published" when="2011">2011</date>
			<biblScope unit="page" from="420" to="425" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b46">
	<analytic>
		<title level="a" type="main">A biochemical approach to adaptive service ecosystems</title>
		<author>
			<persName><forename type="first">M</forename><surname>Viroli</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Zambonelli</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Inf. Sci</title>
		<imprint>
			<biblScope unit="volume">180</biblScope>
			<biblScope unit="issue">10</biblScope>
			<biblScope unit="page" from="1876" to="1892" />
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b47">
	<analytic>
		<title level="a" type="main">A comprehensive review of nature inspired routing algorithms for fixed telecommunication networks</title>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">F</forename><surname>Wedde</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Farooq</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Systems Architecture</title>
		<imprint>
			<biblScope unit="volume">52</biblScope>
			<biblScope unit="issue">8</biblScope>
			<biblScope unit="page" from="461" to="484" />
			<date type="published" when="2006-08">Aug 2006</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b48">
	<monogr>
		<title level="m" type="main">An artificial intelligence approach to machine translation</title>
		<author>
			<persName><forename type="first">Y</forename><surname>Wilks</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2009">2009</date>
			<publisher>Springer</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b49">
	<analytic>
		<title level="a" type="main">An empirical approach to the semantic representation of laws</title>
		<author>
			<persName><forename type="first">A</forename><surname>Wyner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Bos</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Basile</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Quaresma</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Legal Knowledge and Information Systems -JURIX 2012: The Twenty-Fifth Annual Conference. Frontiers in Artificial Intelligence and Applications</title>
				<editor>
			<persName><forename type="first">B</forename><surname>Schäfer</surname></persName>
		</editor>
		<imprint>
			<publisher>IOS Press</publisher>
			<date type="published" when="2012">2012</date>
			<biblScope unit="volume">250</biblScope>
			<biblScope unit="page" from="177" to="180" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b50">
	<analytic>
		<title level="a" type="main">From policy-making statements to firstorder logic</title>
		<author>
			<persName><forename type="first">A</forename><surname>Wyner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Van Engers</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Bahreini</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the First International Conference on Electronic Government and the Information Systems Perspective</title>
				<meeting>the First International Conference on Electronic Government and the Information Systems Perspective<address><addrLine>Berlin, Heidelberg</addrLine></address></meeting>
		<imprint>
			<publisher>Springer-Verlag</publisher>
			<date type="published" when="2010">2010</date>
			<biblScope unit="page" from="47" to="61" />
		</imprint>
	</monogr>
	<note>EGOVIS&apos;10</note>
</biblStruct>

<biblStruct xml:id="b51">
	<analytic>
		<title level="a" type="main">A study on translating regulatory rules from natural language to defeasible logic</title>
		<author>
			<persName><forename type="first">A</forename><surname>Wyner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Governatori</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">RuleML 2013</title>
				<meeting><address><addrLine>Seatle, USA</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2013-07">July 2013</date>
			<biblScope unit="page" from="1" to="16" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b52">
	<analytic>
		<title level="a" type="main">On rule extraction from regulations</title>
		<author>
			<persName><forename type="first">A</forename><surname>Wyner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Peters</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Legal Knowledge and Information Systems -JURIX 2011: The Twenty-Fourth Annual Conference. Frontiers in Artificial Intelligence and Applications</title>
				<editor>
			<persName><forename type="first">K</forename><surname>Atkinson</surname></persName>
		</editor>
		<imprint>
			<publisher>IOS Press</publisher>
			<date type="published" when="2011">2011</date>
			<biblScope unit="volume">235</biblScope>
			<biblScope unit="page" from="113" to="122" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b53">
	<analytic>
		<title level="a" type="main">Truth discovery with multiple conflicting information providers on the Web</title>
		<author>
			<persName><forename type="first">X</forename><surname>Yin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Han</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">S</forename><surname>Yu</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the Conference on Knowledge and Data Discovery</title>
				<meeting>the Conference on Knowledge and Data Discovery</meeting>
		<imprint>
			<date type="published" when="2007">2007</date>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
