=Paper=
{{Paper
|id=Vol-1668/paper9
|storemode=property
|title=Multi-Agent Based Ethical Asset Management
|pdfUrl=https://ceur-ws.org/Vol-1668/paper9.pdf
|volume=Vol-1668
|authors=Nicolas Cointe,Grégory Bonnet,Olivier Boissier
|dblpUrl=https://dblp.org/rec/conf/ecai/CointeBB16
}}
==Multi-Agent Based Ethical Asset Management==
Multi-Agent Based Ethical Asset Management Nicolas Cointe1 and Grégory Bonnet2 and Olivier Boissier3 Abstract. The increasing number of ethical investment funds shows The contributions of this article are the following: mapping of an how the need of ethics in asset management is growing up. In the ethical judgment process in a BDI architecture and instantiating the same time, in some markets, autonomous agents are managing a components of this model to the asset management domain. The pa- larger number of financial transactions than human do. If many per is organized as follows. In Section 2, we introduce the asset man- philosophers and economists discuss the fairness of different ap- agement domain and present what are ethical considerations in such proaches for responsible investment, there is no strong proposition a domain. In Section 3, we present a BDI agent architecture in which today about the implementation of autonomous agents able to take the ethical judgment process presented in [6] is embedded. Thus an into account ethical notions in their financial decisions. This article autonomous agent can decide on actions to execute based both on proposes an approach to represent morals and ethics in a BDI archi- ethical principles and preferences and on moral values and rules. tecture and illustrates its use in the context of ethical asset manage- This BDI agent architecture is instantiated to the asset management ment. An analysis of a first experimentation on a simulated market is domain. Finally, in Section 5, we offer an agent-based simulation to given. analyse the system’s behavior. 1 INTRODUCTION 2 ETHICS & ASSET MANAGEMENT The increasing use of IT technologies in today financial markets is In this section we motivate and identify the needs of introducing eth- no more limited to the use of communication and automatic match- ical dimensions in the autonomous decision making supporting asset ing mechanisms but is invading also the decision layer where au- management. Firstly, we briefly present what is morals and ethics, tonomous algorithms make decisions. In this paper, we are interested then we present asset management domain. Then, we present the in asset management domain where such a transformation in the trad- main concepts to understand ethics in such a domain. ing of assets generates several practical and ethical issues4 . The ob- jective and contribution of this article is use a BDI approach to embed autonomous trading agents’ decisions with ethical considerations, re- 2.1 Morals and ethics gardless the speed or efficiency of the trading strategy. Morals consists in a set of moral rules which describes the compli- Some people consider the use of automatic management decision ance of a given behavior with mores, values and usages of a group as the origin of several bad effects such as market manipulations, or a single person. These rules associate a good or bad value to some unfair competition towards small investors and flash crashes by cas- combinations of actions and contexts. They could be specific or uni- cading effects. Others argue that it reduces volatility, increases trans- versal, i.e. related or not to a period, a place, a community, etc. This parency and stability with a lower execution cost [3]. As shown by kind of rules grounds our ability to distinguish between good and some reports [5], ethical investment funds are even more growing evil. Morals can be distinguished from law and legal systems in the and taking a significant position on the market. However, werehas the sense that there is not explicit penalties, officials and written rules performance of such funds can be measured objectively, their ‘èthi- [10]. Moral rules are often supported and justified by some moral cal” quality is more difficult to determine as it determines at least in values (e.g. transparency, responsibility, ecology). Psychologists, so- part on the values of the observer. ciologists and anthropologists almost agree that moral values are cen- Decisions by autonomous agents to whom human users delegate tral in the evaluation of actions, people and events [15]. the power to sell/buy assets have consequences in real life [7] and A set of moral rules and moral values establishes a theory of the as some investment funds are interested to make socially responsible good which allows humans to assess the goodness or badness of a be- and ethical trading, we are interested in the definition of mechanisms havior and theories of the right which define some criteria to recog- for making financial agents able to follow ethical principles, moral nize a fair or, at least, acceptable option. Indeed, humans commonly values and moral rules. In order to achieve this objective, we use a accept many situations where it is right and fair to satisfy needs or model of ethical judgment process proposed in [6] mapped into a desires, even if it is not acceptable from a set of moral rules and val- BDI agent model. Such agents can decide to trade assets based on ues. Those theories are also respectively named theory of values and the moral and ethical preferences or values of their stakeholders. theories of right conduct [16]. 1 Institut Henri Fayol, EMSE, LabHC, UMR CNRS 5516, F-42000, Saint- Relying on some philosophers as Paul Ricoeur [14], we admit that Etienne, France, email: nicolas.cointe@emse.fr ethics is a normative practical philosophical discipline of how hu- 2 Normandie Univ, UNICAEN, ENSICAEN, CNRS, GREYC, 14000 Caen, mans should act and be toward the others. Ethics uses ethical princi- France, email: gregory.bonnet@unicaen.fr 3 Institut Henri Fayol, EMSE, LabHC, UMR CNRS 5516, F-42000, Saint- ples to conciliate morals, desires and capacities of the agent. Philoso- Etienne, France, email: olivier.boissier@emse.fr phers proposed various ethical principles, such as Kant’s Categorical 4 http://sevenpillarsinstitute.org/ Imperative [11] or Thomas Aquinas’ Doctrine of Double Effect [12], which are sets of rules that allow to distinguish an ethical option from fact is part of an asset policy and the second one is part of a mar- a set of possible options. ket policy. Those policies can be viewed as a set of moral rules. As Indeed, the core of ethics is the judgment. It is the final step to moral rules cannot be satisfied in all contexts, ethical asset managers make a decision and it evaluates each choice, with respect to the use ethical principles to make their decisions. By instance “Always agent’s desires, morals, abilities and ethical principles. Relying on execute the most profitable action which violate as few as possible some consensual references [1] and previous work [6], judgment is rules” is an example of ethical principle for an ethical asset manager. the faculty of distinguishing the most satisfying option in a situation, Finally, an asset manager needs to be able to judge that the asset regarding a set of ethical principles, for ourselves or someone else. exchanged and the modalities of the transaction are both compliant Finally, if an agent is facing two possible choices with both good with his morals and ethics. To this end, some institutions as authori- and/or bad effect, the ethical judgment allows him to make a deci- ties, non-governmental organizations or journalists observe markets, sion in conformity with a set of ethical principles and preferences. funds, asset managers, and companies. From those observations, they provide evaluations that may be used by funds, companies and as- set managers to make ethical decisions. For instance, the ethiscore5 2.2 Asset management is a tool proposed by some journalists to rank a set of hedge funds The asset management is the art of selecting financial assets (e.g. regarding a given set of values as ecological, political or social con- equities, bonds, currencies, merchandises and so on) to be bought siderations. According with this tool, a company quoted on a market and be sold in order to manage a capital, respecting regulatory and may satisfy some criteria as producing sustainable products, having contractual constraints, and applying an investment policy defined a socially responsible management method and so on, depending on by the owner of the managed portfolio (a set of assets) in order to the values of the investors, to be considered in an ethical investment optimize his profit, considering a chosen level of risk. portfolio. The assets are commonly exchanged on a marketplace, i.e. a sys- Knowing those concepts, our proposition consists in representing tem designed to match bid and ask orders at the best price and the them explicitly (asset policies, market policies and evaluations) and best frequency. Different types of matching methods are available, as integrate them in autonomous agents’ decision process in terms of auctions or order books, and those methods accept different types of values, morals and ethics. orders, as cancellable or dynamic orders. Marketplaces are actually more than simple interfaces for buyers and sellers because they also provide a variety of functionalities: 3 BDI AGENT ARCHITECTURE FOR ETHICAL ASSET MANAGEMENT 1. to finance companies and institutions by the emission of bonds, warrants or equities; In this section, we first provide a global view of our architecture and 2. to increase liquidity of the exchanges, i.e. minimizing the impact then focus on the two main components for making agents able to of a bid or ask order on the price; produce ethical behaviours: goodness and rightness processes. 3. to indicate the value of the assets in real time; 4. to increase the control and monitoring on the economy, by con- 3.1 Global view tributing to the transparency with the publication of detailed bal- ance sheets and number of analyses. The agent architecture in which we introduce the necessary repre- sentations and mechanisms to have agents able to produce ethical Each asset manager composes the orders to put on the marketplace behaviours is based on a BDI approach [13]. In this approach, the with a set of options as a possibility of cancellation, the duration of its behaviour of an agent is the result of a deliberation designed to issue validity, a limit price, an investment strategy and so on. To decide the intentions, to bring about or to react to some world states with respect best order to perform, the asset manager needs to be well informed to the agent’s evaluation of the situation (represented by a set B of on the state of the market, through raw data and various indicators. beliefs) and the agent’s goals (represented by a set D of desires). To be able to produce an ethical behaviour, the basic BDI delib- 2.3 Ethical dimensions of asset management eration cycle must be enriched with a process to evaluate the good- ness of a behaviour (represented by a goodness process named GP ) Ethical asset management, also called responsible investment or so- and with another process to evaluate the rightness of a behaviour cial investment, considers new information in the management de- (represented by a rightness process named RP ) resulting from the cision process, as sectors, labels or any indicators on the impact of execution of actions. To this end, agents are equipped with an ac- these assets and their underlying on the society. Thus, the morals of tion knowledge base A and four other knowledge bases that define an agent (combination of moral values and rules) may be defined value supports V S, moral rules M R, ethical principles P and ethi- by an asset policy (e.g. trading nuclear-free assets or never trading cal preferences e . Moreover, agents are equipped with an ontology in the defense sector). Moreover, the manner to trade is important O = Ov ∪ Om of moral values Ov (e.g. carefulness, ecology or too. In the last decade, the introduction of autonomous agents on the transparency) and moral valuations Om (e.g. moral, quite good or marketplaces comes with new harmful practices (e.g. layering, quote immoral). The global architecture is given in Figure 1 and is issued stuffing, spoofing). Therefore, the morals of an agent may also rely of the judgment process proposed in [6]. on transparency, honesty or avoidance of any manipulation of the In our agent architecture, each action of A is described as a pair market. Such policies are not about assets, but about the morality of of conditions and consequences bearing respectively on beliefs and agents’s behaviors on the market. desires. Perception P er and communication Com functions update For instance, an ethical asset manager in Islamic finance may beliefs and desires from, respectively, perception of the environment both agree on the fact to “exclude stocks of companies that pro- duce/distribute prohibited goods/services regarding the Shari’ah” [2] 5 http://www.ethicalconsumer.org/buyersguides/money/ and the fact to “prefer to deal with other Islamic agents”. The first ethicalinvestmentfunds.aspx and communication with other agents. From its beliefs B and de- In addition to moral values, an agent must be able to represent sires D, an agent executes an Evaluation Process EP to assess both and to manage moral rules. A moral rule describes the association desirable actions, Ad ⊆ A (i.e. actions that allow to satisfy the con- of a moral valuation m ∈ Om to actions or moral values in a given sequences of the action), and executable actions, Ac ⊆ A (i.e. ac- situation. A moral rule is a tuple hw, o, mi ∈ M R where w is a tions whose conditions are satisfied on the current beliefs about the situation of the current world described by w ⊂ B ∪ D interpreted world). The evaluation process EP produces desirable actions Ad as a conjunction of beliefs and desires, o = ha, vi where a ∈ A and and executable ones Ap from B and D. At the end of the process, we v ∈ Ov , and m ∈ Om is a moral valuation that qualifies o when w find a classical deliberation function that generates the intentions to holds. For instance, some rules may be represented as follows: execute given the right actions of Ar . hBel(sector(α, medicine)), hbuy(α), _ i, morali Data flow Awareness Process hBel(going down, α), h _ , caref ulnessi, quite goodi VS MR Evaluation Process Goodness Process A moral rule can be more or less specific depending on the situa- Rightness Process tion w or the object o. For instance “Transparency is good” is more Knowledge base B ME Am State general (having less combinations in w or o, thus applying in a larger Function number of situations) than “To sell an asset in a quantity superior than Com the available bid between the current value and the moving average A CE Ac EE Ae J Ar Del I minus five percent is immoral”. Classically, moral theories are clas- Per sified in three approaches using both moral values and moral rules as P e defined above, we can represent such theories. D DE Ad • A virtuous approach uses general rules based on moral values, e.g. “Ecology is moral”, Figure 1. Ethical BDI agent architecture • A deontological approach classically considers rules concerning actions in order to describe as precisely as possible the moral be- havior, e.g. “Buying an asset of an eurolabel certified company is moral” 3.2 Goodness process • A consequentialist approach uses both general and specific rules concerning states and consequences, e.g. “Investing in an asset of The goodness process GP identifies moral actions Am ⊆ A6 given an company that will practice animal testing is not moral”. the agent’s beliefs B and desires D, the agent’s actions A, the agent’s value supports V S given moral values and M R moral rules knowl- edge base. It is defined as: 3.3 Rightness Process From the sets of possible (Ap ), desirable (Ad ) and moral actions GP = hV S, M R, Am , M Ei (Am ), we can introduce the rightness process RP aiming at assess- ing the rightful actions. As an ethical agent can use several ethical where M E is the moral evaluation function: principles to conciliate these sets of actions, we consider a prefer- M E : 2D × 2B × 2A × 2V S × 2M R → 2Am ence relationship between those principles. Thus, a rightness process RP produces rightful actions given a representation of the agent’s In order to realize this goodness process, an agent uses knowledge ethics. It is defined as: that associates moral values to combinations of actions and situa- tions, meaning that the execution of the actions in these situations RP = hP, e , Ar , EE, Ji promotes the corresponding moral values. where P is a knowledge base of ethical principles, e ⊆ P × P an We represent this knowledge through value supports. A value sup- ethical preference relationship, Ar ⊆ A the set of rightful actions port is a tuple hs, vi ∈ V S where v ∈ Ov is a moral value, and two functions EE (evaluation of ethics) and J (judgment) such and s = ha, wi is the support of this moral value where a ⊆ A, that : w ⊂ B ∪ D. Here, the precise description of a moral value through a EE : 2Ad × 2Ap × 2Am × 2P → 2E value support relies on the language used to represent beliefs, desires and actions. For instance, from this definition, carefulness supported where E = A × P × {⊥, >}. by “do not buy any asset α if the volatility V is over a limit Vlimit ” may be represented by: J : 2E × 2e → 2Ar hhbuy(α), {Bel(V ≥ Vlimit )}i, ¬caref ulnessi An ethical principle is a function which represents a philosophical theory and evaluates if it is right or wrong to execute a given action where α represents any asset, Bel(V ≥ Vlimit ) is a belief represent- in a given situation regarding this theory. For instance “It is right to ing the context for which executing the action buy(α) does not sup- do the most desirable action which is, at least, amoral” may be a very port the value caref ulness. A moral value may also be a subvalue simple principle. Formally, an ethical principle p ∈ P is defined as: of another more general one, i.e. all its value supports also support the more general one. p : 2A × 2B × 2D × 2M R × 2V → {>, ⊥} 6 A m * Ad ∪ Ac because an action might be moral by itself even if it is not The ethics evaluation function EE returns the evaluation of all desired or feasible. desirable, feasible and moral actions (resp. Ad , Ap and Am ) given the set P of known ethical principles. Given a set of actions issued executed parts are removed from the CLOB. At the end of the inser- from EE, the judgment J selects the rightful action Ar to perform, tion, the new best bid is p − 1 and the new best ask is p. All these considering a set of ethical preferences (defined as a partial or total changes are perceived by the agents. order on the ethical principles). For instance, a principle P 1 ∈ P Agents get a set of beliefs describing the market and their port- may be “if an action is possible, desirable and motivated by a moral folio, making them able to represent and reason on the current sit- rule, it is right to do it” and a principle P 2 ∈ P “if an action is uation. Agents also perceive each minute a set of statistics on the possible, desirable and at least not immoral, it is right to do it”. If activity of each asset: the volume v (the quantity of exchanged as- P 1 e P 2, the agent will select a right action according with P 1 sets), two moving average prices mm and dblmm, respectively the and, if it is not feasible, a right action regarding P 2. The right action average price on the last twenty minutes and on the last fourty min- Ar is transmitted to the classic deliberation function to choose the utes, the standard deviations σ of prices, the closing prices on this intention I to execute. period, and the up and down Bollinger bands (respectively mm + 2σ and mm − 2σ). The agents’ perception function provides the following beliefs 4 AGENCY FOR ETHICAL ASSET from the environment: MANAGEMENT indicators(Date,Marketplace,Asset,Close,Volume, This section describes the experiment used to to illustrate and eval- Intensity,Mm,Dblmm,BollingerUp,BollingerDown) uate the use of the architecture presented in the previous section. We have implemented a multi-agent system that simulates a finan- onMarket(Date,Agent,Portfolio,Marketplace, cial market where some autonomous ethical trading agents exchange Side,Asset,Volume,Price) assets. This system has been implemented using the JaCaMo plat- executed(Date,Agent,Portfolio,Marketplace, form where agents are programmed using the Jason language and Side,Asset,Volume,Price) the market place is based on artifacts from Cartago. The ethical agents are initialized with a set of beliefs about ac- tivities of the companies (e.g. EDF7 produces nuclear energy) and 4.1 Financial market modeling some labels about their conformity with international standards (e.g. We consider a marketplace where autonomous trading agents have Legrand8 is labeled FSC). the possibility to manage portfolio of assets and to sell or buy assets (both currencies, i.e. money, and equity securities, i.e. part of a capi- 4.2 Ethical settings tal stock of a company) on the market. The set of actions that an agent can execute on the market are “buy”, “sell” or “cancel” orders. They The ethical agents know a set of organized values: for instance “envi- respectively correspond to the exchange of an equity for a currency, ronmental reporting” is considered as a subvalue of “environment”. the opposite way and cancellation of a proposition of exchange if They are declared as : this order is not yet executed. These actions will be the ones consid- ered in the ethical deliberation cycle of an agent. Agents can specify value("environment"). subvalue("promote_renewable_energy","environment"). a limit price or can accept the current market price. Each equity is subvalue("environmental_reporting","environment"). quoted in a state-of-the-art Central Limit Order Book (CLOB) [3]. subvalue("fight_climate_change","environment"). A CLOB simply stores and sorts by price the set of “buy” and “sell” orders (respectively placed on bid and ask sides of the same order They also have a set of value supports as “trading assets of nu- book) provided by the agents. When an agent put an order on the bid clear energy producer is not conform with the subvalue promotion of or ask side, the CLOB obey the following rules (see Figure 2): renewable energy”, “trading asset of an FSC-labeled company is con- form with the subvalue environmental reporting” and “trading assets • if there is no order to match with, the order is added, of nuclear energy producer is conform with the subvalue fight against • if there is an order to match with, both the incoming and the climate changes”. Some examples of value supports are: present orders are filled, and the rest of the biggest, if any, is placed in the CLOB (and may eventually match with another order). ~valueSupport(buy(Asset,_,_,_), "promote_renewable_energy"):- activity(Asset,"nuclear_energy_production"). Price Price Price Bid side Ask side Bid side Ask side Bid side Ask side valueSupport(sell(Asset,_,_,_), p+3 Ask5 Ask5 p+3 Ask5 Ask5 p+3 Ask5 Ask5 "environmental_reporting") :- p+2 Ask10 p+2 Ask10 p+2 Ask10 label(Asset,"FSC"). p+1 Ask6 p+1 Ask6 p+1 Ask6 Bid8 p Ask13 EXE p EXE Ask5 p Ask5 Bid5 Bid5 Bid5 Bid5 Bid5 Bid5 Agents are also equiped with moral rules stating the morality of p−1 p−1 p−1 Bid8 p−2 Bid8 p−2 Bid8 p−2 environmental considerations. For instance, “It is moral to act in con- t t+1 t+2 formity with the value environment” is simply represented as: moral_eval(X,V1,moral):- Figure 2. Execution of a limit order added on the market valueSupport(X,V1) & subvalue(V1,"environment"). The example on the Figure 2 illustrates the addition of an ask or- moral_eval(X,"environment",moral):- valueSupport(X,"environment"). der of thirteen assets at the price p. Before the addition, the best bid is p and the best ask is p + 1. The new order encounter an order on 7 The French national energy producer. 8 A French electric infrastructure producer. the other side during its insertion, so the biggest is splitted and the In this example, an ethical agent is now able to infer for instance the agents. They concern the equities “LEGRAND”. The main data that, regarding its belief, trading Legrand is moral regarding this the- (represented by a candlestick chart) show us the evolution of the price ory of good, and that trading EDF is both moral and immoral. Fi- on the market and the two moving averages mentioned in section 4.1 nally, ethical agents are equipped with simple principles, such as “It (the line charts in the middle of the candlestick chart) are slowly is rightful to do a possible, not immoral and desirable action”. The moving up and down. They are used by the desirability evaluation implementation of this principle and some preferences is: to detect opportunities according to the rules detailed in Section 4.3. The candlestick chart does not break often the Bollinger bands, but ethPrinciple("desireNR",Action):- possible_eval(Action, possible) & these breaks may happen sometimes. We observe some peaks in the desire_eval(Action,desired) & volume barchart when the moving averages are crossing each other. not desire_eval(Action,undesired) & This is due to the number of exchanges performed by the zero-ethics not moral_eval(Action,_,immoral). and ethical agents because their desirability function is triggered by prefEthics("perfectAct","desireNR"). this event. prefEthics("desireNR","dutyNR"). � ���� 4.3 Families of agents for asset management ��� � ���� Each agent receives a portfolio (a set of equities and currencies) ������������ at the beginning of the simulation and may exchange it on the ��� market. Three types of agents are considered in this system: zero- � ���� intelligence, zero-ethics and ethical agents. ��� • Zero-intelligence agents are making random orders (in terms of � ���� price and volume) on the market to generate activity and simu- �� ������ ����������������� late the "noise" of real markets. Each zero-intelligence agent is �� assigned to an asset. Their only desire and ethical principle are the � application of this random behaviour. In this experiment, they are ��� ��� �� � ���� ���� ���� ��� � ��� � ����������������� used to generate a realistic noisy activity on the market in order to create opportunities for the other agents. Figure 3. Evolution of the asset LEGRAND. The candlestick chart repre- • Zero-ethics agents only have a simple desirability evaluation func- sents the evolution of the price, with the moving averages in the middle and tion to speculate: if the price of the market is going up (the shortest the up and down Bollinger bands on each side. moving mean is over the other one), they buy the asset, otherwise, they sell it. If the price goes out of the bollinger bands, these rules are inverted. This strategy is also used by the ethical agents to Figure 4 represents the evolution of the portfolio of an ethical evaluate the desirable actions. agent during the experiment. It provides information on the behavior • Ethical agents implements the ethical decision process to take of this agent and it was chosen because it is quite representative of their decisions. An ethical agent implementing the ethical deci- the portfolios of the other ethical agents. The y-axis shows the value sion process without any moral value or moral rule and an single of the portfolio and the colors depend on the assets placed in the ethical principle that simply considers desirability are also ethical portfolio. agents, more precisely hedonic agents. It is different from a zero- ethics agent because this agent still has all the ethical decision ��������� ��� ���� ����� ������� process and explicitly believes that its action are not moral or im- ������ moral. In this experience, ethical agents have the three following � ��� principles (by order of preferences): “It is rightful to do a possi- � ��� ble, moral, not immoral and desirable action”, “It is rightful to do a possible, not immoral and desirable action” and “It is rightful to � ��� ������������ do a possible, moral, not immoral and not undesirable action”. � ��� ��� 5 EXPERIMENTAL RESULTS � � ��� This section details and analyzes the results of a simulation executed with ten zero-intelligence agents per asset, eight zero-ethics agents �� � � � �� �� � ��� ���� ���� � ��� � ��� ��� � and two ethical agents to illustrate the impact of the ethics described ����������������� previously on the behavior of an ethical agent. This quantity of agents was the optimal one to generate enough opportunities in the simula- Figure 4. Evolution of the portfolio of an ethical agent tions with the limited performances of a laptop. You can download this experience on the internet9 . At initialization, each agent receives a portfolio containing a ran- Firstly, we can notice that the number of EDF equities in the port- dom set of assets for a total value of 500e more or less. folio never changes during the simulation. We can easily explain that Figures 3 and 4 show the results of the experiment. Figure 3 shows by the agent’s ethical settings given in Section 4.2: it is never right- all volume and price information made accessible by the market to full to trade this equity because the agent thinks that EDF is a nuclear energy producer and no ethical principle provided to the agent con- 9 https://cointe.users.greyc.fr/download/experience-EDIA2016.zip siders an immoral action as rightful. Secondly, we can also observe many periods where the portfolio [6] N. Cointe, G. Bonnet, and O. Boissier, ‘Ethical judgment of agents’ contains the “Legrand” asset. In fact, trading this asset is the only behaviors in multi-agent systems’, in 15th International Conference on Autonomous agents and multi-agent systems, (2016). action judged as moral due to its label. So to buy and to sell this asset [7] Directorate-General for Economic and Financial Affairs, ‘Impact of the is the only way to satisfy the most preferred principle and obviously, current economic and financial crisis on potential output’, Occasional they are here the most executed actions. Papers 49, European Commission, (June 2009). Finally, we can notice different stages where the agent put in its [8] J.-G. Ganascia, ‘Ethical system formalization using non-monotonic portfolio various equities. These equities are bought or sold due to the logics’, in 29th Annual Conference of the Cognitive Science Society, pp. 1013–1018, (2007). desirability of these trades and the impossibility to execute a moral [9] J.-G. Ganascia, ‘Modelling ethical rules of lying with Answer Set Pro- action. gramming’, Ethics and information technology, 9(1), 39–47, (2007). [10] B. Gert, ‘The definition of morality’, in The Stanford Encyclopedia of Philosophy, ed., Edward N. Zalta, fall edn., (2015). 6 CONCLUSION [11] R. Johnson, ‘Kant’s moral philosophy’, in The Stanford Encyclopedia of Philosophy, ed., Edward N. Zalta, summer edn., (2014). This paper presents an ethical BDI architecture for agents in a multi- [12] A. McIntyre, ‘Doctrine of double effect’, in The Stanford Encyclopedia of Philosophy, ed., Edward N. Zalta, winter edn., (2014). agent system. This architecture is not designed to only implement [13] A.S. Rao and M.P. Georgeff, ‘BDI agents: From theory to practice’, in a given ethics in the decision process, but also to integrate differ- Proceedings of the First International Conference on Multiagent Sys- ent moral rules and values, or ethical principles as parameters of a tems, June 12-14, 1995, San Francisco, California, USA, eds., V.R. generic architecture. Lesser and L. Gasser, pp. 312–319. The MIT Press, (1995). [14] P. Ricoeur, Oneself as another, University of Chicago Press, 1995. The paper also presents an experiment that illustrates, in a partic- [15] S.H. Schwartz, ‘Basic human values: Theory, measurement, and appli- ular use case, how to represent and to use moral values, moral rules cations’, Revue française de sociologie, 47(4), 249–288, (2006). and ethical principles in a BDI agent in order to describe a rightful [16] M. Timmons, Moral theory: an introduction, Rowman & Littlefield behavior. The experiment highlights how a few and simple values, Publishers, 2012. moral rules and ethical principle can influence the behavior of an agent in order to incite it to prefer a set of rightful actions when they are available. Of course, we cannot yet answer some interesting issues such as how to evaluate the cost of this ethical behavior in terms of finan- cial performance with a real state-of-the-art trading strategy, or what is the impact of a given population of ethical agents on a market behavior. To answer those questions, we need to enrich the knowl- edge bases of the ethical agents with some logical models of several famous available principles in the literature (such those modeled in [4, 8, 9]) and complete the definition of moral values and rules. Even if the morals and ethics of the agents are only used in this ex- periment to guide their own decisions, we intend in a future work to use them to evaluate the behavior of the other agents. Indeed, several usecases can need this kind of abilities, for instance when an author- ity wants to monitor the actors on a market, or when an hedge funds expresses the policy to only cooperate with other trading agents that satisfy an ethical behavior. ACKNOWLEDGMENTS The authors acknowledge the support of the French Agence Na- tionale de la Recherche (ANR) under reference ANR-13-CORD- 0006. They also express their gratitude to Professor Jomi Fred Hüb- ner for his theoretical and practical support during the design of this experiment. REFERENCES [1] Ethical judgment. Free Online Psychology Dictionary, August 2015. [2] O.B. Ahmed, ‘Islamic equity funds: The mode of resource mobilization and placement’, Islamic Development Bank, (2001). [3] I. Aldridge, High-frequency trading: a practical guide to algorithmic strategies and trading systems, volume 459, John Wiley and Sons, 2009. [4] F. Berreby, G. Bourgne, and J.-G. Ganascia, ‘Modelling moral rea- soning and ethical responsibility with logic programming’, in Logic for Programming, Artificial Intelligence, and Reasoning, pp. 532–548. Springer, (2015). [5] S. Bono, G. Bresin, F. Pezzolato, S. Ramelli, and F. Benseddik, ‘Green, social and ethical funds in europe’, Technical report, Vigeo, (2013).