<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Judging Amy: Automated Legal Assessment using OWL 2</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Saskia van de Ven</string-name>
          <email>s.vandeven@uva.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rinke Hoekstra</string-name>
          <email>hoekstra@uva.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Joost Breuker</string-name>
          <email>breuker@uva.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lars Wortel</string-name>
          <email>l.l.wortel@uva.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Abdallah El-Ali</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Leibniz Center for Law, University of Amsterdam</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>One of the most salient tasks in law is legal assessment, and concerns the problem of determining whether some case is allowed or disallowed given an appropriate body of legal norms. In this paper we describe a system and Protege 4 plugin, called OWL Judge, that uses standard OWL 2 DL reasoning for legal assessment. Norms are represented in terms of the LKIF Core ontology, as generic situation descriptions in which something (state, action) is deemed obliged, prohibited or permitted. We demonstrate the design patterns for de ning the norms and actual cases. Furthermore we show how a DL classi er can be used to assess individual cases and automatically generate a lex specialis exception structure using OWL Judge. We illustrate our approach with a worked-out example of university library regulations.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        One of the most salient tasks in law is legal assessment, and concerns the problem
of determining whether some case is allowed or disallowed given an appropriate
body of legal norms. For legal experts this process becomes more and more
di cult as the amount of legislation continuously grows and the complexity
of legislative documents increases. Moreover, the structure of legal documents
di ers from those in other domains. Legislation tends to be highly interconnected
{ and interdependent { and normative con icts between di erent regulations
are resolved by meta legal rules, such as lex specialis and lex posterior. The
application of these rules can result in complex exception structures, which can
be di cult to keep track of for the average citizen. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] presented a way to resolve
lex posterior (the more recent norm takes precedence) con icts between concept
de nitions. Conversely, this paper is focused on the resolution of lex specialis
exceptions between norms, the legal principle that states that a more speci c
norm takes precedence over a more general one.
      </p>
      <p>Legal knowledge-based systems allow us to manage the complexity of
legislation and enable online e-government services. Transactions that require the
application of complex legislation, such as tax bene ts or social security
administration, are increasingly processed online. This gives citizens and businesses
more direct access to a personalised and transparent insight in their rights and
duties. Although there already exist several such systems, the wider acceptance
and dissemination of legal knowledge technology is hampered by the lack of an
open platform.</p>
      <p>
        The Legal Knowledge Interchange Format (LKIF), developed within the
ESTRELLA1 project, aims to provide an open platform for legal knowledge
exchange between e-government services [
        <xref ref-type="bibr" rid="ref1 ref10">1,10</xref>
        ]. HARNESS2 is the working title of
a knowledge-based system that is currently being developed within this project.
Its architecture is based on the separation of control knowledge, such as problem
solving methods, from a domain theory [
        <xref ref-type="bibr" rid="ref16 ref3">16,3</xref>
        ]. The general architecture allows
for the implementation of multiple tasks, such as legal planning and
argumentation, though it currently only supports legal assessment. This task is solely
implemented using the OWL 2 DL language.
      </p>
      <p>In the following sections we describe the requirements for legal assessment
and explain our approach. We present OWL Judge which is developed to assist
users in the task of assessing their individual case. All of this will be illustrated
with a worked-out example of university library regulations.
1</p>
    </sec>
    <sec id="sec-2">
      <title>Legal Assessment</title>
      <p>
        Clancey [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] identi ed di erent types of rules involved in the medical domain
theory of the Mycin system: identi cation, causal, world fact and domain fact
rules. Similarly, the domain theory of legal knowledge based systems is not
homogeneous either. [
        <xref ref-type="bibr" rid="ref15 ref17">15,17</xref>
        ] give a general breakdown of the types of knowledge
and their dependencies involved in the legal domain. Valente's Functional
Ontology of Law (FOLaw) describes the legal system as an instrument to in uence
society and reach certain social goals, i.e. it exists to ful l a function. The legal
system can be viewed as a \social device operating within society and on society,
and whose main function is to regulate social behaviour" [15, p. 49].
      </p>
      <p>FOLaw distinguishes seven types of knowledge: commonsense knowledge,
world knowledge, normative knowledge, responsibility knowledge, meta-legal
knowledge, creative knowledge and reactive knowledge. Any legal knowledge
based system will incorporate at least one of these knowledge types.</p>
      <p>
        The most characteristic category of legal knowledge is normative knowledge,
which re ects the regulatory nature of law. It has two functions: prescribing
behaviour, and de ning a standard of comparison for social reality. A norm
expresses an idealisation: what ought to be the case (or to happen) a ccording to
the will of the agent that created the norm [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Meta-legal knowledge governs
relations between norms, and is applied when solving normative con icts [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], and
determining the preference ordering of norms [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Legal principles such as lex
specialis are types of meta-legal knowledge. Because law governs the behaviour
of agents in the world, it must contain some description of this behaviour. This
1 The European project for Standardized Transparent Representations in order to
      </p>
      <p>
        Extend Legal Accessibility, see http://www.estrellaproject.org/.
2 Hybrid Architecture for Reasoning with Norms Exploiting Semantic web Services
world knowledge functions as an epistemological interface between the legal
system and social reality. World knowledge is an abstraction of commonsense [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
This principle lies at the heart of the LKIF Core ontology of basic legal concepts
[10,?].
      </p>
      <p>Legal assessment concerns the problem of determining whether some case
is allowed or disallowed given an appropriate body of legal norms. It involves
the expression of an individual case, an interpretation of that case in terms of
the world knowledge, and the application of normative knowledge to determine
whether the case constitutes a norm violation. More precisely, the following steps
are needed to perform this task:
Case Input Create a description of the case that needs to be assessed. The
facts that are provided should correspond to terms are used in the norms,
i.e. both the norms and the individual case should commit to the same
domain ontology.</p>
      <p>
        Match The individual case is matched against the set of norms.
Resolving con icts Because it is not unlikely that the individual case matches
more than a single norm, the system identi es con icting norms and decides
which norm has priority over the other norms (e.g. according to the principle
of lex specialis).3
Final verdict Provide an outcome of the normative quali cation of the case. It
is desirable to present an explanation, e.g. why a certain norm applies to the
given input, showing which terms in a norm match the individual facts of
the case. Moreover the answer should be justi ed by reference to the norms
and original source. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>In the following sections we outline the representation in OWL 2 DL of the
three types of knowledge necessary for legal assessment. A domain ontology for
terminological knowledge de nes the concepts used as the basic building blocks
for specifying case descriptions and norms. The ontology is a specialisation of
the LKIF Core ontology. The norms are speci ed in a separate OWL le, and
de ne the regulations that govern the situations expressible using the domain
ontology. They are expressed as generic situations in which a state or action is
quali ed as undesirable, permitted or prescribed (see Figure 1). The individual
case description represents the facts that characterise an actual situation and is
expressed in terms of the domain ontology as a set of related OWL individuals.
Furthermore we will provide the corresponding OWL DL design patterns and
show how a description classi er can be used to perform legal assessment of an
individual case.
2</p>
    </sec>
    <sec id="sec-3">
      <title>Norms and Generic Cases</title>
      <p>
        A norm is represented as a deontic quali cation of a generic case [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] (GC), which
is a conjunction of conditions that together form a description of the situation
3 Note that the outcome of this step does not always result in a single match. Several
norms may apply that have a con icting deontic quali er, but are not each other's
exception.
      </p>
      <p>Qualified</p>
      <p>Normatively_Qualified
Disal owed</p>
      <p>Al owed
qualifies</p>
      <p>Mental_Entity
Qualification
qualifies</p>
      <p>Subjective_Entity</p>
      <p>Mental_Object</p>
      <p>Norm
Obliged</p>
      <p>Right</p>
      <p>Permission
al ows</p>
      <p>equivalent
disal ow
al ows</p>
      <p>Obligation
expressed by the norm. A GC is de ned as a set of conditions 1 u ... u n
in conjunctive normal form. Conditions are class axioms composed of classes
and properties de ned by the domain ontology. An individual case C is a set of
grounded propositions fc1; :::; cng, called circumstances, that describe a certain
state of a airs. The match between a GC and an individual case is through
realisation. For instance, a generic case GC1 that is used in the de nition of the
norm \Students are not allowed to rent books":</p>
      <p>GC1</p>
      <sec id="sec-3-1">
        <title>Student u 9checks out Library Book</title>
        <p>is trivially satis ed by the individual case:</p>
        <p>fAmy : Student; history book : Library Book; Amy checks out history bookg
Obviously, a more speci c case GC2 will be subsumed by GC1. However the
above example already shows that just representing a norm by a generic case is
not enough. From the generic case itself, it does not become clear whether the
expressed situation is allowed or not. Therefore we need the following deontic
notions that enable us to normatively qualify a generic case: permission,
obligation and prohibition. These notions are part of the LKIF Core ontology which
is described in a bit more detail at the end of this section.</p>
        <p>As the goal of our system is normative assessment, we would like to detect
violations of the default situation. Norms apply only to cases that di er from
this default situation. The majority of legislative documents by default allow a
situation, unless some norm(s) state(s) otherwise. In some regulations, the
default situation is disallowed. This is for instance the case in permit systems. The
default situation should therefore be included as a generic case in any
normative representation. All other generic cases speci ed by norms are subsumed by
this default generic case. This allows us to make explicit any exceptions to the
default by more speci c norms.</p>
        <p>The way in which deontic operators interact can be rather complex. We
therefore introduce design patterns to facilitate the speci cation of norms. The
following paragraphs describe the behaviour of norms compared to the default,
and provide the design patterns (see also Table 1).</p>
        <p>Default situation: allowed In the \most common" case, everything is by default
allowed. A match of an individual case with the GC of a permission does not
have any normative consequences for example. Similarly, when the individual
case does not match a prohibition, no normative consequences follow. On the
other hand, a match with the GC of a prohibition, constitutes an exception to
the default. These types of exceptions should be detected and given precedence
over the default situation. However, this simplistic matching process becomes
more complex in the case of no match with the GC of an obligation.</p>
        <p>We take a ctive example from the library domain again: \Students are
obliged to show their library card in order to rent a book. If in this example,
someone does want to rent books (a match with the context), but does not show
his library card (which is the speci c obliged part), the obligation is violated.
However there would be no match with the generic case which expresses this
(only a partial match), we would have failed to detect a violation of the default.
To be able detect these violations, the GC is partitioned into that part which
is explicitly allowed (A ) and that part which is explicitly disallowed (D ) by
the obligation. Moreover a norm is typically only addressed towards a certain
element of the GC, given some context. We therefore distinguish between the
context of a norm and that part of the GC which the norm is directed towards.
The pattern we follow in the representation of obligations is therefore as follows:
O
%
&amp;</p>
        <p>A
D
Where the context is de ned as 1: 1 u ... u n (a student rents a book), and
the obliged part of the GC is 2: n+1 (showing the library card). Renting a
book is disallowed, but renting a book and showing a library card is allowed,
which is the desired behaviour.</p>
        <p>Default situation: disallowed Of course, where the default situation is disallowed,
the normative quali cations di er signi cantly. For instance, if a norm expresses
a permission, and there is no match with an individual case, we are still in line
with the default situation. However, a match constitutes a direct exception to
the default. Similarly, for obligations and prohibitions the exceptions change:
a compliance with the allowed part of an obligation is an exception, where a
compliance with the disallowed part of a prohibition is not. Therefore, if there is
no match in case of a prohibition: we might have failed to detect a violation of the
default. A prohibition expresses a disallowed situation (D ), but also implicitly
represents an allowed (A ) situation (the complement of the disallowed case is
an allowed situation). In case of the example \Students that are in the library,
are prohibited to make noise" it is allowed to be in the library, but it is disallowed
to be in the library and make noise. The design pattern is as follows:
F
%
&amp;</p>
        <p>D
A
Where the context is de ned as 1: 1 u ... u n (being in the library), and the
prohibited part of the GC is 2: n+1 (making noise).</p>
        <p>The LKIF Core ontology de nes the class Norm and its subclasses Permission,</p>
        <sec id="sec-3-1-1">
          <title>Obligation and Prohibition as follows [10,2]:</title>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>Norm v Quali cation u 9quali es Normatively Quali ed</title>
      </sec>
      <sec id="sec-3-3">
        <title>Permission v Norm</title>
      </sec>
      <sec id="sec-3-4">
        <title>9allows Allowed u 8allows Allowed</title>
      </sec>
      <sec id="sec-3-5">
        <title>Obligation v Permission</title>
        <sec id="sec-3-5-1">
          <title>Prohibition</title>
        </sec>
      </sec>
      <sec id="sec-3-6">
        <title>9allows Obliged u 9disallows Disallowed</title>
        <p>u 8allows Allowed u 9disallows Disallowed</p>
        <sec id="sec-3-6-1">
          <title>Obligation</title>
          <p>The Prohibition and Obligation are equivalent because they are simply two
di erent ways to put the same thing into words: a prohibition to smoke is an
obligation not to smoke. The Permission is di erent in that it allows something,
but does not prohibit anything. For the purpose of clarity we will refer to the
subclasses of Normatively Quali ed as generic cases. The properties allows and
disallows are disjoint subproperties of quali es; a norm cannot simultaneously
allow and disallow the same situation. Although a GC describes an entire
situation, it can be represented as a single class description because the entities in a
single situation should be connected. On the other hand, this means the norm's
quali cation is biased to the class that forms the entry point for describing the
GC.
3</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>The University Library Regulations</title>
      <p>Now that we have explained our approach we will illustrate it by means of
a worked-out example of a toy domain: university library regulations. We list
relevant regulations and introduce a use case. We then show how the regulations
are represented, and introduce OWL Judge.</p>
      <p>Consider the following university library regulations:
1a) Students registered at this university are allowed to check out a book from
this library
1b) Students registered at other universities are allowed to check out a book
from this library provided that they are enrolled in at least one course given
at this university.
1c) Students who have checked out more than ve books are not allowed to check
out another book.</p>
      <p>One of our students is Amy. She is registered at the University of Amsterdam
and has an inquisitive mind: she has checked out 6 books on some general topic:
fAmy : Registered Student; general book 1 : Library Book;
general book 2 : Library Book; general book 3 : Library Book;
general book 4 : Library Book; general book 5 : Library Book;
general book 6 : Library Book; Amy checks out general book 1;
Amy checks out general book 2; Amy checks out general book 3
Amy checks out general book 4; Amy checks out general book 5;</p>
      <p>Amy checks out general book 6g
According to the regulations, Amy's situation is allowed by article 1a, but
disallowed by article 1c. However, these two articles contain an intuitive hierarchic
pattern: the case described by article 1a subsumes that of article 1c. In fact,
article 1c is an exception to 1a, because 1a implicitly expresses that students
registered at other universities are not allowed to check out any books. The
expected verdict of the system should therefore be that Amy's situation is
disallowed, as article 1c is more speci c than article 1a, the lex specialis principle
states that 1c trumps 1a.</p>
      <p>Although the two relevant articles are article 1a and 1c, we rst need to
specify the default situation. In the library regulations the default situation is
disallowed; students are generally not allowed to check out books, unless stated
di erently in the norms. The default norm and generic case apply to all situations
where a book is checked out:</p>
      <sec id="sec-4-1">
        <title>Default GC v Generic Case u 9disallowed by fdefaultnormg</title>
      </sec>
      <sec id="sec-4-2">
        <title>Default Norm v Prohibition u 8disallows Default GC</title>
      </sec>
      <sec id="sec-4-3">
        <title>9checks out Library Book</title>
        <p>fdefaultnormg</p>
        <p>Article 1a states that students registered at this university are allowed to
check out a book from this library:</p>
      </sec>
      <sec id="sec-4-4">
        <title>Art1a GC v Generic Case u 9allowed by fart1ag</title>
      </sec>
      <sec id="sec-4-5">
        <title>Registered Student u 9checks out Library Book</title>
      </sec>
      <sec id="sec-4-6">
        <title>Art1a Permission v Permission u 8allows Art1a GC</title>
        <p>fart1ag</p>
        <p>Article 1c states that students who have checked out more than ve books
are not allowed to check out another book:</p>
      </sec>
      <sec id="sec-4-7">
        <title>Art1c GC F v Generic Case u 9disallowed by fart1cg</title>
      </sec>
      <sec id="sec-4-8">
        <title>Student u</title>
        <sec id="sec-4-8-1">
          <title>6 checks out Library Book</title>
        </sec>
      </sec>
      <sec id="sec-4-9">
        <title>Art1c GC P v Generic Case u 9allowed by fart1cg</title>
        <p>u</p>
      </sec>
      <sec id="sec-4-10">
        <title>Student u 9checks out Library Book</title>
        <sec id="sec-4-10-1">
          <title>5 checks out Library Book</title>
        </sec>
      </sec>
      <sec id="sec-4-11">
        <title>Art1c Prohibition v Prohibition u 8disallows Art1c GC F u 8allows Art1c GC P</title>
        <p>fart1cg</p>
        <p>Article 1c expresses a prohibition where the default situation is disallowed.
The GC is therefore partitioned into a part that is disallowed (the prohibition)
and the thing that is allowed (the context). In this case it is permitted to check
out books, checking out more than 5 books is prohibited. By using a cardinality
restriction, checking out less than or exactly 5 books is allowed by this rule.
3.1</p>
        <p>Exception structure
As mentioned in the preceding paragraphs, multiple interacting norms can create
complex exception structures. As our norms are represented as OWL classes, a
DL classi er can generate the subsumption hierarchy of generic cases. This
hierarchy actually re ects the lex specialis exception relations between norms.
Moreover we can apply the following role inclusion axioms to make these exception</p>
        <p>Because norms are nominals that consist of a single individual, these
exception relations can be derived automatically, using Pellet for all norms. Take for
example the Art1c Prohibition which disallows Art1a GC. The individual art1c,
which represents the prohibition from article 1c, disallows our individual amy,
since her situation matches with Art1c GC. However, amy is also classi ed as
Art1a GC, and therefore amy is also allowed by art1a. In this way we can derive
the exception relation between art1c and art1a:</p>
        <p>fart1c exception art1ag</p>
        <p>This inferred exception hierarchy is used by OWL Judge to resolve possible
con icts, and helps to present a nal verdict to the user.
3.2</p>
        <p>OWL Judge
OWL Judge assists users in the task of legal assessment. It prompts the user to
select an OWL le containing the norms, and a le containing a case description.
Once the \check" button is pressed, Pellet is called to perform classi cation and
realisation on the given les (see Figure 2).</p>
        <p>
          First OWL Judge checks all individuals that exist in the le containing the
case description. Depending on their classi cation as Allowed or Disallowed, they
are displayed in respectively the \Allowed" and/or \Disallowed" column, shown
in the top left part of the screen. A user can click on the individuals in those
columns and retrieve an explanation of the classi cation. For the explanation,
OWL Judge uses the standard explanation facilities of Pellet [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
        </p>
        <p>OWL Judge also generates a nal verdict, which is especially interesting in
situations where multiple norms apply to the individual case (if only one norm
applies it is clearly the nal verdict as well). If an individual is both Allowed and
Disallowed, OWL Judge tries to resolve this con ict by checking whether one of
the norms allowing or disallowing it contains an exception relationship with the
other norm: a norm trumps another norm, if the generic case of the rst norm
is more speci c. This means some additional querying of the TBox and ABox is
done by the plugin.</p>
        <p>The most speci c one will be displayed in the appropriate \Verdict" column,
shown in the top right of the screen. The user can again select the individual
to view an explanation of OWL Judge's verdict. The screen shows that the
individual amy is disallowed by defaultnorm and art1c, but allowed by art1a.
The explanation indicates that article 1c is the most speci c norm, which makes
the nal verdict \prohibited".
4</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusions and future work</title>
      <p>
        Currently, the individual case description has to be entered using a generic OWL
editor, such as Protege4 or Topbraid Composer5. This of course asks for quite
some experience in working with these kind of tools. Moreover a person that
creates the case description should have knowledge of what is present in the
ontology and in the norms, as the terms in the case description should correspond
to either the terms used in the ontology or in the norms. It would be very
bene cial to provide a more friendly user interface. Such an interface should
for example guide a user in what terms to use and try to complete the case
description as much as possible. Some work, cf. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], suggests that the language
used in regulations is highly structured, which suggests a possibility to support
a structured language interface along the lines of [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        OWL Judge as it exists now implements our basic requirements, but there are
still some things we would like to address. For instance, it might be interesting
to enhance the explanation by allowing users to click on a certain individual
case to get more information about it. Moreover OWL Judge is not yet capable
of determining whether an individual case is Obliged, which is also something
that needs to be dealt with. Furthermore, we would like to further enhance the
explanations with forms of justi cation, such as a reference to the original source
of law. Preferably the original source of law is stored in the MetaLex/CEN format
4 http://protege.stanford.edu
5 http://www.topbraidcomposer.com
of [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], an open XML interchange format for legal and legislative resources6. This
enables a direct connection between the original legal source to (speci c parts of)
our model. This would also form a nice way to interact with the MetaVex editor,
a WYSIWYG editor used to create and edit documents in the MetaLex/CEN
format [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>The major advantage of using only OWL 2 DL to represent both conceptual
and normative knowledge is that we can use an existing reasoner, Pellet, to
perform all reasoning. There is no need to concern ourselves with an interaction
between di erent formalisms. The question is whether OWL 2 DL is expressive
enough to suit our needs. In some cases we would like to talk about things at
the level of individuals, instead of at the level of concepts. For example, if we
want to represent \a student that checks out a book belonging to a course he
is enrolled in", this is currently impossible to express in DL because of the tree
model property7.</p>
      <p>
        Rule formalisms can easily represent this example just by using variables each
time we want to point to a certain student or course. Alternative approaches,
such as structured objects ([
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]) are very promising as well, but are currently not
supported by mainstream reasoners. However, the necessary e ect can sometimes
be achieved by approximation [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Also, others are working to achieve higher
expressiveness by using SWRL conditions [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Thus far we have found solutions
that work for limited cases but cannot be applied in general. Nonetheless, the
approach explained in this paper might be su cient for some domains, and we
intend to thoroughly test and evaluate our approach on existing regulations.
6 http://www.metalex.eu/
7 See [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] for an in-depth discussion on the problem of identity of individuals.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Boer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Thomas F.</given-names>
            <surname>Gordon</surname>
          </string-name>
          , Kasper van den Berg, Marcello Di Bello, Andras Forhecz, and Reka Vas.
          <article-title>Speci cation of the legal knowledge interchange format</article-title>
          .
          <source>Deliverable 1</source>
          .1,
          <string-name>
            <surname>Estrella</surname>
          </string-name>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Alexander</surname>
            <given-names>Boer</given-names>
          </string-name>
          , Tom van Engers,
          <string-name>
            <given-names>and Radboud</given-names>
            <surname>Winkels</surname>
          </string-name>
          .
          <article-title>Mixing legal and nonlegal norms</article-title>
          . In
          <string-name>
            <surname>M-F. Moens</surname>
          </string-name>
          and P. Spyns, editors,
          <source>Jurix</source>
          <year>2005</year>
          :
          <article-title>The Eighteenth Annual Conference</article-title>
          .,
          <source>Legal Knowledge and Information Systems</source>
          , pages
          <fpage>25</fpage>
          {
          <fpage>36</fpage>
          , Amsterdam,
          <year>2005</year>
          . IOS Press.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Joost</given-names>
            <surname>Breuker</surname>
          </string-name>
          .
          <article-title>Components of problem solving</article-title>
          . In Luc Steels, Guus Schreiber, and Walter van de Velde, editors,
          <source>A Future for Knowledge Acquisition: proceedings of the EKAW-94, European Knowledge Acquisition Workshop</source>
          , pages
          <volume>118</volume>
          {
          <fpage>136</fpage>
          , Berlin,
          <year>1994</year>
          . Springer Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>William</surname>
            <given-names>J. Clancey.</given-names>
          </string-name>
          <article-title>The epistemology of a rule-based expert system - a framework for explanation</article-title>
          .
          <source>Arti cial Intelligence</source>
          ,
          <volume>20</volume>
          (
          <issue>3</issue>
          ):
          <volume>215</volume>
          {
          <fpage>251</fpage>
          ,
          <year>1983</year>
          . First published as
          <source>Stanford Technical Report</source>
          ,
          <year>November 1981</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5. E. de Maat,
          <string-name>
            <given-names>R.</given-names>
            <surname>Winkels</surname>
          </string-name>
          , and T. van Engers.
          <article-title>Making Sense of Legal Texts</article-title>
          . In G. Grewendorf and M. Rathert, editors,
          <source>Formal Linguistics and Law</source>
          ,
          <article-title>Trends in Linguistics - Studies and Monographs (TiLSM)</article-title>
          . Mouton, De Gruyter, Berlin, (in press)
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Abdullatif</surname>
            <given-names>A.O.</given-names>
          </string-name>
          <string-name>
            <surname>Elhag</surname>
          </string-name>
          , Joost A.
          <string-name>
            <surname>Breuker</surname>
          </string-name>
          , and
          <string-name>
            <surname>Bob</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Brouwer</surname>
          </string-name>
          .
          <article-title>On the formal analysis of normative con icts</article-title>
          . In H.Jaap van den Herik et al., editor,
          <source>JURIX 1999: The Twelfth Annual Conference, Frontiers in Arti cial Intelligence and Applications</source>
          , pages
          <volume>35</volume>
          {
          <fpage>46</fpage>
          ,
          <string-name>
            <surname>Nijmegen</surname>
          </string-name>
          ,
          <year>1999</year>
          . GNI.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A.</given-names>
            <surname>Forhecz</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Strausz</surname>
          </string-name>
          .
          <article-title>First-order owl conjunctions</article-title>
          .
          <source>In Proceedings of OWLED 2008 EU</source>
          ,
          <year>2008</year>
          . Under Review.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Christian</given-names>
            <surname>Halaschek-Wiener</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Yarden</given-names>
            <surname>Katz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Bijan</given-names>
            <surname>Parsia</surname>
          </string-name>
          .
          <article-title>Belief base revision for expressive description logics</article-title>
          .
          <source>In OWL: Experiences and Directions</source>
          <year>2006</year>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Rinke</given-names>
            <surname>Hoekstra</surname>
          </string-name>
          and
          <string-name>
            <given-names>Joost</given-names>
            <surname>Breuker</surname>
          </string-name>
          .
          <article-title>Polishing diamonds in OWL 2</article-title>
          . In Aldo Gangemi and Jero^me Euzenat, editors,
          <source>Proceedings of the 16th International Conference on Knowledge Engineering and Knowledge Management (EKAW</source>
          <year>2008</year>
          ), LNAI/LNCS. Springer Verlag,
          <year>October 2008</year>
          . To be published.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Rinke</surname>
            <given-names>Hoekstra</given-names>
          </string-name>
          , Joost Breuker, Marcello Di Bello, and
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Boer</surname>
          </string-name>
          .
          <article-title>The LKIF Core ontology of basic legal concepts</article-title>
          .
          <source>In Pompeu Casanovas</source>
          , Maria Angela Biasiotti, Enrico Francesconi, and Maria Teresa Sagri, editors,
          <source>Proceedings of the Workshop on Legal Ontologies and Arti cial Intelligence Techniques (LOAIT</source>
          <year>2007</year>
          ),
          <year>June 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>Hans</given-names>
            <surname>Kelsen</surname>
          </string-name>
          .
          <source>General Theory of Norms</source>
          . Clarendon Press, Oxford,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Szymon</surname>
            <given-names>Klarman</given-names>
          </string-name>
          , Rinke Hoekstra, and
          <string-name>
            <given-names>Marc</given-names>
            <surname>Bron</surname>
          </string-name>
          .
          <article-title>Versions and applicability of concept de nitions in legal ontologies</article-title>
          . In Kendall Clark and Peter F. PatelSchneider, editors,
          <source>Proceedings of OWL: Experiences and Directions (OWLED 2008 DC)</source>
          , Washington, DC (metro),
          <year>April 2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Boris</surname>
            <given-names>Motik</given-names>
          </string-name>
          , Bernardo Cuenca Grau, and
          <string-name>
            <given-names>Ulrike</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Structured objects in OWL: Representation and reasoning</article-title>
          .
          <source>Technical report</source>
          , University of Oxford, UK,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Rolf</surname>
            <given-names>Schwitter</given-names>
          </string-name>
          , Kaarel Kaljurand, Anne Cregan, Catherine Dolbear, and
          <string-name>
            <given-names>Glen</given-names>
            <surname>Hart</surname>
          </string-name>
          .
          <article-title>A comparison of three controlled natural languages for owl 1.1</article-title>
          . In Kendall G. Clark and
          <string-name>
            <surname>Peter F.</surname>
          </string-name>
          Patel-Schneider, editors,
          <source>Proceedings of OWL: Experiences and Directions (OWLED 2008 DC)</source>
          , Washington, DC (metro),
          <year>April 2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>A.</given-names>
            <surname>Valente</surname>
          </string-name>
          .
          <article-title>Legal Knowledge Engineering: A Modelling Approach</article-title>
          .
          <source>PhD thesis</source>
          , University of Amsterdam, Amsterdam,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>A.</given-names>
            <surname>Valente</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Breuker</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.W.</given-names>
            <surname>Brouwer</surname>
          </string-name>
          .
          <article-title>Legal modelling and automated reasoning with ON-LINE</article-title>
          .
          <source>International Journal of Human Computer Studies</source>
          ,
          <volume>51</volume>
          :
          <fpage>1079</fpage>
          {
          <fpage>1126</fpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>Andre</given-names>
            <surname>Valente</surname>
          </string-name>
          and
          <string-name>
            <given-names>Joost</given-names>
            <surname>Breuker</surname>
          </string-name>
          .
          <article-title>ON-LINE: An architecture for modelling legal information</article-title>
          .
          <source>In International Conference on Arti cial Intelligence and Law (ICAIL-1995)</source>
          , pages
          <fpage>307</fpage>
          {
          <fpage>315</fpage>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18. Saskia van de Ven, Rinke Hoekstra, Radboud Winkels, Emile de Maat, and Adam Kollar.
          <article-title>MetaVex: Regulation drafting meets the semantic web</article-title>
          .
          <source>In Giovanni Sartor and Pompeu Casanovas</source>
          , editors,
          <source>Computable Models of the Law. Languages</source>
          , Dialogues, Games, Ontologies., volume
          <volume>4884</volume>
          <source>of Lecture Notes in Arti cial Intelligence</source>
          , pages
          <fpage>42</fpage>
          {
          <fpage>55</fpage>
          . Springer Verlag,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>R.</given-names>
            <surname>Winkels</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Boer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Hoekstra</surname>
          </string-name>
          . MET Alex:
          <article-title>An XML Standard for Legal Documents</article-title>
          .
          <source>In Proceedings of the XML Europe Conference, London (UK)</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>