<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Controlled and Uncontrolled English for Ontology Editing</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Brian Donohue CUBRC Buffalo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Douglas Kutach CUBRC Buffalo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Robert Ganger CUBRC Buffalo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ron Rudnicki CUBRC Buffalo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tien Pham Army Research Lab Adelphi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Amardeep Bhattal IBM Southampton</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dave Braines IBM Portsmouth</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Controlled</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>English</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Intelligence</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Barry Smith University at Buffalo Buffalo</institution>
          ,
          <addr-line>NY</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Geeth de Mel IBM White Plains</institution>
          ,
          <addr-line>NY</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <fpage>4</fpage>
      <lpage>11</lpage>
      <abstract>
        <p>-Ontologies formally represent reality in a way that limits ambiguity and facilitates automated reasoning and data fusion, but is often daunting to the non-technical user. Thus, many researchers have endeavored to hide the formal syntax and semantics of ontologies behind the constructs of Controlled Natural Languages (CNLs), which retain the formal properties of ontologies while simultaneously presenting that information in a comprehensible natural language format. In this paper, we build upon previous work in this field by evaluating prospects of implementing International Technology Alliance Controlled English (ITACE) as a middleware for ontology editing. We also discuss at length a prototype of a natural language conversational interface application designed to facilitate ontology editing via the formulation of CNL constructs.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology</kwd>
        <kwd>Collection</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>INTRODUCTION
Ontologies formally represent reality in a way that limits
ambiguity and facilitates automated reasoning and data
fusion. Many technologies are available for building,
sharing, and using ontologies, including Web Ontology
Language (OWL) and controlled natural languages (CNLs).
On the one hand, OWL provides effective representation
constructs and enables efficient reasoning procedures but is
daunting to the non-technical user. On the other hand,
CNLs, which are restricted versions of natural languages,
provide a human-friendly representation format that is easier
for non-technical users but there is no established standard
for how statements of CNLs should map onto assertions
defining an ontology.</p>
      <p>
        Motivated by the accessibility of CNL, we explored how to
create software infrastructure that would enable users to
interact with an OWL knowledge base through CNL
constructs. We see the value of such an infrastructure for the
intelligence, defense and security communities as being
realized in the use of ontology-driven information collection
applications. Such applications typically have one of two
opposing shortcomings. First, users can be prevented from
entering information about an entity if that type of entity is
not represented in the underlying ontology, but this can be
perceived by users as unfriendly. Second, applications can
let users enter such information, but this allows the ontology
to be modified in ways that do not follow best practices.
In this report, we specifically examine the interplay
between OWL 2 DL [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and the International Technology
Alliance’s Controlled English, ITA-CE [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]-[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] to determine
the feasibility of using ITA-CE as a medium through which
ontologies can be correctly modified by non-technical users.
      </p>
      <p>There are two main conclusions we have drawn from this
investigation. First, a conversational interface application
can assist users in ontology editing tasks. We developed a
prototype software application that can be used either as a
command-line application or as part of the conversational
panel found in IBM’s ITA-CE processing environment
called ‘CE Store’. Our application allows people to converse
with a computer in everyday English so that the user’s
intentions regarding ontology can be rendered into a CNL
equivalent. The CNL command can then be passed on to
additional machine agents, which modify the ontology and
store the result in an OWL file. The application can easily
be extended to ingest other data formats such as relational
databases and ontology formats other than OWL. At the
same time, we discovered that such software does not
strictly require the use of CE statements in general or of
ITA-CE statements in particular. However, within the
current implementation of the conversational interface
application, ITA-CE is presented to human users as
unambiguous confirmation prompts to ensure that the user’s
natural language commands were interpreted correctly.</p>
      <p>The second conclusion was that ITA-CE might serve as a
convenient communication medium for analysts and
developers handling information sources in a variety of
formats, and by enabling machine agents to exploit
additional information sources when attempting to interpret
requests made by users.</p>
      <p>The rest of the document is structured as follows. Section
II discusses existing approaches to utilizing CNL-based
approaches to modifying ontologies. Section III provides an
overview of ITA-CE. In Section IV, we provide a detailed
discussion of our implementation to support conversational
OWL ontology editing. In Section V, we introduce a few
illustrative scenarios to show the applicability of our work.
We conclude in Section VI by sketching future directions of
our work.</p>
      <p>II.</p>
      <p>CONTROLLED NATURAL LANGUAGE ONTOLOGY</p>
      <p>
        EDITORS
The formal underpinnings of semantic technologies are
substantial obstacles for a casual end-user. This usability
problem has been widely noted already within the Semantic
Web. For example, Rector [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] documented numerous errors
commonly made by non-expert ontology users. These
include (1) the failure to make all information explicit, (2)
ignorance of the effects of range and domain restrictions, (3)
mixing up defined and primitive classes, (4)
misunderstanding common logical constructs (‘and’, ‘or’,
‘some not’, ‘not some’), (5) presuming that classes are
disjoint by default, and (6) being insensitive to open world
reasoning. Thus, non-expert ontology users face an immense
hurdle developing and utilizing ontology-based information
sources.
      </p>
      <p>
        In response to the usability problem, previous research
[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ][
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] has sought to hide the formal syntax and semantics of
ontologies behind CNL constructs. Several projects in
particular have sought to exploit existing CNLs, or develop
new CNLs, in order to simplify the tasks of creating,
managing, and navigating ontologies.1 Several software
applications now allow users to edit ontologies by writing
English sentences that are restricted in admissible
vocabulary and grammatical constructions, yet relatively
easily comprehended. This sets them apart from traditional
tree-structured and graph-structured ontology editors such as
Protégé and TopBraid Composer™.
      </p>
      <p>
        To a great extent, these CNL ontology editors have helped
to bridge the gap between casual users and ontological
formalisms. However, their success is limited by at least one
of four recalcitrant problems. First, most of the editors are
not fully compliant with OWL 2 DL, the most widely used
member of the OWL family of languages. ACE View does
not currently support sentences that express data properties
and their corresponding datatypes (e.g., having a date-time
value associated with an event). GINO Editor and CLOnE
Editor restrict users to only very basic OWL constructs (e.g.,
there appears to be no support for inserting class axioms or
cardinality restrictions). The ROO Editor employs a more
expressive language than ACE View, GINO Editor, and
CLOnE Editor, but it shies away from OWL 2 DL
expressivity for simplicity [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Only the Fluent Editor™
1 There has been little comparative study of the vast array of CNLs actively
in use. Kuhn (2014) surveys 100 recent CNLs, and Schwitter (et al.,
2008) offers a detailed comparison of three of the more prominent CNLs in
use today: Attempto Controlled English (ACE), Ordnance Survey Rabbit,
and Sydney OWL Syntax (SOS).
2014 connects users with OWL2 DL’s full expressive
potential.
      </p>
      <p>
        Second, some of the editors employ insufficient resources
for explaining and correcting user input error. CLOnE
Editor users, for example, complained of receiving little
guidance for inputting CNL expressions and no feedback to
explain syntactical errors [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Similarly, users of ROO
Editor complained of receiving no feedback on semantic
errors [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>Third, the documented experiments conducted with CNL
ontology editors suggest that all but the simplest editing
tasks lie beyond the ordinary capabilities of the CNL
ontology editor user. Of the editors surveyed above, GINO,
CLOnE, and ROO ran experiments with non-expert
ontology users. In each case, however, users were successful
only in performing basic tasks (e.g., most users could create
a class, property, or instance), and for the most part
unsuccessful in executing any more sophisticated task (e.g.,
correctly adding an axiom). If the usability problem is to be
solved altogether, then end-users will need an interface that
relieves much of the burden of expressing the wide array of
OWL constructs.</p>
      <p>
        Fourth, all of the editors require end-users to master the
stringent lexical and syntactic rules governing the
implemented CNL. For instance, users must be sensitive to
quantifiers (‘every’, ‘some’), disallowed terms (‘or’, ‘not’),
and peculiar lexical conventions (e.g., in ACE, dashes
between multiple elements of a term, e.g., ‘stretch-of-river’).
Although the GINO and Fluent editors assist users in
entering CNL through predictive mechanisms, and although
CLOnE and ROO employ less stringent lexical and syntactic
restrictions, the fact remains that users are expected to write
impeccable CNL sentences. Thus, even if CNL-based
editors are more human friendly than traditional
treestructured or graph-structured ontology editors, they
nevertheless run the risk of alienating the non-expert user, as
put forward by Smart [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        Related projects include formulations of alternative OWL
syntaxes, aimed at simplifying OWL for non-expert users,
and resulting in an ontology language that resembles, in
many of its properties, a CNL. In particular, we note
Manchester OWL Syntax [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], which is recognized by
W3C, and Sydney OWL Syntax [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>The software discussed in this paper aims to overcome the
usability problem in a different way. If it were fully
developed, it would minimize people’s direct interaction
with CNLs and eliminate altogether the requirement for
them to write syntactically correct sentences of a CNL.
Instead, a non-technical user could engage in ontology
creation, editing, and management entirely by means of a
natural language human-machine conversation. At most a
user would need to read a sentence of CNL in order to
confirm that the conversational agent has correctly
interpreted the natural language input. Behind the scenes,
the conversational agent would translate the user’s
commands into a CNL, which would then be passed along
to other agents that have access to particular knowledge
representation documents, e.g., an OWL/XML file. In our
current preliminary implementation of this idea, all of the
interaction can take place within the CNL processing
environment designed by the International Technology</p>
    </sec>
    <sec id="sec-2">
      <title>Alliance (ITA) and within the context of previous ITA research on CNL-based tools and their military applications. III.</title>
    </sec>
    <sec id="sec-3">
      <title>OVERVIEW OF ITA CONTROLLED ENGLISH</title>
    </sec>
    <sec id="sec-4">
      <title>In 2010, the International Technology Alliance (ITA) began</title>
      <p>developing a CNL known as ITA Controlled English
(ITA</p>
    </sec>
    <sec id="sec-5">
      <title>CE) for the purpose of supporting tasks within the Data-to</title>
      <p>
        Decisions (D2D) framework, “specifically to assist coalition
decision makers in distributed information environments
through automated or semi-automated fusion processes” [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>Previous ITA-CE research has addressed the problem of the</title>
      <p>miscommunication between US and UK military personnel
rooted in lexical and cultural discrepancies and the problem
of enhancing shared understanding and communication for
military decision-making, especially through the
exploitation of sensor resources. An example of this is</p>
    </sec>
    <sec id="sec-7">
      <title>MOIRA (Mobile Intelligence Reporting App), which aims to expedite data requisition within ISR missions.</title>
    </sec>
    <sec id="sec-8">
      <title>At base, the syntax and semantics of ITA-CE are adopted</title>
      <p>
        from Sowa’s Common Logic Controlled English [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]-[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ],
which in turn aligns itself closely to first-order logic. As
with most CNLs, the resultant expressions of the language
are readily comprehensible to ordinary English speakers.
      </p>
    </sec>
    <sec id="sec-9">
      <title>For example:</title>
      <p>there is a person named Steve.
the person Steve is married to the person Jane.
the person Steve has the person Jane as spouse.</p>
    </sec>
    <sec id="sec-10">
      <title>By writing ITA-CE sentences, users can gradually construct</title>
      <p>a model, in which all pertinent entities within that model –
including types, properties, relations, and individuals – are
specified. Thus, to construct a model, a user would write
sentences defining the objects, properties, and relationships
within that domain.</p>
      <p>New terms are introduced to the model by means of
“conceptualise” statements. For example:
conceptualise a ~ Chihuahua ~ C that is a dog.
conceptualise the Chihuahua C ~ barks at ~ the
person P1.
conceptualise the Chihuahua C has the person P2 as
~ owner ~.</p>
    </sec>
    <sec id="sec-11">
      <title>The term being added or modified is set off by tildes (~), and if the new term is a noun, it is followed by an uppercase variable name.</title>
    </sec>
    <sec id="sec-12">
      <title>Additionally, users can write rules of inference to the model</title>
      <p>in the form of “if-then” statements. For example:
if</p>
      <p>( the person P1 is married to the person P2 )
then
( the person P2 is married to the person P1 ) .
This rule states that the “is married to” relation is
symmetric. If a user includes this rule in a model and also
includes the sentence “the person Steve is married to the
person Jane,” then software can easily and correctly infer
“the person Jane is married to the person Steve.”</p>
    </sec>
    <sec id="sec-13">
      <title>Models can be defined and extended using the ITA-CE</title>
      <p>
        processing environment, called ‘CE Store’ [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].2 ITA-CE’s
      </p>
    </sec>
    <sec id="sec-14">
      <title>CE Store software allows users to define and execute</title>
      <p>custom “CE agents,” including conversational agents with
which users can converse in ordinary English. Below, we
present a pair of CE agents, one of which assists the user in
formalizing natural language expressions and the other of
which retrieves and emends information within OWL files.</p>
      <p>IV.</p>
    </sec>
    <sec id="sec-15">
      <title>CONVERSATIONAL INTERFACE APPLICATION</title>
    </sec>
    <sec id="sec-16">
      <title>The conversational interface application that we coded</title>
      <p>cooperates with the CE Store software, which takes the form
of a web application that accepts ITA-CE sentences as input
and responds by remembering the ITA-CE sentence and
possibly triggering other behavior based on the content of
the ITA-CE sentence. Our software is an add-on to the CE</p>
    </sec>
    <sec id="sec-17">
      <title>Store in the sense that it is a WAR file that can be placed in the same folder as the CE Store's WAR files and is configured by storing a few CE statements in the CE Store.</title>
    </sec>
    <sec id="sec-18">
      <title>Given the suitability of the CE Store for incorporating</title>
      <p>ontology information, one possible strategy for editing
ontologies by means of ITA-CE is first to translate the</p>
    </sec>
    <sec id="sec-19">
      <title>English into ITA-CE and then ITA-CE into OWL. In practice, however, such a strategy faces some obstacles.</title>
    </sec>
    <sec id="sec-20">
      <title>To see why, first observe that in order for the software to</title>
      <p>guide the user in editing an ontology, it must somehow
access all the relevant information about the ontology.</p>
    </sec>
    <sec id="sec-21">
      <title>Because the CE Store software stores its data in the form of</title>
    </sec>
    <sec id="sec-22">
      <title>ITA-CE statements, the ontology would first need to be</title>
      <p>loaded into CE Store. This would incur some data
redundancy and would require the addition of some rules to
draw inferences not explicitly asserted by the ontology.</p>
    </sec>
    <sec id="sec-23">
      <title>Neither of these is a sizable obstacle. However, if we were</title>
      <p>to adopt this strategy, and then a user made changes to the
ontology, then the previous statements might become false.</p>
    </sec>
    <sec id="sec-24">
      <title>For example, an ontology might define a hierarchy in which</title>
    </sec>
    <sec id="sec-25">
      <title>Z is a direct subtype of X. If a user chooses to insert a new</title>
      <p>type Y so that X is a parent of Y and Y is a parent of Z, the
previous statement will need to be deleted. Deletion can
pose a problem for the CE Store because new statements are
sometimes automatically inferred according to the rules
already present in the store.</p>
      <p>Although limited deletion of sentences is no obstacle, some
kinds of changes to an ontology (that ought to be allowed)
could potentially require identifying and deleting sentences
en masse, at least if there are already statements about
instances of the classes in the ontology. For example, we
2 An alpha version is publically available for download at
http://ibm.co/RDIa53.
might have a relation “receives information from” between
artifacts, with some instances like “the machine KRF343
receives information from the machine EELR.” and “the
machine KRF343 receives information from the machine
KRF343.” Now suppose that someone alters the ontology by
marking the “receives information from” relation as
reflexive, which triggers (for every artifact X) the addition
of a statement, “X receives information from X.” Then, if
the reflexivity of this relation is removed, the proper
behavior would not be to have all such statements removed,
but to remove only those that statements whose existence
were generated by the rule. In that case, we might need to
keep “the machine KRF343 receives information from the
machine KRF343,” because, say, it is a special radio that
broadcasts messages and also records what it broadcasts in
addition to what it receives from other broadcasters. The CE
Store can keep track of which rules its sentences are derived
from (as “rationale graphs”); even then, however, there
remains a problem of managing which information should
be deleted.</p>
      <p>A second related worry is that the ontology editing software
does not have exclusive control over the CE Store, nor can it
verify ahead of time whether all the rules CE Store will be
compatible with changes that a user makes. If a user
accidentally adds a statement to the ontology which renders
it inconsistent, it is possible that rules that trigger on the
statements in the ontology will generate conflicting
assertions, which can trigger further undesired effects that
might be hard to predict and difficult to undo.</p>
      <p>A third deficiency of the CE Store for maintaining the
ontology information that users are editing is that it does not
provide a means for keeping different users’ ontology
changes separate. In its current state, the CE Store does not
allow any name spaces, which could differentiate between
conflicting definitions of an entity.</p>
      <p>Consequently, we found it advisable to adopt two design
policies. First, it should not be required for the CE Store to
ingest the ontology information, which is already in the
OWL file. Second, we should not require the content of the
OWL file match what ontology information (if any) kept in
the CE Store. At the same time, we determined that we
could still use the CE Store by inserting ITA-CE statements
about the user’s intention to make an ontology change or
about what information about the ontology the user would
like to obtain.</p>
      <p>The structure of the resultant application is such that a user
types ordinary English sentences into either a terminal
window or the conversational interface of the CE Store,
which triggers a response from a specially designed Java
class, OntologyAgent. This Java class parses English input
in attempt to infer the user's intentions regarding the loaded
ontology. In the special case where the user's input is in
controlled English, the OntologyAgent can act on it without
needing to ask the user for further clarification, but when the
user states a command in ordinary English, the
OntologyAgent will do its best to interpret the input,
sometimes responding with advice or questions. The output
to the user is often in ordinary English, but when the
OntologyAgent is prompting the user for confirmation, it
provides a controlled English statement to coach the user so
that on future occasions, the user can use controlled English
for quicker unambiguous communication.</p>
      <p>When the OntologyAgent needs information about the
current state of the ontology, it sends out requests for
information by placing appropriately structured ITA-CE
sentences in the CE Store, which in turn trigger a response
by another specially designed Java class, OwlAgent, which
loads OWL ontology files and operates automated reasoners
to answer questions about the inferred ontology, sending
answers back to the OntologyAgent through ITA-CE
statements placed in the CE Store. Information is shuttled
back and forth between the OwlAgent and OntologyAgent
until the OntologyAgent feels confident about the meaning
of the user’s initial request. Once the user has confirmed the
accuracy of the OntologyAgent’s interpretation, it passes an
ITA-CE string to an OwlAgent via the CE Store
conversational interface, the OwlAgent analyzes the
requested modification, and, so long as it protects the
integrity of the OWL file, updates the ontology accordingly.
Given this structure, the program can (and does) log changes
to all ontologies, keeps different users' ontologies separate,
and saves changes to the ontologies incrementally to allow
users to undo changes.</p>
      <p>In order to enhance its interpretive capabilities, the
OntologyAgent attempts to leverage information already
present within the OWL file. It does so by posing queries to
the OwlAgent (again, via the CE Store), such as, ‘Does the
class C exist in the ontology?’ and ‘Does the user’s request
violate any domain or range restrictions on object
properties?’ The OwlAgent, who manages changes to OWL
files, answers the OntologyAgent’s queries, for example,
‘There is no such class in the OWL file’ or ‘That requested
change would violate a domain restriction’. As a result, the
OntologyAgent can make suggestions based on the
information already contained within the OWL file and thus
provide guidance to users wishing to modify an ontology.
Currently, the software allows users to add classes anywhere
in the class hierarchy and to add any desired existential
restrictions. With the basic framework having been coded, it
is straightforward to expand the software to allow other
types of ontology changes.</p>
      <p>Consider an example. The user, who is logged in as ‘Steve’,
types “I want to add Citizen as a subclass of Person.” into
the conversational interface. The OntologyAgent is part of
the CUBRC software and conducts some basic natural
language processing to identify that the string matches one
of the allowed forms for stating that that one class X should
be made a subclass of another class Y. The user could have
just typed “citizen is person” and gotten the same result. The
interface is designed to be very forgiving about what it
accepts. After getting confirmation from the user, the
OntologyAgent passes the user’s command into the CE
Store using a controlled English statement
there is a request card named 'msg_1' that is from
the service 'OntologyAgent' and is to the
individual 'OwlAgent' and has and has 'citizen' as
argument one and has 'person' as argument two and
has 'Steve' as human and has 'Command_AddClass' as
command and has 'conceptualise a ~ citizen ~ C
that is a person.' as content.</p>
      <p>This string, when it enters the CE Store is recognized as a
legitimate CE statement. Because it is recognized as a card
to the individual ‘OwlAgent’, the OwlAgent coded as part
of the CUBRC software is passed the string through a Java
method. The OwlAgent then parses the string to find that it
should check whether ‘citizen’ can be added as a subclass of
‘person’. It does so by making calls to a layer of the
CUBRC software that keeps track of which ontologies are
being edited by which humans and limits the kind of
ontology changes permitted. This OWLAPI wrapper then
makes calls to a publicly available Java API called
OWLAPI, which is more complex and permits a much
wider range of operations on ontologies, especially those
stored as OWL files.</p>
      <p>Note, however, that the OntologyAgent sends redundant
information to the OwlAgent. In the content string it sends a
statement that obeys the syntax and semantics of ITA-CE:
conceptualise a ~ citizen ~ C that is a person.
In the command, argument one, and argument two strings, it
conveys in effect the same information:
Command_AddClass 'Citizen' 'Person'
The reason for passing two strings to the OwlAgent that
express the same command is that (1) it is easy for the
OntologyAgent to generate a tiny amount of additional text
to express the same command in different formats, and (2)
any agents that are coded to receive commands from an
OntologyAgent can be coded to respond to whichever
format is easiest to parse. In our conversational interface
software, the Java methods called by the OwlAgent
correspond exactly with the command strings that the
OntologyAgent sends to the OwlAgent. The correspondence
exists because there are only a small number of types of
ontology alterations that it is reasonable to allow. Because
OntologyAgents and OwlAgents understand that adding
class X as a subclass of class Y is something a user probably
wants to do, an OntologyAgent could encode that command
in ITA-CE and have an OwlAgent decode it, but it is a bit
simpler for the CUBRC software (and no harder for the CE
Store) to have the OwlAgent ignore the ITA-CE altogether
and check the command string and its arguments directly.
This raises interesting questions about what role, if any,
controlled English can or should play in a conversational
interface for editing ontologies. In the current version of the
software, ITA-CE strings are used to provide a logically
unambiguous yet human-readable confirmation prompt, but
are not needed for processing the ordinary English input.
Three questions in particular arise. Should some CNL be
used even for the confirmation prompt? Should some CNL
be used in this software for transmitting messages between
the OntologyAgent and OwlAgent? And is ITA-CE the best
form of CE to be used if we do use CE for user
confirmation?
Concerning the first, the simplicity and lack of ambiguity
provides a reason to use it for a command confirmation. But
this alone is not a strong reason because it is often possible
to make CNL statements even clearer in meaning by
dropping some of the formality. For example, instead of the
formula in ITA-CE:
conceptualise a ~ citizen ~ C that is a person.
the computer could offer
conceptualise a citizen that is a person.
without any loss of content. The tildes and the variables just
indicate which concept is being defined, which is often clear
from context or can be emphasized with boldface if desired.
A stronger reason for using CNL is that it helps to coach the
user so that the next time the user wants to enter the same
kind of request, the user can use the sort of phrasing that
appeared in previous prompts.</p>
      <p>Concerning the second question of whether CNL should be
used for the transmission of messages, there are some good
arguments for its use. In our particular software, we
controlled both ends: the natural language processing and
the ontology processing. But if we think more broadly about
how the conversational interface could be used, we find that
an OntologyAgent could potentially get clues about how
best to advise the human user from a wide range of
additional sources beyond what is kept in the edited
ontology. Given the existing software framework, one could
code agents that respond to an OntologyAgent’s information
requests by looking at a relational database, dictionaries, or
even special purpose ontology advisors. Or one could code
agents that edit ontologies stored in Open Biological and
Biomedical Ontology (OBO) files rather than OWL files.
The separation of the functions requires some sort of
common communication format. Because CNL is relatively
easy to parse and easy to extend in order to add additional
functionality, it could serve well in this role. A further
benefit of allowing CNL to play this role would be that one
could easily set up logging and auditing software to work
with the CE Store in order to keep track of which ontology
changes were being made and by whom. Such information
could be handy for later analysis to ascertain common
ontology editing patterns, which could then be used to
automate revisions to ontologies.</p>
      <p>Concerning the third question, it is important to keep in
mind that ITA-CE is severely restricted in its core lexicon
and syntax. For example, the words ‘every’, ‘some’, ‘or’,
and ‘not’ are not considered grammatical. While these same
ideas can be expressed indirectly, the resultant statements
and rules necessary for that expression tend to be too
awkward for casual users (e.g., ‘or’ is defined in terms of
complex statements involving numerous cases of ‘and’ and
‘it is false that’). Thus, extending the lexicon and syntax of
ITA-CE would greatly facilitate user understanding if these
terms could appear in the confirmation prompts and in any
communication to reduce complexity. In this way, ITA-CE
could emulate some of the existing CNL-based ontology
editors mentioned above, insofar as these editors utilize
CNL constructs that more closely resemble OWL
constructs.</p>
      <p>V.</p>
      <p>A.</p>
      <p>USE CASES: MODIFYING THE SENSOR ONTOLOGY</p>
      <sec id="sec-25-1">
        <title>Adding New Classes</title>
        <p>It is easy to add a new class to an ontology using the
conversational interface. The easiest way to do this is for the
user to use the “is a” form that is standard in Basic Formal
Ontology. The user types
An animal is an object.</p>
        <p>At this point, the OntologyAgent sends a test message to the
OwlAgent to see if the class “animal” can be assigned as a
direct subclass of “object”. If it can, the OwlAgent lets the
OntologyAgent know this, and the OntologyAgent asks the
user for confirmation. If the user answers, “yes”, the
OntologyAgent tells the OwlAgent to add the appropriate
axiom and the OwlAgent does so, logging the change in
case the user later wants to undo it. If the user answers “no”
or doesn’t respond or issues some alternative statement, The
OntologyAgent will forget about the attempt to add
“animal”.</p>
        <p>The user has other ways to communicate the desire to add a
class. The following statements are equivalent to “An
animal is an object.”
animal is object
Animals are objects.</p>
        <p>I would like to make animal a subclass of object.
Make animal a kind of object.</p>
        <p>The software also allows users to insert a new class in
between two existing classes, one of which is a direct
subclass of the other.</p>
        <p>Insert the class organism between object and
animal.
The other main capability of the software allows the user to
add a new existential restriction on a class. The user can
type something like
Every sensor observation is about some detected
material entity.
or
Sensor observations are about detected material
entities.</p>
        <p>When receiving such a statement, the OntologyAgent sends
a test message to the OwlAgent to see if the class “sensor
observation” can have an existential restriction with the
relation “is about” and the class “detected material entity”.
If it can, the OwlAgent lets the OntologyAgent know this,
and then the OntologyAgent asks the user for confirmation.
If the user answers, “yes”, the OntologyAgent tells the
OwlAgent to add the appropriate axiom and the OwlAgent
does so, logging the change in case the user later wants to
undo it. If the user answers “no” or doesn’t respond or
issues some alternative statement, the OntologyAgent will
forget about the attempt to add the existential restriction.</p>
      </sec>
      <sec id="sec-25-2">
        <title>C. Adding Existential Restrictions in the Face of Obstacles</title>
        <p>In order to demonstrate some of the more sophisticated
capabilities of our application, we created a use case with
the following vignette:</p>
        <p>Your current version of the CUBRC Sensor Ontology
includes a class called ‘Detected Material Entity’ but
does not include any additional information about it.
You want to introduce a class called ‘Sensor
Observation’ and make the ontology understand that a
sensor observation is the kind of thing that is about
detected material entities. The ontology already has an
‘is about’ relationship but does not know the term
‘Sensor Observation’.</p>
        <p>Your goals, then, are (1) to add a new class for sensor
observations, (2), correctly situate that class within the
existent hierarchy of classes, and (3) describe its
relationship to detected material entities.</p>
        <p>This task is more complicated than simply adding an
existential restriction, but nonetheless quickly doable for the
user who interacts with the OntologyAgent. The process
begins when the user enters a natural language expression
that informally captures his request to add an existential
restriction. The user could type anything like the following:
I want to make every sensor observation be about
some detected material entity.</p>
        <p>I want to make sensor observation be about
detected material entities.</p>
        <p>I want sensor observations to be about detected
material entities.</p>
        <p>Sensor observations should be about detected
material entities.</p>
        <p>Sensor observations are about detected material
entities.
a sensor observation is about a detected material
entity.</p>
        <p>With such a request, the OntologyAgent queries for the class
‘sensor observation’. Discovering – as the vignette stipulates
– that there is no class by that name in the ontology, the
OntologyAgent begins to search for any clues that will help
interpret the user’s intention. The OntologyAgent first
checks the various parts of the user’s phrase. In this case, it
sees that ‘observation’ is a word in ‘sensor observation’ and
checks whether there is a class ‘observation’ that could be a
superclass for ‘sensor observation’. When the OwlAgent
tells the OntologyAgent that ‘observation’ is also not in the
ontology, the OntologyAgent looks for restrictions upon
relations (e.g., domain or range restrictions) in this case,
whether the ‘is about’ relation already has any existential
restrictions. (Although we have not coded further
capabilities into the OntologyAgent yet, it would be easy to
extend the CUBRC software to also look for synonyms of
class names and annotations like developer comments,
definitions, and class labels.) When searching the ‘is about’
relation for restrictions, the OwlAgent reports to the
OntologyAgent the following clue: there is an axiom about
the class Information Content Entity to the effect that
Information Content Entity is equivalent to ‘is about some
entity’ (a generic class comprising all other classes). Since
the user is trying to express that sensor observations are
about detected material entities, and since being an
Information Content Entity is equivalent to being about
some Entity, the OntologyAgent formulates a guess that (a)
we need to insert a new class called Sensor Observation,
and (b) the class Sensor Observation needs to be a subclass
of Information Content Entity, though not necessarily a
direct subclass. So, the OntologyAgent gets the direct
subclasses of Information Content Entity from the
OwlAgent and presents to the user the following text.
OntologyAgent: I understand you as wanting to add
an existential restriction. You are trying to
express that every sensor observation is about
some detected material entity. I think you want me
to issue the following command:
conceptualise a ~ sensor observation ~ C that is
about the detected material entity R.</p>
        <p>However, the ontology is not aware of what 'sensor
observation' means. Because of the 'is about'
relation, a sensor observation should probably be
assigned to be one of the following:
1. A descriptive information content entity
2. A designative information content entity
3. A directive information content entity
4. An information content entity
If is one of these, just let me know the number,
or you can write something of the form, "a sensor
observation is a ___."
As it turns out, the user Steve decides to situate Sensor
Observation under the parent class of Descriptive ICE, so he
types
1
The OntologyAgent responds by adding ‘sensor
observation’ as a direct subclass of the ‘descriptive
information content entity’ class. Once the OwlAgent
reports that that change has been made, the OntologyAgent
knows that the obstacles have been cleared to allow the
existential restriction to be added. So the OntologyAgent
immediately sends the command to the OwlAgent without
needing further confirmation. When the OwlAgent reports
that this further command has succeeded, the
OntologyAgent reports to the user the following:
OntologyAgent: I successfully added 'sensor
observation' as a direct subclass of 'descriptive
information content entity'. I successfully added
the existential restriction you requested.
In summary, Steve submitted a single sentence to convey his
desired ontology change. After that, Steve only needed to
select a multiple choice answer in order to clarify where the
previously unknown ‘sensor observation’ class should be
placed in the hierarchy, and all the necessary changes were
made without any further effort.</p>
        <p>In practice, all ontology changes would be audited before
being integrated into widely shared OWL files.</p>
        <p>VI.</p>
        <p>FUTURE WORK
Our research on this topic was merely exploratory because
of resource limitation and a number of future efforts are
warranted. Greater editing functionality should be added
first because it provides clear value and is not an ambitious
task. The harder task will be to improve the software's
ability to help the user with the most appropriate questions
and advice. Still, even these improvements can be
incremental and piece-meal, as the natural language is
meant only to help guide and coach when the user does not
know the appropriate controlled English to use.</p>
        <p>Earlier, we showed that although our application extends the
capability of the CE Store software, it does so without
necessarily using ITA-CE to represent ontological claims.
The role played by ITA-CE might easily be played by a
more expressive CNL or a standard data format like XML or
JSON. There is potential for ITA-CE to serve as a common
format for capturing the semantic intention of natural
language user inputs. Its value in this regard will largely
depend on how much other infrastructure uses ITA-CE and
how well the information being passed back and forth can
be leveraged to automate some ontology development.
At this stage, our application is limited to assistance with
OWL-based ontology editing. It is our hope that this project
will eventually be extended further, so that ITA-CE
sentences can be exploited to mediate user interaction with
other ontology languages (e.g., OBO) and other formats
(SQL, relational databases). Thus, in dividing labor between
the OntologyAgent and OwlAgent, we have left open the
possibility of mapping ITA-CE to these formats and of
writing additional back-end agents, whose jobs, like the
OwlAgent’s, would be to exchange information with the
OntologyAgent and edit the appropriate document on behalf
of the user. We also leave open the possibility of alternative
OntologyAgents, who pass messages in ITA-CE only.
To illustrate this proposal, consider the following two
scenarios. In Scenario #1, a user interacts with a different
OntologyAgent that outputs ITA-CE strings only, not the
command strings described earlier, and sends the messages
to an OwlAgent. The problem is that the OwlAgent does not
understand ITA-CE strings; it ingests command strings only.
In this scenario, it would be desirable to introduce a further
intermediary agent to translate ITA-CE strings into
command strings amenable to the OwlAgent’s work. By
introducing this further layer, we allow the OwlAgent to
continue interpreting messages in terms of command strings.
At the same time, this makes room for ITA-CE to act as
middleware for various other agents.</p>
        <p>In Scenario #2, a user interacts with the OntologyAgent,
who passes messages in turn to an OwlAgent that
understands ITA-CE strings only, not command strings.
This new OwlAgent would have access to a relational
database and would query that database to provide the
OntologyAgent with information about the user’s intended
request. In this scenario, it becomes indispensable that the
OntologyAgent transmit not just command strings, but
ITACE strings as well. Thus, if ITA-CE is to be the common
format for various agents and information sources, we ought
to ensure that OntologyAgents are conversant in ITA-CE.
These scenarios highlight another potential benefit of
employing ITA-CE as middleware. If ITA-CE is used as a
common format, then additional agents could be
programmed to provide OntologyAgents with answers to his
queries which are based on the access they enjoy to various
information sources. In this case, ITA-CE appears to be
promising as a common format for the exchange of
information among agents.</p>
        <p>
          If ITA-CE were to be harnessed in these ways, then in will
be necessary to augment the present ITA-CE core lexicon
and syntax. At present, ITA-CE does not allow the terms
‘every’, ‘some’, ‘or’, and ‘not’, which inhibits users from
facile comprehension. Thus, an extension of this project
would be to pursue methods laid out by Mott and Hendler
[
          <xref ref-type="bibr" rid="ref2">2</xref>
          ], in which new layers of generic syntax are added to the
core ITA-CE syntax. Mott and Hendler illustrate this with
the adverb ‘only’; to add ‘only’ to the syntax of ITA-CE,
they invented a language, which defines ‘only’ in terms of
the unaugmented core syntax. Further transformations could
add common quantifiers and connectives such as ‘every’,
‘some’, ‘or’, and ‘not’, thus enhancing users’ interaction
with ITA-CE expressions by rendering them more natural.
        </p>
        <p>Acknowledgments
Work on ITA-CE as a middleware for ontology editing was
supported by the US Army Research Laboratory. We also
thank David Mott for his consultations on ITA-CE.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Bock</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fokoure</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoekstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>“OWL 2 Web Ontology Language Structural Specification</article-title>
          and
          <string-name>
            <surname>Functional-Style</surname>
            <given-names>Syntax</given-names>
          </string-name>
          ,”
          <fpage>2nd</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Mott</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2009</year>
          . “Layered Controlled Natural Languages,
          <source>” Proceedings of the Third Annual Conference of the International Technology Alliance.</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Braines</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mott</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laws</surname>
          </string-name>
          , S., de Mel, G.,
          <string-name>
            <surname>Pham</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <year>2013</year>
          . “Controlled English to Facilitate Human/Machine Analytical Processing,”
          <source>in Proceedings of SPIE.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Braines</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Preece</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , de Mel, G.,
          <string-name>
            <surname>Pham</surname>
            <given-names>T.</given-names>
          </string-name>
          <year>2014</year>
          . “
          <article-title>Enabling CoIST Users: D2D at the Network Edge,</article-title>
          ” in
          <source>2014 Proceedings of the 17th International Conference on Information Fusion (FUSION).</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Poteet</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xue</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mott</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Braines</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Giammanco</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <year>2013</year>
          . “
          <article-title>Controlled English for Effective Communication during Coalition Operations,”</article-title>
          <source>Proceedings of ICCRTS.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Preece</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pizzocaro</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Braines</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mott</surname>
          </string-name>
          , D., de Mel, G.,
          <string-name>
            <surname>Pham</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>“Integrating Hard and Soft Information Sources for D2D using Controlled Natural Languages,”</article-title>
          <source>Proceedings of the 15th International Conference on Information Fusion.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drummond</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogers</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knublauch</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wroe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <year>2004</year>
          . “OWL Pizzas:
          <article-title>Practical Experience of Teaching OWL-DL: Common Errors &amp; Common Patterns,” European Conference on Knowledge Acquisition (EKAW-</article-title>
          <year>2004</year>
          ), Whittlebury, UK.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Bernstein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaufmann</surname>
            <given-names>E.</given-names>
          </string-name>
          <year>2006</year>
          .
          <string-name>
            <surname>“GINO - A Guided Input Natural Language Ontology Editor</surname>
          </string-name>
          ,” in Cruz, I.,
          <string-name>
            <surname>Decker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allemang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Preist</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schwabe</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mika</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Uschold</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aroyo</surname>
            ,
            <given-names>L</given-names>
          </string-name>
          . (eds.),
          <source>ISWC 2006. Lecture Notes on Computer Science</source>
          , Vol
          <volume>4273</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Bernstein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaufmann</surname>
          </string-name>
          , E.,
          <string-name>
            <surname>Kiefer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <year>2009</year>
          .
          <article-title>“Querying the Semantic Web with Ginseng - A Guided Input Natural Language Search Engine,” Searching Answers: Festschrift in Honour of Michael Hess on the Occasion of His 60th Birthday</article-title>
          , Clematide,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Klenner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Volk</surname>
          </string-name>
          , M. (eds.).
          <article-title>Munster: MV-Wissenschaft.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Kaufmann</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bernstein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2007</year>
          . “
          <article-title>How Useful Are Natural Language Interfaces to the Semantic Web for Casual End-</article-title>
          <source>Users?” Lecture Notes in Computer Science</source>
          , Vol.
          <volume>4825</volume>
          ,
          <fpage>281</fpage>
          -
          <lpage>294</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Funk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tablan</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bontcheva</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cunningham</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Handschuh</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <year>2007</year>
          . “
          <article-title>CLOnE: Controlled Language for Ontology Editing</article-title>
          ,” Lecture Notes in Computer Science: The Semantic Web
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Hart</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , Johnson,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Dolbear</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <year>2008</year>
          . “
          <article-title>Rabbit: Developing a Controlled Natural Language for Authoring Ontologies,”</article-title>
          <source>The Semantic Web: Research and Applications, Lecture Notes in Computer Science</source>
          , Vol.
          <volume>5021</volume>
          ,
          <fpage>348</fpage>
          -
          <lpage>360</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Kaljurand</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <year>2008</year>
          . “
          <source>ACE View - An Ontology and Rule Editor Based on Controlled English,” Proceedings of the Poster and Demonstration Session at the 7th International Semantic Web Conference (ISWC</source>
          <year>2008</year>
          ), CUER Workshop Proceedings.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Wroblewska</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaplanski</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zarzycki</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lugowska</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          <year>2013</year>
          . “
          <article-title>Semantic Rules Representation in Controlled Natural Language in FluentEditor,” The 6th Annual International Conference on Human System Interaction (HSI).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Smart</surname>
            ,
            <given-names>P.R.</given-names>
          </string-name>
          <year>2008</year>
          .
          <article-title>“Controlled Natural Languages and the Semantic Web</article-title>
          .
          <source>Technical Report ITA/P12/SemWebCNL</source>
          , School of Electronics and Computer Science, University of Southampton.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>“OWL 2 Web Ontology Language Manchester Syntax,” 2nd edition</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Cregan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schwitter</surname>
          </string-name>
          , R., Meyer T.
          <year>2007</year>
          .
          <article-title>“Sydney OWL Syntax - toward a Controlled Natural Language Syntax for OWL 1</article-title>
          .1,” presented
          <source>at OWLED</source>
          <year>2007</year>
          ,
          <article-title>OWL: Experiences and Directions</article-title>
          , Third International Workshop, Innsbruck, Austria,
          <fpage>6</fpage>
          -
          <lpage>7th</lpage>
          ,
          <year>June 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Sowa</surname>
            ,
            <given-names>J.F.</given-names>
          </string-name>
          <year>2007</year>
          . “Common Logic Controlled English,” http://www.jfsowa.com/clce/clce07.htm.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Mott</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <year>2010</year>
          . “
          <article-title>Summary of ITA Controlled English</article-title>
          ,” https://www.usukita.org/papers/5658/details.html.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>