<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <pub-date>
        <year>1800</year>
      </pub-date>
      <abstract>
        <p>We discuss the development of an environment for formal knowledge engineering. The Sigma system is an advance over previously developed systems in that it integrates a number of modern ontology development tools, which has motivated a number of research issues. Primary components include an ontology browsing and editing environment, a first order logic inference system and a natural language to logic translator. Although largely independent of any particular ontology, it supports a number of publicly available formal ontologies.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Human knowledge is complex, and human language is
very expressive. Computer systems that process natural
language have been limited to a shallow level of
understanding by the very complexity of the information
that they are expected to handle. Conversely, systems that
manage information in databases have been left to reason
either in very narrow and pre-determined ways, or to
perform processing tasks that must be interpreted by
humans.</p>
      <p>
        It is desirable to employ computer languages for
representing knowledge that are as expressive as possible,
and as close to the expressiveness of human language.
Expressiveness does have a computational burden. In the
opinion of the author, the best compromise available for
many knowledge representation efforts is first order logic.
While there are other choices, such as description logic and
higher order logic, they represent departures from a middle
ground. First order logic is undecidable, but can be made
tractable for certain kinds of reasoning, which will be
detailed later. Description logic
        <xref ref-type="bibr" rid="ref1">(Baader, et al, 2003)</xref>
        has
some very attractive formal properties, but is significantly
less expressive than first order logic, and therefore limits
the knowledge engineer’s ability to express the semantic
content of statements found in normal human discourse.
Higher order logic (Carreno et al, 2002) on the other hand
is much harder to reason with.
      </p>
      <p>The Sigma system was designed to integrate several
different kinds of tools for working with knowledge in first
order logic.</p>
    </sec>
    <sec id="sec-2">
      <title>Browsing and Editing</title>
      <p>The Sigma system contains several different sorts of
browsers for viewing formal knowledge bases. The most
basic component is a term browser, which presents all the
statements in which a particular term appears. The
statements are sorted by argument position and then the
appearance of the term in rules and non-rule statements are
then shown. All the statements are hyperlinked to the terms
that appear in them.</p>
      <p>Two types of tree browser are provided. One provides
an automatic graph layout. Another shows a textual
hierarchy. The user can chose the term to start with, the
number of “levels” that should be presented from the term,
and the binary relation to chose as the predicate that links
the different nodes in the graph. For example, if the user
asks for a graph of the term IntentionalProcess and for
the subclass relation, the system will go “up” the graph to
display the term Process, and down the graph to display
the terms Keeping, Guiding, Maintaining etc. The user
can ask for more levels up or down the graph. Note that
any relation can be chosen so for example a presentation of
partonomies, or attribute hierarchies is also supported by
choosing the relations part and subAttribute
respectively.</p>
      <p>The editing system is currently rather rudimentary,
consisting of the ability to type formulae and have some
simple syntax and other error checking performed. We
plan to offer a frame-based editing system similar to, or
incorporating open-source components from, the Protégé
(Gennari et al, 2002) system.</p>
      <p>
        We have developed some more sophisticated tools for
collaborative knowledge engineering. The System for
Collaborative Open Ontology Production (SCOOP)
        <xref ref-type="bibr" rid="ref10 ref7 ref8">(Pease
&amp; Li, 2003)</xref>
        supports an automated workflow process for
development of ontologies and resolution of conflicts
among ontologies. The SCOOP system employs a theorem
prover to detect inconsistencies among ontologies.
      </p>
      <p>SCOOP addresses several types of inconsistencies. The
first we term vertical inconsistency. This refers to when a
set of ontologies are loaded and one ontology has a
contradiction with another ontology on which it depends.
Inconsistency of this type is never allowed, because from a
contradictory knowledge base, any proposition can be
concluded to be true. SCOOP enforces a workflow process
that requires a resolution to such a situation.</p>
      <p>The second kind of inconsistency we term horizontal
inconsistency. This refers to a situation in which
knowledge products created by different knowledge
engineers, and which do not have a mutual dependency, are
mutually contradictory. SCOOP alerts developers to such a
situation, but does not require that it be eliminated. It is
possible for two knowledge bases to represent different
perspectives, which are contradictory, but locally valid.</p>
      <p>
        We employ the KIF (Genesereth, 1991) language and
have a translator to and from DAML
        <xref ref-type="bibr" rid="ref4">(Hendler &amp;
McGuinness, 2000)</xref>
        . A translator to and from Protégé
(Gennari et al, 2002) is partially completed at this time.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Language Generation</title>
      <p>Each statement can also be presented as a natural
language paraphrase similar to (Sevcenko, 2003). Note
that we also use Sevcenko’s language templates for English
and Czech. Each term in an ontology can be given a
natural language presentation form, indexed by the human
language. For example, the SUMO term
DiseaseOrSyndrome can be presented as “ disease or
syndrome” and an Italian presentation would be shown as
"malattia o sindrome". Combined with the English
understanding mechanisms described below, this gives us a
very rudimentary language translation capability.</p>
      <p>Although presentation of terms is straightforward,
presentation of statements is more complicated, and
roughly patterned after C-language printf statements. For
example the relation “ part” , which states that one object is
a part of another, has the corresponding language
generation template “ %1 is %n a part of %2” . The first
argument to the logical relation is substituted for %1 etc.
Note that this substitution is recursive, so that complex
statements with nested formulae can be translated
effectively. The %n signifies that if the statement is
negated, that the negation operator for the appropriate
human language should be inserted in that position.</p>
      <p>We currently have language templates for English,
Czech, German and Italian. Some work has been done on
Hindi, Telugu, Tagalog and Russian.</p>
    </sec>
    <sec id="sec-4">
      <title>Natural Language Understanding</title>
      <p>We take a restricted language approach to natural
language understanding. Deep understanding of
unrestricted human languages is too hard with present
technology. Our approach is to create a restricted version
of English, which is grammatical but more limited than true
natural language. Statements must be present tense
singular. Although different tense and number can be
accepted, the system paraphrases such sentences into a
present tense singular form. Ambiguous word choices
default to the most popular sense of the word, with an
escape mechanism for the user to select a different sense.
Anaphoric references are handled with a simple mechanical
algorithm. Some kinds of quantification (every, some, all)
can be handled.</p>
      <p>
        The current system is capable of taking simple English
sentences and translating them into KIF, using terms from
our SUMO upper ontology (described below). We have
mapped all 100,000 WordNet (Miller, et al, 1993) word
senses (synsets) to SUMO, one at a time, by hand over the
period of a year
        <xref ref-type="bibr" rid="ref10 ref7 ref8">(Niles &amp; Pease, 2003)</xref>
        . This endows our
natural language translation system with a very large
vocabulary.
      </p>
      <p>
        Our approach is presented more fully in
        <xref ref-type="bibr" rid="ref10 ref7 ref8">(Murray, Pease
&amp; Sams, 2003)</xref>
        .
      </p>
    </sec>
    <sec id="sec-5">
      <title>Inference</title>
      <p>One basic issue is that of allowing variables in the
predicate position. While the general case of this results in
expressions being beyond first order logic, there is a
slightly more restricted case, which is first order. A
statement with a variable in the predicate position is only
higher order if a quantifer ranges of all possible relations,
rather than the finite set of relations in a particular
knowledge base. Since prepending another relation in front
of every statement makes everything first order for such a
restricted practical case, this therefore must mean that the
statement wasn’t really higher-order in the first place.</p>
      <p>There is also an issue with prohibiting statements as
arguments to relations. When arguments to relations are
statements, then such a statement is higher order. We could
either have a quote operator or define a Statement class and
require all predicates have their argument types defined
(which would allow us to know in advance whether an
argument is a Statement, and therefore needs to be
implicitly quoted). A statement that has this issue is
(believes John (likes Bob Mary))</p>
      <p>Currently, such statements are quoted, and therefore
become opaque first-order objects rather than statements.</p>
      <p>
        Another issue is row variables, for use in variable arity
relations. One proposed version of KIF
        <xref ref-type="bibr" rid="ref3">(Hayes &amp; Menzel,
2001)</xref>
        has what are alternately called row, or sequence
variables. They are denoted by the ’@’ symbol in KIF
statements. They are analogous to the lisp @REST
variable. This is not first order if the number of arguments
it can "swallow up" is infinite. However, if row variables
have a definite number of arguments, it can be treated like a
macro, and becomes first order. For example,
(=&gt;
(and
(subrelation ?REL1 ?REL2)
(holds ?REL1 @ROW))
(holds ?REL2 @ROW))
would become
etc.
      </p>
      <p>Also note that this "macro" style expansion has the
problem that unlike the true semantics of row variables,
that it is not infinite. If the macro processor only expands
to five variables, there is a problem if the knowledge
engineer uses a relation with six. Because of that, Sigma’s
syntax checker must prohibit relations with more arguments
than the row variable preprocessor expands to.</p>
    </sec>
    <sec id="sec-6">
      <title>Default reasoning</title>
      <p>Given the example KB:
(=&gt;
(instance ?X Bird)
(canFly ?X))
(=&gt;
(instance ?X Penguin)
(not</p>
      <p>(canFly ?X)))
(subclass Penguin Bird)
We would like the second rule to override the first. The
general case of default reasoning is very difficult
(Schlechta, 1997). However, we believe that there is an
easy way to address the most common case and get the
utility we need. Given a relation
(exception &lt;formula-specific&gt; &lt;formula2-general&gt;)
we can implement a macro that modifies the first formula
above to exclude the exception specified and generate the
KB
(=&gt;
(and
(instance ?X Bird)
(not (instance ?X Penguin))
(canFly ?X))
(=&gt;
(instance ?X Penguin)
(not</p>
      <p>(canFly ?X)))
(subclass Penguin Bird)</p>
      <p>Of course, this is only easy in the specific case where
two rules have opposite conclusions and the antecedent of
one subsumes the other. It’s possible that in easy cases we
might be able to have Sigma even generate the
(exception... clause that the macro will use.</p>
      <p>The algorithm for the macro simply would be, given the
(exception... statement, to negate the antecedent of the
&lt;formula-specific&gt; and add it as a conjunction to the
&lt;formula2-general&gt;. Like other macros, this has
implications for proof presentation that are also unresolved.</p>
    </sec>
    <sec id="sec-7">
      <title>Proof Presentation</title>
      <p>Sigma includes several options for proof presentation.
Despite the fact that most textbooks present proofs as linear
structures, proofs are trees. The same sub-proof may be
used several times in reaching different intermediate
conclusions. While this is a byproduct of automated
reasoning, it is rarely useful to the human user. Therefore,
Sigma eliminates redundant paths of reasoning in order to
create a linear proof.</p>
      <p>Sigma also has options for how it presents multiple
proofs. Often, the same proof, with the same proof steps,
can be reached via a different search order. This means
that although two tree-structured proofs may be different,
they may work out to be identical when redundant paths are
removed and a linear proof structure generated. Sigma
supports an option for hiding such duplicate proofs.</p>
      <p>On additional option is to suppress proofs that may have
different steps but which lead to the same answer.
Sometime it is useful to a knowledge engineer to see these
alternate proofs, and sometime not.</p>
    </sec>
    <sec id="sec-8">
      <title>Reasoning with Equality</title>
      <p>One problem in a first order theorem prover with
procedural attachments for arithmetic is that the equality
operator masks normal unification and inference. Currently
Sigma converts the SUMO term ’equal’ to ’=’ when sending
assertions and queries to the theorem prover and then
converts back for proof formatting. We are experimenting
with changing the name to ’eval’ and mapping that string to
the theorem prover’s '= '.</p>
      <p>Our current idea is to have three predicates, one, which
handles evaluation, one, which handles inference, and
another, which combines the two.
equalAsserted eval</p>
      <p>equal
The following examples of assertions and queries should
make clear how this will work.
assert:
(equal (CardinalityFn Continent) 7)
macro expands to:
(eval (CardinalityFn Continent) 7)
(equalAssigned (CardinalityFn Continent) 7)
documentation allows us to alert the user when such
statements are conflicting or not present.</p>
      <p>
        We employ the Suggested Upper Merged Ontology
(SUMO)
        <xref ref-type="bibr" rid="ref8">(Niles &amp; Pease, 2001)</xref>
        as the system’s standard
ontology. SUMO has been released to the public for free
since its first version in December of 2000. Now in its 47th
version, the SUMO has been reviewed by hundreds of
people and subject to formal validation with a theorem
prover, to ensure that it is free of contradictions. The
SUMO contains roughly 1000 terms and 4000 statements,
of which 750 are rules. As mentioned above, it has been
mapped by hand to the WordNet lexicon, which has acted
as an additional check on completeness and coverage.
      </p>
      <p>A number of domain ontologies have been created that
extend SUMO and can be used in the Sigma system. They
include
·</p>
      <p>A Quality of Service ontology, covering computer
systems and networks
An ecommerce services ontology
An ontology of biological viruses
A financial ontology
An ontology of terrain features
Ontologies of weapons of mass destruction and
terrorism
An ontology of government and governmental
organizations
Taxonomies of the periodic table of the elements
and industry types</p>
    </sec>
    <sec id="sec-9">
      <title>Related Work</title>
      <p>
        There have been a number of ontology editing
environments created including Ontolingua
        <xref ref-type="bibr" rid="ref2">(Farquhar et al,
1996)</xref>
        , Ontosaurus
        <xref ref-type="bibr" rid="ref13">(Swartout et al, 1996)</xref>
        , Protégé (Gennari
et al, 2002), and Cyc
        <xref ref-type="bibr" rid="ref5">(Lenat, 1995)</xref>
        . Ontosaurus and Cyc
both have inference components. Cyc is the only system to
contain a standard ontology. Cyc also contains a natural
language component although little or no public
information about that work is available.
      </p>
      <p>
        The GKB editor
        <xref ref-type="bibr" rid="ref9">(Paley et al, 1997)</xref>
        is an example of a
graphical ontology editor. SNARK (Stickel et al, 1994),
and Otter (Kalman, 2001) are examples of theorem provers.
Many theorem provers have been tested on the
CADE/TPTP
        <xref ref-type="bibr" rid="ref12">(Sutcliffe et al, 2002)</xref>
        competitions.
However, limited efforts have been made to apply formal
first order theorem proving to expert system and common
sense reasoning on large knowledge bases. The Sigma
system brings all these types of components together, and
in the process, addresses a number of research issues that
have not been evident in use of these separate components.
      </p>
    </sec>
    <sec id="sec-10">
      <title>Acknowledgements</title>
      <p>The author would like to thank Randy Schulz for his efforts
on early versions of this system.
query:
(equalAssigned (AdditionFn 2 3) ?X)
query:
(equal (AdditionFn 2 3) ?X)
macro expands to:
(eval (AdditionFn 2 3) ?X)
(equalAssigned (AdditionFn 2 3) ?X)
The formal semantics of the macro is
(=&gt;
(equal ?X ?Y)
(eval ?X ?Y))
(=&gt;
(equal ?X ?Y)
(equalAssigned ?X ?Y))</p>
    </sec>
    <sec id="sec-11">
      <title>Ontology</title>
      <p>The Sigma system has been designed to be as
independent of a particular ontology as possible, but there
are many features that are available when a standard
ontology is used. Current features are primarily to do with
error checking. Knowing a standard method for defining
argument type restrictions, class-subclass relations and</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            , Nardi,
            <given-names>D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , (eds). (
          <year>2003</year>
          )
          <article-title>The Description Logic Handbook Theory, Implementation</article-title>
          and Applications,
          <volume>574</volume>
          pp.
          <source>ISBN: 0521781760 Carreno</source>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Munoz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            , and
            <surname>Tahar</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          , (eds.) (
          <year>2002</year>
          ).
          <article-title>Theorem Proving in Higher Order Logics</article-title>
          .
          <source>Proceedings of the 15th International Conference, TPHOLs</source>
          <year>2002</year>
          , Hampton,
          <string-name>
            <surname>VA</surname>
          </string-name>
          , USA,
          <year>August</year>
          20-
          <issue>23</issue>
          ,
          <year>2002</year>
          . SpringerVerlag.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Farquhar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fikes</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rice</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , (
          <year>1996</year>
          ).
          <article-title>The Ontolingua Server: a Tool for Collaborative Ontology Construction</article-title>
          .
          <source>Proceedings of Tenth Knowledge Acquisition for Knowledge-Based Systems Workshop</source>
          . Available at http://ksi.cpsc.ucalgary.ca/KAW/KAW96/farquhar/farquha r.html#RTFToC15 Gennari, J.,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. W.</given-names>
            <surname>Fergerson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. E.</given-names>
            <surname>Grosso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Crubézy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Eriksson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. W.</given-names>
            <surname>Tu</surname>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>The Evolution of Protégé: An Environment for KnowledgeBased Systems Development</article-title>
          .
          <source>Stanford SMI technical report SMI-2002-0943</source>
          .http://smi-web.stanford.edu/pubs /SMI_Abstracts/SMI-2002-0943.html Genesereth,
          <string-name>
            <surname>M.</surname>
          </string-name>
          , (
          <year>1991</year>
          ).
          <article-title>``Knowledge Interchange Format''</article-title>
          ,
          <source>In Proceedings of the Second International Conference on the Principles of Knowledge Representation and Reasoning</source>
          , Allen,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Fikes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Sandewall</surname>
          </string-name>
          , E. (eds), Morgan Kaufman Publishers, pp
          <fpage>238</fpage>
          -
          <lpage>249</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Hayes</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Menzel</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , (
          <year>2001</year>
          ).
          <article-title>A Semantics for Knowledge Interchange Format</article-title>
          ,
          <source>in Working Notes of the IJCAI-2001 Workshop on the IEEE Standard Upper Ontology.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , (
          <year>2000</year>
          ),
          <article-title>The DARPA Agent Markup Language</article-title>
          ,
          <source>IEEE Intelligent Systems</source>
          ,
          <volume>15</volume>
          (
          <issue>6</issue>
          ) (November),
          <fpage>67</fpage>
          -
          <lpage>73</lpage>
          . Available: http://www.ksl.stanford.edu/people/dlm/papers/ieeedaml01-abstract.html Kalman,
          <string-name>
            <surname>J. K.</surname>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>Automated Reasoning with OTTER</article-title>
          . Rinton Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Lenat</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>"Cyc: A Large-Scale Investment in Knowledge Infrastructure."</article-title>
          <source>Communications of the ACM</source>
          <volume>38</volume>
          , no.
          <volume>11</volume>
          (November).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>MacGregor</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , (
          <year>1991</year>
          ).
          <article-title>The Evolving Technology of Classification-Based Knowledge Representation Systems</article-title>
          .
          <source>In Principles of Semantic Networks: Explorations in the Representation of Knowledge, ed J. Sowa</source>
          ,
          <volume>385</volume>
          -
          <fpage>400</fpage>
          . San Francisco, Calif., Morgan Kaufmann Miller,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Beckwith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Fellbaum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Gross</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            , and
            <surname>Miller</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          “
          <article-title>Introduction to WordNet: An On-line Lexical Database</article-title>
          .”
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Murray</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pease</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Sams</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Applying Formal Methods and Representations in a Natural Language Tutor to Teach Tactical Reasoning</article-title>
          . To appear.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Niles</surname>
            ,
            <given-names>I</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Pease</surname>
            <given-names>A.</given-names>
          </string-name>
          , (
          <year>2001</year>
          ) “
          <article-title>Towards A Standard Upper Ontology</article-title>
          .”
          <source>In Proceedings of Formal Ontology in Information Systems (FOIS</source>
          <year>2001</year>
          ),
          <source>October 17-19</source>
          , Ogunquit, Maine, USA, pp
          <fpage>2</fpage>
          -
          <lpage>9</lpage>
          . See also http://ontology.teknowledge.com Niles,
          <string-name>
            <given-names>I.</given-names>
            , &amp;
            <surname>Pease</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          , (
          <year>2003</year>
          ).
          <article-title>Mapping WordNet to the SUMO Ontology</article-title>
          . To appear. See also http://ontology.teknowledge.com:8080/rsigma/nilesWordN et.pdf
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Paley</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lowrance</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Karp</surname>
            ,
            <given-names>P.D.</given-names>
          </string-name>
          (
          <year>1997</year>
          )
          <article-title>"A Generic Knowledge-Base Browser and Editor,"</article-title>
          <source>In Proceedings of the 1997 National Conference on Artificial Intelligence</source>
          , Providence, RI.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Pease</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , (
          <year>2003</year>
          ).
          <article-title>Agent-Mediated Knowledge Engineering Collaboration</article-title>
          ,
          <source>in Proceedings of the AAAI Spring Symposium on Agent Mediated Knowledge Management</source>
          . Stanford, CA March 24-26. To appear.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Pease</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Niles</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , (
          <year>2002</year>
          ),
          <article-title>The Suggested Upper Merged Ontology: A Large Ontology for the Semantic Web and its Applications</article-title>
          ,
          <source>in Working Notes of the AAAI-2002 Workshop on Ontologies and the Semantic Web</source>
          . http://projects.teknowledge.com/AAAI-2002/Pease.ps Schlechta,
          <string-name>
            <surname>K.</surname>
          </string-name>
          , (
          <year>1997</year>
          ).
          <source>Nonmonotonic Logics: Basic Concepts</source>
          ,
          <source>Results, and Techniques (Lecture Notes in Artificial Intelligence) by Karl</source>
          243 pp.
          <source>Springer Verlag pub. ISBN: 3540624821 Stickel</source>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Waldinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Lowry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Pressburger</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Underwood.</surname>
          </string-name>
          (
          <year>1994</year>
          )
          <article-title>Deductive composition of astronomical software from subroutine libraries</article-title>
          .
          <source>Proceedings of the Twelfth International Conference on Automated Deduction (CADE-12)</source>
          , Nancy, France,
          <year>June 1994</year>
          ,
          <fpage>341</fpage>
          -
          <lpage>355</lpage>
          . See also http://www.ai.sri.com/~stickel/snark.html.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>Sutcliffe G.</given-names>
            ,
            <surname>Suttner</surname>
          </string-name>
          <string-name>
            <given-names>C.B.</given-names>
            ,
            <surname>Pelletier</surname>
          </string-name>
          <string-name>
            <surname>F.J.</surname>
          </string-name>
          (
          <year>2002</year>
          ),
          <article-title>The IJCAR ATP System Competition</article-title>
          ,
          <source>Journal of Automated Reasoning</source>
          <volume>28</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>307</fpage>
          -
          <lpage>320</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Swartout</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patil</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knight</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Russ</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>Ontosaurus: a tool for browsing and editing ontologies</article-title>
          , Gaines,
          <string-name>
            <given-names>B.R.</given-names>
            and
            <surname>Musen</surname>
          </string-name>
          , M.A., Ed.
          <source>Proceedings of Tenth Knowledge Acquisition Workshop</source>
          . pp.
          <fpage>69</fpage>
          -
          <lpage>1</lpage>
          -
          <fpage>69</fpage>
          -12 (http://ksi.cpsc.ucalgary.ca/KAW/KAW96/swartout/ontosa urus_demo.html)
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>