<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Application of OWL 1.1 to Systems Engineering</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Henson Graves</string-name>
          <email>henson.graves@lmco.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ian Horrocks</string-name>
          <email>Ian.Horrocks@comlab.ox.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Lockheed Martin Aeronautics Company Fort Worth</institution>
          ,
          <addr-line>Texas</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Oxford University Computing Laboratory Parks Road</institution>
          ,
          <addr-line>Oxford</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Current systems engineering languages, standards, and tools are restricted in certain aspects of their expressiveness and do not provide formal semantics. While there is a long history of attempts to use formal methods for engineering, up to now the formalisms have generally proved too hard to use, and the tools do not scale for large complex system development. A semantic integration framework that can integrate representations from multiple system engineering languages and tools could, however, have a significant impact on cost, schedule, and product integrity. We are exploring the potential for OWL 1.1 to provide such a semantic integration for the air system engineering domain. To determine the potential to use OWL 1.1 in this setting we are developing a prototypical air system ontology in OWL 1.1 and evaluating the use of the language for developing and reasoning about systems engineering concepts such as requirements and product structure.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Current systems engineering languages, standards,1 and tools are restricted in
certain aspects of their expressiveness and do not provide formal semantics.
While there is a long history of attempts to use formal methods for
engineering, up to now the formalisms have generally proved too hard to use, and the
tools do not scale for large complex system development. A semantic integration
framework that can integrate representations from multiple system engineering
languages and tools could, however, have a significant impact on cost, schedule,
and product integrity. We are exploring the potential for OWL 1.12 to provide
such a semantic integration for the air system engineering domain [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The idea
is that a product development ontology can capture the meaning of concepts
in a form independent of interpretation by subject matter experts, something
that is not possible with current engineering languages and tools. Automated
1 See, e.g., http://www.sysml.org/
2 See http://www.w3.org/2007/OWL/
reasoning could then be used to check design properties such as consistency and
conformance with specification, and the ontology could also be used to integrate
information from the large number of systems used in the design of an air vehicle.
      </p>
      <p>
        To determine the potential to use OWL 1.1 in this setting we are developing
a prototypical air system ontology in OWL 1.1 and evaluating the use of the
language for developing and reasoning about systems engineering concepts such
as requirements and product structure. The ontology has been developed within
Prot´eg´e 4.0 using the Fact++ reasoner [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. We have verified that a simplified
air vehicle design specification satisfies requirements verification criteria under
specific assumptions. Preliminary analysis indicates that OWL 1.1 has the
potential to have a significant impact on systems engineering tools and processes.
We have, however, also discovered some shortcomings of OWL 1.1, at least with
respect to this application.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>The use of knowledge representation and reasoning in product development</title>
      <p>Systems engineering is a sufficiently complex domain that its vocabulary needs
formal definition. The meaning of concepts in engineering depends on consensus
of interpretation by domain experts. Sufficient precision regarding the meaning of
concepts is notoriously difficult to obtain. The multiplicity of languages and data
formats makes information integration a difficult and labour intensive task. This
is a common problem associated with other domains such as life sciences. Large
and complex ontologies are being developed and maintained in these domains.
Explicit representation of concepts in an ontology and reasoning based on the
ontology has been shown to provide essential support for the development of
ontologies and for their application in semantic integration. We believe that the
potential for reasoning within systems engineering includes, but goes beyond
information integration.</p>
      <p>Many systems engineering tasks directly involve reasoning. For example,
requirements for a product to be developed need to be checked for consistency: it is
not unheard of that requirements developed by multiple individuals and groups
are inconsistent. Further, at any given stage of a complex concurrent
development process, design artifacts are being produced using other design artifacts as
input. Even with rigid controls, immature or superseded inputs may be used to
produce some new design artifact, leading to inconsistency. Design artifacts can
easily be inconsistent with each other at a given time. Automated consistency
checking is therefore of great importance.</p>
      <p>The real test of reasoning in product development comes, however, when a
product which implements a design has been produced. The challenge is then to
verify that the product satisfies its requirements. Of course, this verification task
involves going outside any reasoning framework to perform analysis and make
measurements. However, reasoning is still needed to check that the accumulated
test results support the conclusion that the product which was tested actually
satisfies the requirements. Since these requirements are pervasive in engineering,
the potential payoff for using ontologies and reasoning in terms of saved cost
and schedule and elimination of rework is very high.</p>
      <p>
        When decisions which are based on complex technical information have
significant financial and legal implications, the correctness of conclusions and
credibility of argument has high significance. The accepted norm for correct reasoning
is to use a well understood logical framework consisting of a language and an
inference procedure, for example First Order Logic and resolution. From
statements in the language which are assumed to be true (axioms), conclusions are
derived using the inference procedure. The application of logic is often referred to
as formal methods [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The potential for use of logic in engineering goes beyond
providing a foundation for correctness of argument. The concept of proof in logic
is, again, the norm for representing the evidence for conclusions. A proof
provides an explanation for a logically derived consequence, which could be highly
relevant in engineering. For example, argument may be required to demonstrate
that satisfying a specific collection of test conditions is logically equivalent to
satisfying a requirement.
      </p>
      <p>
        For at least 30 years [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] formal methods have been put forward as the best
means to develop safe, reliable products that perform as expected. The reality
is that formal methods are in regular use in only a limited number of specialized
areas such as safety of flight control software [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and hardware design [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. One
reason for this state of affairs is that tools with wide usage must satisfy a range of
basic requirements for consideration in large scale complex product engineering
efforts. Other reasons have to do with finding a good logical framework and
engineering the framework to produce usable tools. A good logical framework
balances questions of expressiveness with the complexity of reasoning procedures.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Languages and tools for product development</title>
      <p>General requirements apply to all computer based languages and tools used
in large scale product development engineering. Application languages must be
somewhat intuitive to individuals with domain expertise, must be
standardsbased and must have good tool support. Tools must sufficiently simple to be used
by systems engineering practitioners with only basic training, and must scale for
large efforts. They must also have well defined interfaces for data exchange with
other tools. Most commercial tools used for system engineering satisfy these
requirements, or they do not receive much use.</p>
      <p>Current systems engineering languages and tools, however, lack a formal
semantics. This lack impedes the ability to integrate information from multiple
languages and tools. Further, there are no logical mechanisms to check if classes
are consistent, if one class is contained in another class, or if an individual is an
instance of a class.
3.1</p>
      <p>
        Why use OWL and why OWL 1.1?
Advances in the development of knowledge representation languages and
methodologies for engineering knowledge bases, the provision of these languages with
a formal semantics, the development of efficient reasoning algorithms, and the
adoption of OWL as a World Wide Web Consortium language standard, all
contribute the potential to realize the promise of formal methods within engineering.
In particular:
– OWL represents the culmination of more than 20 years of research aimed at
developing formal languages for conceptual modeling. As a result of this
research, the formal properties of the language are extremely well understood.
– OWL is a logical system with a formal semantics, and it is a fragment of
First Order Logics. In particular, the language has been designed so as to
be decidable (arbitrary queries can be answered) and to allow for sound
and complete implementations (implementations where positive and negative
answers can be given equal weight).
– OWL is a W3C standard language for Web ontologies, and has rapidly
become a de facto standard for ontology engineering in fields as diverse as
biology [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], medicine [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], geography [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], astronomy [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], agriculture [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], and
defence [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
– The standardization of OWL, along with the number and size of OWL
applications, has fuelled the development of OWL tools and
infrastructure, both academic and commercial, including editors such as Prot´eg´e 4.0
(http://protege.stanford.edu/) and Swoop [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], reasoners such as Pellet [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
FaCT++ [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], RACER [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], CEL [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], and KAON2 [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], APIs such as the
OWL API [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] and foundational ontologies such as DOLCE [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. These are
now sufficiently robust and scalable to be used in large-scale applications.
– We can draw on extensive experience of using OWL in the above-mentioned
applications, and in particular on experience using OWL and other
Description Logic based ontology languages to model complex physically structured
systems such as human anatomy, automobiles (Ford and Daimler Chrysler
[
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]) and even aircraft systems (Boeing [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]).
      </p>
      <p>The use of OWL 1.1 is not intended to replace system engineering languages
such as UML and SysM, or the use of 3D geometry languages, but to
augment these languages and serve as an integration framework. A Knowledge Base
(equivalently an OWL 1.1 ontology) can be used to represent product design and
requirements specifications as well as facts regarding product implementation,
testing, verification, and deployment.
3.2</p>
      <p>
        Why use a foundational ontology and why use DOLCE?
In the development of our air system ontology a lot of effort has been saved
through the use of a foundational ontology. The entities of interest in the
system engineering domain are very diverse. Air system engineering entities include
physical objects and their qualities, as well as events, plans, descriptions, and
test results. An engineering ontology requires the representation of structural
aspects and properties of products. In addition, the ontology will need to
represent artifacts such as specifications for products and tests to be performed
on products. The usefulness of a foundational ontology is also documented in
application areas such as life sciences [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ].
      </p>
      <p>In our case we are making extensive use of the DOLCE Ultra Lite (DUL)
foundational ontology. Our air system ontology is constructed by specializing
classes and roles in DUL. The structure of and constraints on DUL classes and
roles have been carefully worked out, and DUL can be readily loaded in Prot´eg´e
4.0. For example, we use and build on partOf and hasPart properties for
specifying product structure. We use Quality to represent attributes and characteristics
of product components. There are some specific concepts in other foundational
ontologies that would be worth adopting and we plan to make use of these as
we proceed. DOLCE entities not only include objects, both physical and
social, events, but also descriptions of objects and events. These classes such as
Description and Situation are useful to classify descriptions of test setups and
occurrences of test processes with their observed/measured results.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Benefits and Shortcomings of OWL 1.1</title>
      <p>Using OWL and DUL classes works well for representation of product structure
and (static) properties. Class constructors allowed us to define classes of physical
objects with structural properties (using partOf relations) and specify properties
(using Quality with measured or computed values in Region).</p>
      <p>For requirements that consist of structural properties and characteristics,
we have been able to define classes and verify that the (requirements) class is
consistent. We have been able to define classes characterized by generic instances
(e.g., a design class) and construct a generic instance (in the ABox). We can then
go outside the logic and measure, analyze and simulate in order to conclude (and
then assert in the ABox) some additional properties of the instance. Finally, we
can use the reasoner to check if the extended generic instance is consistent with
the requirements and/or provably satisfies them.</p>
      <p>Some of the new features of OWL 1.1 were useful or even crucial in our
application. In representing the physical structure of an air vehicle, for example,
we encounter many of the same problems that arise in medicine when describing
anatomy. In this part of the model various kinds of part-whole properties play
an important role, and the complex role inclusions of OWL 1.1 are of crucial
importance in allowing us to transfer properties and constraints from parts to
wholes and vice versa.</p>
      <p>
        The extended support for datatypes in OWL 1.1 is critical in engineering
applications. Numerous design constraints relate to concrete values such as weight,
speed, temperature, distance etc. Some also relate to more complex datatypes,
for example datatypes representing shapes or complex performance measures.
N-ary datatype predicates might be useful for comparing values, but more
powerful mechanisms, such as aggregation, would be needed in general. For example,
the weight of a physical object can be calculated in multiple ways. Weight can
be estimated, measured (using a scale) or calculated from the sum of the weights
of components. A rule stating that the weight of a product is the sum of the
weights of its components is not easily expressed in OWL 1.1, although DL-safe
rules might be used if their restricted applicability (i.e., to ABox individuals)
proved to be acceptable [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Verification that a product satisfies some weight
requirement, using the weight rule, must therefore be done externally to OWL.
      </p>
      <p>When huge amounts of money, and even lives, may depend on the behaviour
of an information system, tracking the provenance of both explicit and implicit
information is of great importance. The improved annotations capabilities of
OWL 1.1 are therefore of great importance—one needs to know where
information came from and when. Explanations and/or proofs that show how implicit
information has been derived will also be important, perhaps even essential.</p>
      <p>Another observation is that representing dynamic properties of products,
such as the change in fuel level during flight operation of an air vehicle, presents
problems for OWL 1.1. Dynamic properties are properties that change with
respect to time or some operational context. DUL provides concepts needed to
represent behavior, but a more expressive language (such as FOL) seems to be
required in order to fully model behavioral requirements and test results relating
to behaviors.</p>
      <p>With respect to OWL tools, improved interfaces to other computation
systems would be very useful. For example, it would be very useful to be able to
interface to an external database containing a parts list. On the one hand, it
may be useful for the DB system to query the semantic framework about the
configuration description to determine properties of the parts in the DB. On the
other hand, where a database contains a parts list corresponding to a potential
air vehicle configuration one would like the OWL tool to create in the ontology
a product instance corresponding to the configuration; the reasoner could then
be used to verify that the instance is consistent with and/or provably satisfies
the design requirements.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Achievements and lessons learned</title>
      <p>OWL 1.1 is not a replacement for Systems Engineering languages (e.g., SysML)
and tools, but OWL 1.1 is a good candidate for defining Classes and relationships
that can be used to describe products, and for semantic integration. The formal
semantics provides a precise notion of meaning. Reasoning can be used to aid
testing and verification. The serialisation of OWL 1.1 using XML schemas may
facilitate the exchange of data between systems, but issues need to be resolve
regarding interface to external systems. Given that a DL based system is unlikely
to meet all the requirements in this large and complex domain, an architecture
is needed for integration the of DL based systems with not-DL logics and other
computational systems, including, but not limited to, database systems.</p>
      <p>
        In spite of the difficulties mentioned in Section 4, we have been successful
in using FaCT++ for simple reasoning experiments to show consistency or
inconsistency of product descriptions. This is very promising as current systems
engineering tools are not able to perform this kind of check. We are still
experimenting with how best to divide the modeling and reasoning tasks between
the TBox and the ABox: the former allows for gradual refinement and varying
granularity, but the latter allows for the more precise description of complex
relational structures. Recent work on representing structured objects in OWL
might be of great interest in this respect [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
      </p>
      <p>We are also investigating the use of the ontology to optimise testing. A
typical issue for product verification is how to use the requirements decomposition
tree constructed as part of the design process to determine test conditions with
expected results that are used as input to the test planning process. Each test
description describes a collection of input and output parameters to some
operational process such as detecting and identifying objects within some area of
interest. For example, a test may be to measure the accuracy of an air vehicle
radar to detect and identify objects on the ground. The input parameters to the
detection and identifying process describe aspects of the air vehicle operating
environment. A specific test supplies values for the input parameters and obtains
values for the output parameters. Representing features of tests could possibly
be used to try to minimize redundancy by recognizing when, say, a conjunction
of tests subsumes some other test.</p>
      <p>Our ontology development effort is still in its beginning stages. However, we
can identify areas whether further language and tool development would be of
great use.</p>
      <p>
        Ontology Management Development of ontologies for large complex systems
involves many subdomains and disciplines. Each domain or discipline may have
its own ontology. The overall process of product development will at any given
time be using a unification of some of these ontologies. Changes will inevitably
need to be made to individual ontologies and so mechanisms are needed to
manage multiple ontologies by including or excluding them and tracking which
ontologies were in force when specific conclusions were reached. Recent work on
modularity will clearly be of great interest in this regard [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
      <p>Explanation and Annotation As mentioned above, improved annotations
are important as we go forward—one needs to know where information came
from and when. Also explanations and/or proofs will be important in order to
understand the provenance of implicit information. With the current methods
being used in OWL theorem provers, it might seem unlikely that a machine
constructed proof would be understandable. However, there is research which
correlates model theoretic proof results with natural deduction results. This
correspondence could perhaps be used to construct proofs to be used for evidence
purposes.</p>
      <p>Need for modularization Another potentially relevant strand of research
for OWL application is modularization. It would be useful to check if different
components and features that are to be tested are completely independent of
each other and so can be tested completely independently. If you can show that
tests A and B are independent, then costs can be saved by reducing the number
of different combinations of tests that need to be carried out. Elimination of test
costs is of great concern in product development.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>H.</given-names>
            <surname>Graves</surname>
          </string-name>
          .
          <article-title>Ontology engineering for product development</article-title>
          .
          <source>In Proc. of the Third OWL Experiences and Directions Workshop</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Dmitry</given-names>
            <surname>Tsarkov</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ian</given-names>
            <surname>Horrocks</surname>
          </string-name>
          .
          <article-title>FaCT++ description logic reasoner: System description</article-title>
          .
          <source>In Proc. of the Int. Joint Conf. on Automated Reasoning (IJCAR</source>
          <year>2006</year>
          ), volume
          <volume>4130</volume>
          <source>of Lecture Notes in Artificial Intelligence</source>
          , pages
          <fpage>292</fpage>
          -
          <lpage>297</lpage>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>C.</given-names>
            <surname>Holloway</surname>
          </string-name>
          .
          <article-title>Why engineers should consider formal methods</article-title>
          .
          <source>In Proc. of 16th Digital Avionics Systems Conference</source>
          ,
          <year>October 1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>C.</given-names>
            <surname>Hoare</surname>
          </string-name>
          .
          <article-title>An axiomatic basis for computer programming</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>12</volume>
          :
          <fpage>576</fpage>
          -
          <lpage>580</lpage>
          ,
          <year>1969</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>M.</given-names>
            <surname>Blackburn</surname>
          </string-name>
          .
          <article-title>Using models for test generation and analysis</article-title>
          .
          <source>In Proc. of 17th Digital Avionics Systems Conference</source>
          ,
          <year>October 1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>C.</given-names>
            <surname>Kern</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Greenstreet</surname>
          </string-name>
          .
          <article-title>Formal verification in hardware design: A survey</article-title>
          .
          <source>ACM Trans. on Design Automation of Electronic Systems</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Amandeep</given-names>
            <surname>Sidhu</surname>
          </string-name>
          , Tharam Dillon,
          <string-name>
            <given-names>Elisabeth</given-names>
            <surname>Chang</surname>
          </string-name>
          , and
          <article-title>Baldev Singh Sidhu</article-title>
          .
          <article-title>Protein ontology development using OWL</article-title>
          .
          <source>In Proc. of the First OWL Experiences and Directions Workshop</source>
          , volume
          <volume>188</volume>
          <source>of CEUR Workshop Proceedings</source>
          . CEUR (http://ceur-ws.
          <source>org/)</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Christine</given-names>
            <surname>Golbreich</surname>
          </string-name>
          , Songmao Zhang, and
          <string-name>
            <given-names>Olivier</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          .
          <article-title>The foundational model of anatomy in OWL: Experience and perspectives</article-title>
          .
          <source>J. of Web Semantics</source>
          ,
          <volume>4</volume>
          (
          <issue>3</issue>
          ),
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>John</given-names>
            <surname>Goodwin</surname>
          </string-name>
          .
          <article-title>Experiences of using OWL at the ordnance survey</article-title>
          .
          <source>In Proc. of the First OWL Experiences and Directions Workshop</source>
          , volume
          <volume>188</volume>
          <source>of CEUR Workshop Proceedings</source>
          . CEUR (http://ceur-ws.
          <source>org/)</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>S.</given-names>
            <surname>Derriere</surname>
          </string-name>
          , A. Richard, and
          <string-name>
            <given-names>A.</given-names>
            <surname>Preite-Martinez</surname>
          </string-name>
          .
          <article-title>An ontology of astronomical object types for the virtual observatory</article-title>
          .
          <source>Proc. of Special Session 3 of the 26th meeting of the IAU: Virtual Observatory in Action: New Science, New Technology, and Next Generation Facilities</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Dagobert</surname>
            <given-names>Soergel</given-names>
          </string-name>
          , Boris Lauser, Anita Liang, Frehiwot Fisseha, Johannes Keizer, and
          <string-name>
            <given-names>Stephen</given-names>
            <surname>Katz</surname>
          </string-name>
          .
          <article-title>Reengineering thesauri for new applications: The AGROVOC example</article-title>
          .
          <source>J. of Digital Information</source>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Lee</surname>
            <given-names>Lacy</given-names>
          </string-name>
          , Gabriel Aviles, Karen Fraser,
          <string-name>
            <given-names>William</given-names>
            <surname>Gerber</surname>
          </string-name>
          , Alice Mulvehill, and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Gaskill</surname>
          </string-name>
          .
          <article-title>Experiences using OWL in military applications</article-title>
          .
          <source>In Proc. of the First OWL Experiences and Directions Workshop</source>
          , volume
          <volume>188</volume>
          <source>of CEUR Workshop Proceedings</source>
          . CEUR (http://ceur-ws.
          <source>org/)</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Aditya</surname>
            <given-names>Kalyanpur</given-names>
          </string-name>
          , Bijan Parsia, Evren Sirin,
          <article-title>Bernardo Cuenca-Grau, and James Hendler. SWOOP: a web ontology editing browser</article-title>
          .
          <source>J. of Web Semantics</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. E.
          <string-name>
            <surname>Sirin</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B. Cuenca</given-names>
          </string-name>
          <string-name>
            <surname>Grau</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kalyanpur</surname>
            , and
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Katz. Pellet</surname>
          </string-name>
          :
          <article-title>A practical OWL-DL reasoner</article-title>
          .
          <source>J. of Web Semantics</source>
          ,
          <volume>5</volume>
          (
          <issue>2</issue>
          ):
          <fpage>51</fpage>
          -
          <lpage>53</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <article-title>Volker Haarslev and Ralf M¨oller. RACER system description</article-title>
          .
          <source>In Proc. of the Int. Joint Conf. on Automated Reasoning (IJCAR</source>
          <year>2001</year>
          ), volume
          <volume>2083</volume>
          <source>of Lecture Notes in Artificial Intelligence</source>
          , pages
          <fpage>701</fpage>
          -
          <lpage>705</lpage>
          . Springer,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Franz</surname>
            <given-names>Baader</given-names>
          </string-name>
          , Carsten Lutz, and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>CEL-a polynomial-time reasoner for life science ontologies</article-title>
          . In U. Furbach and N. Shankar, editors,
          <source>Proc. of the Int. Joint Conf. on Automated Reasoning (IJCAR</source>
          <year>2006</year>
          ), volume
          <volume>4130</volume>
          <source>of Lecture Notes in Artificial Intelligence</source>
          , pages
          <fpage>287</fpage>
          -
          <lpage>291</lpage>
          . SV,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>Boris</given-names>
            <surname>Motik</surname>
          </string-name>
          .
          <article-title>Reasoning in Description Logics using Resolution and Deductive Databases</article-title>
          .
          <source>PhD thesis</source>
          , Univesit¨at Karlsruhe (TH), Karlsruhe, Germany,
          <year>January 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Sean</surname>
            <given-names>Bechhofer</given-names>
          </string-name>
          , Raphael Volz, and
          <string-name>
            <given-names>Phillip</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>Cooking the semantic web with the OWL API</article-title>
          . In Dieter Fensel, Katia Sycara, and John Mylopoulos, editors,
          <source>Proc. of the 2nd International Semantic Web Conference (ISWC</source>
          <year>2003</year>
          ), volume
          <volume>2870</volume>
          of Lecture Notes in Computer Science. Springer,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Aldo</surname>
            <given-names>Gangemi</given-names>
          </string-name>
          , Nicola Guarino, Claudio Masolo, Alessandro Oltramari, and
          <string-name>
            <given-names>Luc</given-names>
            <surname>Schneider</surname>
          </string-name>
          .
          <article-title>Sweetening ontologies with DOLCE</article-title>
          .
          <source>In Proc. of EKAW</source>
          <year>2002</year>
          , pages
          <fpage>166</fpage>
          -
          <lpage>181</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>Nestor</given-names>
            <surname>Rychtyckyj</surname>
          </string-name>
          . DLMS:
          <article-title>An evaluation of KL-ONE in the automobile industry</article-title>
          .
          <source>In Proc. of the 5th Int. Conf. on the Principles of Knowledge Representation and Reasoning (KR'96)</source>
          , pages
          <fpage>588</fpage>
          -
          <lpage>596</lpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Michael</surname>
            <given-names>Uschold</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Clark</surname>
          </string-name>
          , Fred Dickey, Casey Fung,
          <string-name>
            <given-names>Sonia</given-names>
            <surname>Smith</surname>
          </string-name>
          , Stephen Uczekaj Michael Wilke, Sean Bechhofer, and
          <string-name>
            <given-names>Ian</given-names>
            <surname>Horrocks</surname>
          </string-name>
          .
          <article-title>A semantic infosphere</article-title>
          . In Dieter Fensel, Katia Sycara, and John Mylopoulos, editors,
          <source>Proc. of the 2nd International Semantic Web Conference (ISWC</source>
          <year>2003</year>
          ), volume
          <volume>2870</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>882</fpage>
          -
          <lpage>896</lpage>
          . Springer,
          <year>2003</year>
          . Presentation available from http://www.cs.man.ac.uk/∼horrocks/Slides/ ISWC-Presentation-SemanticFiltering.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Boris</surname>
            <given-names>Motik</given-names>
          </string-name>
          , Ulrike Sattler, and
          <string-name>
            <given-names>Rudi</given-names>
            <surname>Studer</surname>
          </string-name>
          .
          <article-title>Query answering for owl-dl with rules</article-title>
          .
          <source>J. of Web Semantics</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ):
          <fpage>41</fpage>
          -
          <lpage>60</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Boris</surname>
            <given-names>Motik</given-names>
          </string-name>
          , Bernardo Cuenca Grau, and
          <string-name>
            <given-names>Uli</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Structured objects in owl: Representation and reasoning</article-title>
          .
          <source>In Proc. of the Seventeenth International World Wide Web Conference (WWW</source>
          <year>2008</year>
          ). ACM Press,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24. Bernardo Cuenca Grau, Ian Horrocks, Yevgeny Kazakov, and
          <string-name>
            <given-names>Ulrike</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Modular reuse of ontologies: Theory and practice</article-title>
          .
          <source>J. of Artificial Intelligence Research</source>
          ,
          <volume>31</volume>
          :
          <fpage>273</fpage>
          -
          <lpage>318</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>