<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Exploiting Fast Classification of SNOMED CT for Query and Integration of Health Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Michael J. Lawley</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Queensland University of Technology, Faculty of Information Technology</institution>
          ,
          <addr-line>Brisbane, (Queensland)</addr-line>
          ,
          <institution>Australia E-Health Research Centre, CSIRO ICT Centre</institution>
          ,
          <addr-line>(Queensland)</addr-line>
          ,
          <country country="AU">Australia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2008</year>
      </pub-date>
      <fpage>8</fpage>
      <lpage>14</lpage>
      <abstract>
        <p>By constructing local extensions to SNOMED we aim to enrich existing medical and related data stores, simplify the expression of complex queries, and establish a foundation for semantic integration of data from multiple sources. Specifically, a local extension can be constructed from the controlled vocabulary(ies) used in the medical data. In combination with SNOMED, this local extension makes explicit the implicit semantics of the terms in the controlled vocabulary. By using SNOMED as a base ontology we can exploit the existing knowledge encoded in it and simplify the task of reifying the implicit semantics of the controlled vocabulary. Queries can now be formulated using the relationships encoded in the extended SNOMED rather than embedding them ad-hoc into the query itself. Additionally, SNOMED can then act as a common point of integration, providing a shared set of concepts for querying across multiple data sets. Key to practical construction of a local extension to SNOMED is appropriate tool support including the ability to compute subsumption relationships very quickly. Our implementation of the polynomial algorithm for E L+ in Java is able to classify SNOMED in under 1 minute.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>
        Experience with integrating medical and related
data [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] shows that the use of controlled
vocabularies successfully modulates the amount of noise
in the data. However, when querying the
collected data, any semantic relationships between
the terms that are relevant to the query (for
example, specialisation/generalisation or part-of
relationships) need to be explicitly encoded in the
query and/or accounted for in the interpretation
of the query results.
      </p>
      <p>These kinds of implicit relationships are especially
common in the health domain where terms often
involve an implicit context of usage (e.g., lobe in
the context of lung cancer) or implicit references to
anatomical structures (e.g., colorectal cancer) or
related classes of diseases, injuries, or procedures.
Accurately and consistently encoding these
relationships in queries relies on the person
formulating the queries to understand them, thus creating
many opportunities for errors, omissions, and
inconsistencies to occur. When multiple people are
constructing queries these risks are further
exacerbated.</p>
      <p>
        By constructing the vocabularies so as to explicitly
represent the relationships between terms, queries
can directly and consistently exploit the
relationships. Using an ad-hoc explicit representation of
these relationships helps, but may introduce new
problems in terms of consistency of usage and how
the relationships are interpreted (see, for example,
the Radiological Electronic Atlas of Malformation
Syndromes and Skeletal Dysplasias (REAMS) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]).
Instead, using a well-understood formal
mechanism for representing the relationships, such as
Description Logic, can avoid these problems.
However we still have two problems to solve:
1. how do we deal with all the existing data sets
that do not do this; and
2. how do we mitigate the, potentially quite high1,
cost of explicitly representing all the
relationships?
We can deal with both these problems by
extending (as needed) an existing standard
ontology, such as the Systematized Nomenclature of
Medicine (SNOMED) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], that already embodies
1Getting the modelling right, from scratch, requires
not only an excellent understanding of the concepts
involved as well as their relationships, but also an
understanding of how best to represent them in a particular
Description Logic formalism.
many of the relationships we need. However, one
of the main difficulties with this approach is that
building an extension to SNOMED is not
dissimilar to maintaining and developing SNOMED
itself. That is, the sheer size of SNOMED has
meant that, until recently, very few tools could
compute all of its subsumption relationships, and
even those that could would reportedly take
several hours.
      </p>
      <p>
        Fortunately, recent work by Baader et al. [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ]
on the tractable family of description logics E L
has shown that polynomial time classification
algorithms exist and are practical. Moreover despite
their relatively low expressive power, the E L
family of description logics is suitable for
representing such real-world ontologies as SNOMED and
offer additional expressiveness suitable for
properly representing partOf relationships and
sufficient conditions.2 Their implementation of this
algorithm in Lisp is able to classify SNOMED in
1,782 seconds [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] (approx. 30 minutes) which
suggests an optimised implementation in a lower-level
language may be fast enough for near real-time
feedback in an editing tool.
      </p>
      <p>Thus, our goal is to provide tool support for
defining a local extension to an existing standard formal
ontology; a mapping from an existing set of terms
that characterise an informal ontology to concepts
in the formal ontology. In doing so we effectively
realise latent semantics in the existing medical
data via the standard ontology. This should
facilitate simpler and more robust queries and in turn
aid data integration, a special-case application of
querying where related medical data sets use
semantically overlapping, but distinct term sets.</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
      <p>
        There is a great deal of published work on using
ontologies for data integration (see Wache et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
for an overview), but it is mostly focussed on their
use at the meta-data level; ontologies are used
to describe, reason about and integrate database
schemas. While related to our goals, we are
addressing the more specific problem of semantic
data integration or semantic translation.
Stuckenschmidt et al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] discuss an approach to this
problem in the context of their Ontology Interchange
Language (OIL) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. In particular they raise the
question of whether it is feasible to find or
create a sufficient shared terminology. In our domain
of medical data we believe that SNOMED
represents such a shared terminology. A possibly more
2See also
tractable.html#2
http://webont.org/owl/1.1/
important problem, and one identified in our work
with skeletal dysplasias [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], is how to cope with
errors in the shared terminology.
      </p>
      <p>
        Wade and Rosenbloom [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] report on the
manual construction of what is almost a local
extension to SNOMED (they conceived the task as a
semi-formal mapping). In this work 2002 terms
were mapped to combination of single and
postcoordinated concepts of which about 75% were
equivalencies (20% of these were to single
concepts) and only 1% (26) were, in their words, “not
mappable”. It is unclear why these terms were
categorized as such since they include, for example,
presyncope which could reasonably be related to
3006004|disturbance of consciousness|, but it may
be that the context of use of the terms was
unavailable in order to properly discern their meaning.
However, their work does demonstrate that the
goal of producing a local extension to SNOMED
is feasible.
      </p>
    </sec>
    <sec id="sec-3">
      <title>PROBLEM</title>
    </sec>
    <sec id="sec-4">
      <title>DESCRIPTION</title>
      <p>The problem of embedding domain semantics such
as specialisation/generalisation or part-of
relationships into queries is illustrated in the following.
For example, a query to find all performed
procedures involving a colectomy might enumerate all
such procedures:</p>
      <sec id="sec-4-1">
        <title>SELECT S.*</title>
      </sec>
      <sec id="sec-4-2">
        <title>FROM Surgery S</title>
        <p>WHERE S.procedure = ’32003-00’</p>
        <p>OR S.procedure = ’32003-01’
OR S.procedure = ’32012-00’
...
which has the potential to accidently omit certain
codes and will require updating if the terminology
is updated with additional forms of colectomy.
Alternatively, some kind of heuristic query could
be used:</p>
      </sec>
      <sec id="sec-4-3">
        <title>SELECT S.*</title>
      </sec>
      <sec id="sec-4-4">
        <title>FROM Surgery S, ProcedureCodes C</title>
        <p>WHERE S.procedure = C.code</p>
      </sec>
      <sec id="sec-4-5">
        <title>AND C.text LIKE ’%colectomy%’;</title>
        <p>which has the potential to miss a term that doesn’t
follow the expected naming pattern (e.g.,
epiploectomy) or provide false matches where a compound
or composite name does not reflect a valid
specialisation.</p>
        <p>If, however, the terms were encoded as concepts
in an ontology, the query is simple3:</p>
        <p>3We envisage that the complete set of subsumption
relationships would be stored in a database table to
support fast subsumption-based queries using only two</p>
      </sec>
      <sec id="sec-4-6">
        <title>SELECT S.*</title>
      </sec>
      <sec id="sec-4-7">
        <title>FROM Surgery S, Ontology O WHERE O.ancestor = 23968004 AND S.procedure = O.descendant;</title>
        <p>Note also that SNOMED, unlike classification
schemes such as ICD-9 and ICD-10, support a
multi-parented generalisation hierarchy.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>CONSTRUCTING LOCAL</title>
    </sec>
    <sec id="sec-6">
      <title>EXTENSIONS</title>
      <p>In order to construct an ontology from an
existing terminology (or collection of terminologies) we
take a multi-step approach:
1. Map each term from the controlled vocabulary
to a concept, factoring out any synonyms, to
produce P.</p>
      <p>This is often a simple one-to-one mapping, but
it may be necessary to extend the mapping to
include disambiguating data values when the
same term is used to mean different things in
different contexts.
2. Make any simple implicit relationships explicit,
adding them to P.</p>
      <p>For example, generalisation, partOf, or
hasLocation relationships. It may be necessary to
introduce new concepts to act as the generalisation
of two or more sibling concepts.
3. Specify relationships between these (local)
concepts and those in the chosen standard ontology
Q, adding them to P.</p>
      <p>
        To be able to answer queries involving our new
ontology we first need to classify Q ∪ P to identify
all the subsumption relationships it entails.
Note that, we should be careful that Q ∪ P
represents a conservative extension [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] of Q. That is,
Q ∪ P produces the same consequences over the
set of concepts in Q as Q does by itself. We also
need to ensure various integrity constraints (such
as disjointness) are preserved in Q ∪ P. Thus we
would like to be able to interactively edit P while
exploiting the consequences of Q ∪ P in live
feedback through the mapping tool. These kinds of
checks can be performed by classification of Q ∪ P
but this may not be viable if Q ∪ P is large, as is
the case when Q is SNOMED.
      </p>
      <sec id="sec-6-1">
        <title>Colorectal Cancer Example</title>
        <p>
          In this section we consider a sample set of
ICD-10AM [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] terms for procedures relating to colorectal
joins.
The next step is to make any simple relationship
explicit. In our case there are none that can be
expressed using just the concepts we have currently
identified.
cancer, shown in Figure 1. We can map these,
oneto-one, to a set of concepts for a local ontology.
        </p>
        <p>Procedure Code Meaning
(ICD-10-AM)
32000-00
So far we have only considered simple query
scenarios where a single database column
represents the concept we wish to query
(e.g., Surgery.procedure) and there already
exists a concept that characterises the bound of the
query (e.g., 2396804).</p>
        <p>Consider instead a table, as shown in Figure 4,
that stores both scheduled and performed
procedures while using another column to distinguish
them, and which encodes laterality, if any, of the
procedure in yet another column. Now imagine
we wish to query for all patients who have had an
amputation including the left hand.</p>
        <sec id="sec-6-1-1">
          <title>Patient</title>
          <p>. . .</p>
        </sec>
        <sec id="sec-6-1-2">
          <title>Date</title>
          <p>. . .</p>
        </sec>
        <sec id="sec-6-1-3">
          <title>Status</title>
          <p>. . .</p>
        </sec>
        <sec id="sec-6-1-4">
          <title>Procedure</title>
          <p>. . .</p>
        </sec>
        <sec id="sec-6-1-5">
          <title>Laterality</title>
          <p>. . .
To support this kind of problem with reasonable
generality and decent query speed, we need to
generate a new column containing codes that are
mapped to the set of compound concepts that
correspond to the contextualised meaning of each
database row. Hence, as shown in Figure 5, the
table from Figure 4 would be extended with a Code
foreign-key column, and an additional table
containing the SNOMED expressions of the form4:
∃ associatedProcedure. P
∃ laterality. L
∃ procedureContext. S
which gives us another ontology extension that we
can add to SNOMED.</p>
          <p>Finally, in order to be able to pose a
subsumptionbased complex query involving composite concepts
and have it evaluated at database join speeds, we
can employ the same strategy: extend the
ontology with a new fully-defined concept
corresponding to our query expression, re-classify, and
perform a join-based query using the new concept.
The need to construct compound expressions that
explicitly represent the context associated with a
record in a database occurs any time the data
needs to be queried outside its original context.
This may happen in as trivial a case as when one
table in a database is joined with another, but
the more general scenario occurs when integrating
data from multiple data sources.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>RESULTS</title>
      <sec id="sec-7-1">
        <title>Classifying SNOMED</title>
        <p>The practicality of creating local extensions of
SNOMED is dependent on sufficient tool support
and, as mentioned previously, a cornerstone of this
is fast classification. Indeed we believe that near
real-time feedback in an editing environment, be
it an IDE for programming or a 3D architectural
modelling tool, can have a transformational effect
on the authoring and editing process.</p>
        <p>
          To this end, we have implemented snorocket, using
a slightly altered form of the algorithm in [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]
written in Java. We use several optimised Map and
Set data-structures tailored for ontologies with
roughly the same number of concepts and roles as
SNOMED. This implementation is able to classify
4Note that considerable experience with SNOMED
and all its documentation may be required to construct
suitable valid post-coordinated expressions like those
above. Tool support for this is clearly an important
issue and recent work in the IHTSDO Concept Model
SIG on producing a Machine Readable Concept Model
will be valuable for this.
SNOMED in 54 seconds on a modern 2.4GHz
Intel Core 2 Duo running Windows XP and Sun’s
Java 1.6.0 03.
        </p>
        <p>For a fairer comparison with CEL, which only
runs under Linux, we ran both snorocket and
CEL on an older four-CPU Xeon 3.6GHz
machine running RedHat Linux 2.6.9 and Sun’s Java
1.6.0 04. The results, for several of the ontologies
available from http://lat.inf.tu-dresden.de/
~meng/toyont.html, are in Table 1.</p>
        <p>Clearly, being able to classify SNOMED in close
to a minute is a substantial improvement over
roughly 23 minutes and brings us much closer to
the near real-time feedback we are seeking.</p>
      </sec>
      <sec id="sec-7-2">
        <title>Incremental Classification</title>
        <p>In our mapping scenario we observe that
SNOMED (Q) is unchanging while the local
extension (P) is modified. If we can classify Q once
and record the result C(Q) then, due to the
monotonicity of the description logic, the classification
of Q ∪ P, C(Q ∪ P), is a superset of C(Q). The
goal is then to derive C(Q ∪ P) given C(Q) (and,
of course, Q and P) which should be much faster
than deriving C(Q ∪ P) from scratch.</p>
        <p>
          Suntisrivaraporn [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] calls this Duo-Ontology
Classification and presents a variation of the
algorithm in [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] to do just this. We have
independently derived our own variant of this algorithm
along similar lines; the queue-processing core is
essentially unchanged but the initialisation of the
queues is different to account for the work that has
already been done.
        </p>
        <p>
          Currently this work is in a preliminary state and
the correspondence with the variant described
in [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] is unknown. However the performance
of this incremental algorithm is very promising.
With P consisting of the 14 new concepts as
defined as in Figure 2, incremental classification
takes around 0.9s using our un-optimised
implementation.
        </p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>DISCUSSION</title>
      <p>
        Ideally, as a term set is developed, it would be
explicitly constructed as an ontology and, to avoid
re-invention and promote interoperability, could
be developed as an extension of an existing
standard ontology such as SNOMED. These
extension ontologies could then be shared and evolved
within their specialist community while still being
useful and usable in more general communities.
One such example is an ontology for skeletal
dysplasias extracted from REAMS [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        It is thus useful to be able to represent these
ontologies in a standard format such as OWL so
that they can be shared or manipulated using
existing toolsets. Currently we use the OWL 1.1
proposal [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] rather than OWL 1.0 since it
supports the expression of the role axioms (to
describe role transitivity and right-identity). The
particular subset we use is characterised by the
description logic E L+⊥. OWL 1.1 is supported
by, for example, the latest development-release of
Prot´eg´e (4.0 alpha).
      </p>
      <p>Unfortunately, OWL is not practical for
representing large ontologies like SNOMED where an OWL
CEL
snorocket</p>
      <p>SNOMED
1391.9
72.8</p>
      <p>FULL-GALEN
368.9
15.1</p>
      <p>
        NOT-GALEN
5.4
0.4
XML representation is approximately 240MB [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ],
about eight times the size of the equivalent KRSS
representation. Moreover, due to the complexities
inherent in parsing XML, it is much slower to load
and parse than a simpler format such as KRSS.
One work-around for this, and something that
would greatly benefit the e-health community,
would be for the International Health Terminology
Standards Development Organisation, the newly
formed governing body of SNOMED, to formally
publish URIs for the concepts in SNOMED. This
would allow tool vendors to “bake in” SNOMED
to their tools, while still allowing other
OWLbased ontologies to reference SNOMED concepts
in a consistent and interoperable manner in order
to describe extensions to SNOMED.
      </p>
    </sec>
    <sec id="sec-9">
      <title>CONCLUSION</title>
      <p>Our preliminary work on producing local
extensions to SNOMED for semantic data
integration is promising as is the performance of our
classifier. The current implementation is
singlethreaded and we anticipate a further speed
increase from a multi-threaded implementation
running on a multi-core CPU.</p>
      <p>We are currently integrating snorocket with a
3rdparty SNOMED editing tool which requires
specific support for SNOMED’s use of role grouping
and the ability to distinguish between stated and
inferred relationships in the output of the
classifier, although this adds little overhead to the
classification time. In addition, we are
prototyping mapping tools specifically targeting the task of
constructing local extensions of SNOMED from
existing data.</p>
      <p>Finally, we are continuing work on our incremental
form of the algorithm but have not yet tuned or
verified the implementation. Preliminary results
indicate that this approach should be very useable
when integrated with our mapping tool.</p>
    </sec>
    <sec id="sec-10">
      <title>Acknowledgements</title>
      <p>The work described in this paper was carried out while
on secondment to the CSIRO’s E-Health Research
Centre and the author would like to gratefully
acknowledge the support of David Hansen and the other
members of the Health Data Integration team.</p>
    </sec>
    <sec id="sec-11">
      <title>Address for Correspondence</title>
      <p>Michael J. Lawley, Faculty of Information Technology,
University of Queensland, 126 Margaret Street
Brisbane Qld 4000, Australia
m.lawley@qut.edu.au</p>
      <p>Conservative Extensions in Description
Logics. In Patrick Doherty, John Mylopoulos,
and Christopher Welty, editors, Proceedings of
the Tenth International Conference on
Principles of Knowledge Representation and
Reasoning (KR’06), pages 187–197. AAAI Press,
2006. http://lat.inf.tu-dresden.de/~clu/
papers/archive/kr06a.pdf.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Hansen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Daly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Harrop</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. O'Dwyer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Pang</surname>
          </string-name>
          , and J.
          <string-name>
            <surname>Ryan-Brown</surname>
          </string-name>
          . HDI: Research Software To Commercial Product.
          <source>ASWEC 2005 Industry Experience Papers</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>I.</given-names>
            <surname>Jakobsen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.J.</given-names>
            <surname>Lawley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Zankl</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Hansen</surname>
          </string-name>
          .
          <article-title>Ontologies for Skeletal Dysplasias</article-title>
          .
          <source>MedInfo 2007 Workshop: MedSemWeb</source>
          <year>2007</year>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Snomed</given-names>
            <surname>Clinical Terms</surname>
          </string-name>
          . College of American Pathologists,
          <year>2006</year>
          . http://www.snomed.org.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>CEL-a polynomial-time reasoner for life science ontologies</article-title>
          . In U. Furbach and N. Shankar, editors,
          <source>Proceedings of the 3rd International Joint Conference on Automated Reasoning (IJCAR'06)</source>
          , volume
          <volume>4130</volume>
          <source>of Lecture Notes in Artificial Intelligence</source>
          , pages
          <fpage>287</fpage>
          -
          <lpage>291</lpage>
          . Springer-Verlag,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Efficient Reasoning in EL+</article-title>
          .
          <source>In Proceedings of the 2006 International Workshop on Description Logics (DL2006)</source>
          , CEURWS,
          <year>2006</year>
          . http://lat.inf.tu-dresden.de/ research/papers/2006/BaaLutSun-DL-
          <volume>06</volume>
          .pdf.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Wache</surname>
          </string-name>
          , T. V¨ogele, U. Visser,
          <string-name>
            <given-names>H.</given-names>
            <surname>Stuckenschmidt</surname>
          </string-name>
          , G. Schuster,
          <string-name>
            <given-names>H.</given-names>
            <surname>Neumann</surname>
          </string-name>
          , and
          <string-name>
            <surname>S.</surname>
          </string-name>
          <article-title>Hu¨bner. Ontology-based integration of information-a survey of existing approaches</article-title>
          .
          <source>IJCAI-01 Workshop: Ontologies and Information Sharing</source>
          ,
          <year>2001</year>
          :
          <fpage>108</fpage>
          -
          <lpage>117</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>H.</given-names>
            <surname>Stuckenschmidt</surname>
          </string-name>
          .
          <article-title>Catalogue Integration: A Case Study in Ontology-based Semantic Translation</article-title>
          . Vrije Universiteit, Faculteit der Exacte Wetenschappen,
          <source>Divisie Wiskunde &amp; Informatica</source>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Dieter</given-names>
            <surname>Fensel</surname>
          </string-name>
          , Ian Horrocks, Frank van Harmelen,
          <string-name>
            <surname>Deborah L. McGuinness</surname>
          </string-name>
          , and
          <string-name>
            <surname>Peter F. PatelSchneider. OIL</surname>
          </string-name>
          :
          <article-title>An Ontology Infrastructure for the Semantic Web</article-title>
          .
          <source>IEEE Intelligent Systems</source>
          ,
          <volume>16</volume>
          (
          <issue>2</issue>
          ),
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>G.</given-names>
            <surname>Wade</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.T.</given-names>
            <surname>Rosenbloom</surname>
          </string-name>
          .
          <article-title>Experiences Mapping a Legacy Interface Terminology to SNOMED CT</article-title>
          .
          <source>In Proceedings of the SMCS 2006 - Semantic Mining Conference on SNOMED CT</source>
          ,
          <year>2006</year>
          . http://www.hiww.org/smcs2006/ proceedings/9WadeSMCS2006final.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ghilardi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Wolter</surname>
          </string-name>
          .
          <article-title>Did I Damage my Ontology? A Case for</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <article-title>International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM)</article-title>
          .
          <source>National Centre for Classification in Health, 5th edition</source>
          ,
          <year>2006</year>
          . http://www3.fhs.usyd.edu.
          <source>au/ncch/4. 2.1</source>
          .1.htm.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Boontawee</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Module extraction and incremental classification: A pragmatic approach for EL+ ontologies</article-title>
          . In Sean Bechhofer, Manfred Hauswirth, Joerg Hoffmann, and Manolis Koubarakis, editors,
          <source>Proceedings of the 5th European Semantic Web Conference (ESWC'08)</source>
          , Lecture Notes in Computer Science. SpringerVerlag,
          <year>2008</year>
          . To appear.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C.</given-names>
            <surname>Hall</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Washbrook</surname>
          </string-name>
          .
          <article-title>Radiological Atlas of Malformation Syndromes and Skeletal Dysplasias (REAMS) [software]</article-title>
          . Oxford University Press, CD-ROM,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>B.</given-names>
            <surname>Motik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.F.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Horrocks.</surname>
          </string-name>
          <article-title>OWL 1.1 Web Ontology Language</article-title>
          .
          <source>World Wide Web Consortium, W3C Member Submission</source>
          ,
          <year>2006</year>
          . http://www.w3.org/Submission/2006/ SUBM-owl11-owl_
          <fpage>specification</fpage>
          -
          <lpage>20061219</lpage>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>K.</given-names>
            <surname>Spackman</surname>
          </string-name>
          .
          <article-title>An Examination of OWL and the Requirements of a Large Health Care Terminology</article-title>
          .
          <source>In Proceedings of the OWL: Experiences and Directions Third International Workshop (OWLED</source>
          <year>2007</year>
          ), CEURWS,
          <year>June 2007</year>
          . http://owled2007.iut-velizy.uvsq.fr/ PapersPDF/submission_26.pdf.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>