<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Experiences in Modeling Clinical Examinations in ⋆ Oral Medicine Using OWL</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marie Gustafsson</string-name>
          <email>marie.gustafsson@his.se</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Göran Falkman</string-name>
          <email>goran.falkman@his.se</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Science and Engineering, Chalmers University of Technology SE-412 96 Göteborg</institution>
          ,
          <country country="SE">Sweden</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Humanities and Informatics, University of Skövde</institution>
          ,
          <addr-line>PO Box 408, SE-541 28 Skövde</addr-line>
          ,
          <country country="SE">Sweden</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This article describes the modeling of clinical examinations in oral medicine using OWL. Based on experiences from our previous work and knowledge model, requirements for an ontology for examinations in oral medicine are identified. OWL can be used to address most, but not all, of the requirements. We found a lack of guidance for several design choices and for development of OWL ontologies at different levels of sophistication. However, using OWL gives us the ability to come back and refine the knowledge model after initial deployment.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Basing clinical decisions on finding, evaluating, and using the latest research
results is an essential premise of evidence-based medicine (EBM). A crucial part
of the practice of EBM is the integration of the expertise of the individual
clinicians with the best clinical evidence obtainable from external sources [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
The MedView project [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] has aimed to provide IT-support for evidence-based
oral medicine by equipping the clinicians with a set of software tools, assisting
in the various processes of EBM, and by providing a formal knowledge model on
which to base these tools. However, as this model is only used within MedView,
it is difficult to reuse external knowledge sources and to share the data collected
by MedView tools with others. There is also a need to expand the current model
and to reexamine how to best conceptualize examination data in oral medicine.
      </p>
      <p>We have investigated using OWL to model clinical examinations in oral
medicine, taking the previous work of MedView as a starting point. The
knowledge model of MedView includes the representation of examination templates
describing the pattern from which the individual records are created, value lists,
aggregates of values, and individual examination records. Within MedView, the
separation of information models for patient records and terminological
knowledge has been less distinct, which has affected this remodeling work.
⋆ The work presented in this paper was supported by the Swedish Agency for
Innovation Systems.</p>
      <p>
        For both information models and medical terminologies, there has been
extensive international work, to the extent that it is difficult for a small and
previously uninitiated group to make an informed choice among the models and
terminologies available. This, coupled with earlier decisions to investigate the
use of OWL and the somewhat daunting task of integration the content of the
local knowledge model with an external terminology, led us to not base our
work on any of these larger initiatives. Also, in considering efforts to
standardize nomenclature in dentistry, the clinicians we collaborate with found them
lacking. In the dental domain, the America Dental Association provides both a
Current Dental Terminology (CTD), which is updated regularly but limited to
treatments and procedures, as well as a Systemized Nomenclature of Dentistry
(SNODENT), which is an effort to create a comprehensive dental vocabulary.
However, it has been found that it needs improvements in content, quality of
coding, and quality of ontological structure [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Parts of the MedView applications have been adapted to handling the new
OWL and RDF representations, which is also used in the SOMWeb (Swedish
Oral Medicine Web) online community. This online community serves as
support for the discussion of interesting and difficult cases in oral medicine among
geographically dispersed clinics in Sweden [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In this article we describe the
requirements for ontologies for oral medicine, the design and development of such
ontologies, and our experiences in using OWL. While the perspective is that of
remodeling, we believe that our experiences and requirements are relevant for
using OWL and clinical modeling in general.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Requirements for an Ontology for Oral Medicine</title>
      <p>
        In deciding to revise the knowledge model of MedView, we collected requirements
for an ontology for oral medicine. These are based on 10 years of experience with
the MedView system and interviews with domain experts and developers, and
are described in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. To summarize:
– We need the possibility and ability to utilize external sources of knowledge.
– The relation between the conceptual models of fundamental clinical concepts
in use, e.g., examination templates, lists of approved values, and groups of
related terms, and their corresponding concrete entities must be examined.
– Relations and interactions between different entities of the ontology must
be captured, e.g., that a certain answer to a specific question in a given
examination template triggers another question.
– A stronger typing of elements is needed. We must be able to enforce that a
certain term e.g., only has numeric values, or a certain enumerated domain.
– We need to be able to capture different kinds of meta-data, e.g., the creator
and purpose of a specific examination template.
– The localization of data has to be addressed: How to provide different
languagebased versions of the defined concepts, definitions and terms?
– We need to be able to provide different views of the underlying data, to be
utilized for e.g., information visualization and intelligent user interfaces; e.g.,
a patient or temporal oriented view.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Design and Development of the Ontologies</title>
      <p>The design of the SOMWeb ontologies takes the MedView knowledge
representation and content as a starting point, which includes (1) examination templates
describing the pattern from which the individual records are created and which
are used in constructing graphic input forms, (2) value lists from which
values can be chosen when filling out these forms, (3) aggregates of values created
and used when analyzing data from the examination records, and (4) individual
examination records. We refer to the original, approach as the MedView
representation, and the new OWL- and RDF-based representation as the SOMWeb
representation.
3.1</p>
      <sec id="sec-3-1">
        <title>Designing the Examination Template Ontologies</title>
        <p>An examination template describes what should be included in an examination
record. In MedView, examination templates were stored as XML documents, and
there is a DTD to describe general features of such templates. In SOMWeb, each
examination template is stored in a separate OWL file, and one OWL file defines
common classes and properties. In MedView, an examination template is made
up of several categories (subsections of the examination), each with a number
of inputs (properties). An examination template OWL file contains definitions
of the categories that can or need to be included in an examination constructed
from that template. Examples of subclasses of ExaminationCategory (defined
in the common file) are PatientData and GeneralAnamnesis (an anamnesis is
a patient’s account of a health history). In each examination template we also
describe inputs (or properties) of the template. Each property also has properties
pertaining to description and instruction. Figure 1 shows the structure of an
example ExaminationCategory, GeneralAnamnesis, and how it relates to the
common description and the value list ontologies.</p>
        <p>To create the templates, a translator program was written which uses existing
MedView Java classes for reading templates and value lists. Based on the
proposed structure and design decisions described below, we create the appropriate
OWL constructs using the Jena API.3</p>
      </sec>
      <sec id="sec-3-2">
        <title>Design Choices</title>
        <p>Domain and range For each input we need to define what ExaminationCategory
they can belong to and what types of values they can take. This can be done using
rdfs:domain and rdfs:range or using restrictions such as owl:allValuesFrom
and owl:someValuesFrom. We initially expected that using domain and range
would provide some sort of constraint checking, while they are rather used to
infer additional information about individuals. Another consequence of using
domain and range from RDFS is that they apply globally to the property, while
allValuesFrom and someValuesFrom restrictions are local to the class for which
they apply. This leads us to not use domain and range.</p>
        <sec id="sec-3-2-1">
          <title>3 http://jena.sourceforge.net/</title>
          <p>
            Representing order An examination template has an implicit order. A general
anamnesis normally comes before a diagnosis. Whether or not this order is
intrinsic to the examination, or is part of the presentation of the examination remains
an open question. However, OWL and RDF, being graphs, have no order. We
use rdf:list to represent the order of categories and inputs. However, using
rdf:list brings us into OWL Full. As we currently don’t reason over the order
of ExaminationCategories, it is less of a problem. However, one can think of
cases where we will need to reason over the order (e.g., in dependency relations
between different categories). The W3C Working Group Note on N-ary relations
[
            <xref ref-type="bibr" rid="ref6">6</xref>
            ] has suggestions for representing lists as N-ary relations, which could be used
to avoid rdf:list. See also recent work on representing lists in OWL [
            <xref ref-type="bibr" rid="ref7">7</xref>
            ].
MedView’s Question Inputs MedView has an input category called ‘question’.
This is used, e.g., for specifying how long a patient has had a certain problem
(value + time unit), or smoking habits (value + tobacco category + time unit).
The MedView representation of this was unsatisfactory, as there was for example
no relation between the time units. For dealing with ’questions’ we use the W3C
OWL Best Practices Proposal for Representing N-ary Relations [
            <xref ref-type="bibr" rid="ref6">6</xref>
            ].
3.2
          </p>
        </sec>
      </sec>
      <sec id="sec-3-3">
        <title>Designing the Value List Ontology</title>
        <p>The MedView value lists, stored in text files, contain term names and the possible
values the terms can take. In SOMWeb, all terms are represented as OWL classes,
with their values as instances. The term Allergy becomes the class Allergy, and
the values of the Allergy term are instances of this class. Since the structure of
the terms in MedView is flat, no subclasses are created. For each term and value,
we can add metadata about the creator. Some of the values in MedView contain
extra information in the value name, e.g., the diagnosis values can have an ICD
code concatenated to them.In SOMWeb, such extra information is separated
from the name, and provided in a somweb:icdCode property.</p>
        <p>In moving to OWL, we initially attempted to categorize and clean up the
instances using Protégé, so that e.g., Allergy would have a subclass PollenAllergy,
of which BirchPollenAllergy would be an instance. However, this approach was
time-consuming, and should be carried out by the clinicians (or from reuse).
Instead, the MedView value lists are converted programatically, though this means
that any irregularities of the lists are included in the SOMWeb version.</p>
      </sec>
      <sec id="sec-3-4">
        <title>Design Choices</title>
        <p>
          Using Instances We chose to use instances, rather than classes, for values, which
can be problematic for several reasons. Consider, e.g., a property hasAllergy
pointing to the instance of the class Allergy representing a dog allergy. If we
use this instance for two different people, are we somehow saying that they have
the same allergy against dogs, in the sense that the chemical reactions in their
bodies resulting from an exposure to dogs are identical? A solution could be to
have each kind of allergy as a subclass of the class Allergy, and then creating
instances of these for each patient’s allergy. Such an approach would be similar
to the referent tracking system, suggested by Ceusters and Smith [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
Naming In deciding what URI to use for the values, the most straightforward is
perhaps to create one based on the current term value, which is in Swedish. If the
name of the Swedish value contains symbols not allowed in URIs, such as Swedish
letters, the URI is made by replacing these (International Resource Identifiers
were not considered, though we may switch in the future). The rdfs:label is
used for the original name. Initially we have Swedish labels for all values; labels
for English can be added later. Should we at some later time want to switch to
URIs using English, we can state that the old URI using Swedish refers to the
same thing as the new one using English.
        </p>
        <p>
          Before deciding to base the URIs on the Swedish values, we considered
using English names or an identifier scheme not containing the value name. Using
English names was decided against, as many of the terms we need are not in a
common dictionary, and a manual translation would be time-consuming.
Having URIs with an identifier scheme not based on the value name and having
the Swedish name only in the label, was also considered. However, with this
approach the RDF-file describing the examination is less readable and contains
less information as you need to consult the description of the value to find its
Swedish name. Related to the question of URIs and naming are Life Science
Identifiers (LSID),4 designed to be location-independent, stable, and resolvable
identifiers for entities on the Semantic Web for the life sciences [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. These were
found to be beyond the scope of this work.
3.3
        </p>
      </sec>
      <sec id="sec-3-5">
        <title>Representing Value Aggregates and Examinations</title>
        <p>In MedView, value aggregates are created and used when analyzing collected
data. For example, one may want to group allergies into different categories
to investigate relations between these categories and certain mucous membrane
changes in the mouth. In MedView, aggregates were seen as an abstraction of
values, which are in themselves values. In the SOMWeb representation, this is
mainly done by subclassing the values in the value list ontology, and making the
appropriate individual values instances of this subclass.</p>
        <p>Each individual examination is stored as a separate RDF file. We had initially
thought that we would be able to validate this against the corresponding OWL
examination template. However, given the open world assumption and the no
unique names assumption, validation is not automatically available without
making assumptions. That is, we cannot take a RDF description of an examination
instance and check that it fulfills all the requirements of the corresponding OWL
examination template description without, e.g., using a tool such as Eyeball,5
which makes closed world assumptions for checking RDF models for problems.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Results in Relation to the Requirements</title>
      <p>
        Utilization of External Sources We found it difficult to locate relevant
ontologies to reuse. Part of this was lack of appropriate services for finding
ontologies of use,6 and partly due to a lack of ontologies fitting our needs.
One problem may have been naming; there could exist ontologies that fit our
needs, where important concepts are named differently. Further, in the case
of the SOMWeb community, the users want to have a high level of control
over what kind of data they collect. How can this need be balanced with
the possibilities of interoperability which may be gained from reuse? The
problems of reuse are widely known (e.g., [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]), and while our problems were
partly from not finding relevant ontologies in OWL to reuse, it might not be
alleviated by more ontologies being published. As noted by [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], with more
available ontologies, more effort is required to evaluate ontologies, and there
are few available objective measures to determine ontology quality.
Relations Between Conceptual Models of Clinical Concepts The
remodeling work has value in itself, as it meant that many of the structures of the
knowledge model had to be thought through further. Indeed, one reason for
developing an ontology is to elaborate on a common conceptual model [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <sec id="sec-4-1">
        <title>4 http://lsid.sourceforge.net/</title>
      </sec>
      <sec id="sec-4-2">
        <title>5 http://jena.sourceforge.net/Eyeball/</title>
        <p>6 Though Swoogle (http://swoogle.umbc.edu/) is a good resource for this.</p>
        <sec id="sec-4-2-1">
          <title>Capturing Interactions Between Different Parts of the Ontology This</title>
          <p>requirement, where e.g., one examination question triggers another, has not
been studied within this work. It would probably be appropriate to use the
Semantic Web Rule Language (SWRL)7 in conjunction with OWL, if one
wants to stay within the sphere of Semantic Web technologies.</p>
          <p>Stronger Typing of Elements Here we get the benefit of working within a
larger framework, where structures for this is already in place. However, the
consequences of the open world assumption on validation means that we do
not get validation in the way that we had expected.</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>Capturing Examination Template Meta-data Using OWL provides good</title>
          <p>possibilities for capturing meta-data regarding creators and purpose of
different examination templates.</p>
          <p>Localization of Data It is possible to provide different language-based
versions of the parts of the examination template and the values that can be
used, by utilizing the xml:lang of rdfs:label. However, such translations
have not yet been provided.</p>
        </sec>
        <sec id="sec-4-2-3">
          <title>Differentiating between different views of the underlying data While it</title>
          <p>has not been rigorously addressed in this work, it seems feasible that the RDF
graph is a good starting point, as we can ‘pull’ the graph from different nodes,
making them starting points, thereby providing different perspectives.
Representing Data Ranges Though not listed as a requirement, the
possibility to define data ranges would have been useful for e.g., representing values
on a scale from 1 to 10. There is currently no support for this in OWL, which
was not something that we had anticipated when we considered using OWL.</p>
          <p>However, in the proposed OWL 1.1, support for value ranges is included.
5</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Our Experiences in Using OWL</title>
      <p>In working with OWL, possibilities for knowledge sharing are increased and
we get the option of using general tools developed by others. In using a
Semantic Web technology, we also get the prospect of being part of a distributed
knowledge-base. However, using OWL has not been without issues. The
remodeling of the MedView knowledge model has taken place over the course of
approximately two years (fall of 2004 to fall of 2006). At the beginning of this process,
OWL was a fairly recent recommendation. Though ontology research has been
an active research field since the 90’s and the precursors of OWL provided initial
expertise, we still experienced a lack of guidance in many design choices.</p>
      <p>As the MedView knowledge model includes both terminological knowledge
and models for patient records, our remodeling work asks if OWL can handle
both. The use of OWL to represent the terminological knowledge was less of an
issue than using OWL to represent templates for patient records. Initially, we
had expected to be able to specify a schema, which would be used to validate
examination records, in addition to being able to give more elaborate definitions of
what to include in an examination. As we found out, this kind of validation is not</p>
      <sec id="sec-5-1">
        <title>7 http://www.w3.org/Submission/SWRL/</title>
        <p>
          available without making several assumptions, such as a closed world
assumption. This could be made clearer to newcomers to OWL. Further, we see a need
to be able to provide schema functionality within the Semantic Web framework.
New restrictions, such as makeSenseForTypeKnownToBe, canOnlyBeKnownType,
and mustBeAtLeastOneKnown, as suggested by [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ], could be a step in this
direction.
        </p>
        <p>
          Many of the problems we experienced relate to whether or not there is one,
correct way to use OWL, and how important this is to follow. When creating an
ontology it is hard to decide when the ontology is good enough to use. There is
a compulsion to create the ‘perfect’ ontology. Combined with lack of support for
some design choices, it becomes difficult to determine when the ontology is ready
to be deployed. Knublauch et al. [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] see a major benefit in OWL’s breadth, in
that it offers a “migration route from entry level, hand-crafted taxonomies of
terms, to well defined, normalized ontologies capable of supporting reasoning.”
We concur with this, and there is a great need for support for such a route, where
the developer is given guidelines for what is the appropriate way of representing
these ‘entry-level’ ontologies, so that they are coherent and so that the path to
more well-defined ontologies is clear or even possible. We also found it uncertain
how much DL expertise is needed for successful ontology development in OWL,
which is also stated in an assessment of RDF and OWL modeling [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ].
        </p>
        <p>
          However, with OWL, much of the more practical guidance is found in mailing
lists, wikis, and W3C working group notes. While these are public, their
existence, validity, and use might not be obvious to the novice developer. In
experience reports of OWL, e.g., [
          <xref ref-type="bibr" rid="ref14 ref16">14, 16</xref>
          ], many of the issues that we have faced come
up, such as the open world assumption, the no unique names assumption,
validation, value ranges, ontology reuse, imports, using instances or classes, OWL’s
XML syntax, use of domain and range, OWL’s sublanguages, and problems for
developers new to OWL.
6
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Discussion</title>
      <p>The development of the SOMWeb ontologies was based on the knowledge model
of MedView. Taking a previous representation as a starting point for ontology
creation simplifies the development, as much knowledge acquisition has already
been done, and consideration has been given to the structuring of this knowledge.
At the same time, this means that the ontology is developed within certain
constraints, and cannot adhere entirely to the new representation paradigm.</p>
      <p>MedView aims to provide the end users with means to themselves formulate
what to include in examination templates and value lists. While the value lists
are part of an ambition to harmonize the values used in examination records,
the users have been able to add values as they see fit. This control can be a
motivation for the clinician by easing the filling out of the examination forms,
but as a result, the value lists contain duplicates (different spellings and different
names for the same thing), and values mistakenly entered. The clinicians need
tools to carry out ‘clean up’ and structuring of the lists. This tool has to be
presented in a such way that users see a value in structuring, as it might not
seem a natural part of their work tasks. Another way to get more structured
value lists would be to reuse external resources. For example, SOMWeb could
reuse an externally developed allergens ontology or a standardized nomenclature,
such as those mentioned in Sec. 1. In SOMWeb, ICD codes are sometimes added
as properties of instances of the Diagnosis class. Preferably, ICD as a whole
could have been reused, but it is not available in OWL. Our approach has the
advantage of only providing the subset of values that our users are interested
in. Reusing classifications presents difficulties in that some medical entities will
seem insufficiently detailed to some specialists, and too complex to use for others.
Further, it can conflict with requirements of end-user control.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Conclusions and Future Work</title>
      <p>This report describes how the W3C recommendations OWL and RDF can be
used for representing clinical knowledge in oral medicine. From the limitations
of MedView’s original knowledge model, requirements for a new model were
identified. Of these requirements, OWL and RDF have proven useful for
capturing meta-data, different language versions, and providing a stronger typing
of elements. While using these recommendations give better opportunities for
knowledge reuse in theory, it was found that in practice it was difficult to find
ontologies to reuse, which were at an appropriate level of conceptualization and
were available in OWL. Using OWL has given us access to a potentially
beneficial array of externally developed tools, the ability to come back and refine
the knowledge model after initial deployment, as well as the possibility of, post
development and use, aligning the developed ontology with that of potential
collaborators.</p>
      <p>There has yet to be a rigorous evaluation of the developed ontologies, either
from a technical perspective or from a user perspective. However, they have gone
through iterations of evaluation and adjustments from use in the SOMWeb
community. In continuing and expanding on the remodeling of MedView’s knowledge
model, we need to provide tools for the clinicians to be able to add detail to and
refine the ontologies described above.</p>
      <p>In using OWL we found that, while there is much useful material available,
there is still a lack of support for design decisions and best practice guidelines
are still under development. There is a lack of recommendations for what is
necessary in developing ontologies with different levels of sophistication and guiding
materials at an intermediary level, when the developer has moved beyond the
introductory materials but is not yet prepared for the more advanced nuances of
OWL. Further, methodologies for ontology development should cater to different
levels of ontology sophistication, so that the developer knows what is necessary
for reaching an intended result.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Sackett</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosenberg</surname>
            ,
            <given-names>W.M.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>J.A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haynes</surname>
            ,
            <given-names>R.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Richardson</surname>
            ,
            <given-names>W.S.</given-names>
          </string-name>
          :
          <article-title>Evidence based medicine: What it is and what it isn't</article-title>
          . Brit. Med. J.
          <volume>312</volume>
          (
          <issue>7023</issue>
          ) (
          <year>1996</year>
          )
          <fpage>71</fpage>
          -
          <lpage>72</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Jontell</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mattsson</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torgersson</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>MedView: An instrument for clinical research and education in oral medicine</article-title>
          .
          <source>Oral Surg. Oral Med</source>
          . Oral Pathol.
          <source>Oral Radiol. Endod</source>
          .
          <volume>99</volume>
          (
          <year>2005</year>
          )
          <fpage>55</fpage>
          -
          <lpage>63</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Goldberg</surname>
            ,
            <given-names>L.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceusters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eisnerc</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The significance of SNODENT</article-title>
          .
          <source>In: Proc. Medical Informatics Europe (MIE-05)</source>
          . (
          <year>2005</year>
          )
          <fpage>737</fpage>
          -
          <lpage>742</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gustafsson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lindahl</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Falkman</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torgersson</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Enabling an online community for sharing oral medicine cases using Semantic Web technologies</article-title>
          .
          <source>In: Proc. Int. Semantic Web Conf. (ISWC-06)</source>
          . (
          <year>2006</year>
          )
          <fpage>820</fpage>
          -
          <lpage>832</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Gustafsson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Falkman</surname>
          </string-name>
          , G.:
          <article-title>Representing clinical knowledge in oral medicine using ontologies</article-title>
          .
          <source>In: Proc. Medical Informatics Europe (MIE-05)</source>
          . (
          <year>2005</year>
          )
          <fpage>743</fpage>
          -
          <lpage>748</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Defining n-ary relations on the Semantic Web</article-title>
          . W3C Working Group Note (
          <year>2006</year>
          ) Available at: http://www.w3.org/TR/swbp-n-aryRelations/.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Drummond</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moulton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seidenberg</surname>
          </string-name>
          , J.:
          <article-title>Putting OWL in order: Patterns for sequences in OWL</article-title>
          .
          <source>In: Proc. 2nd Workshop on OWL: Experiences and Directions</source>
          . (
          <year>2006</year>
          ) Available at: http: //owl-workshop.man.ac.uk/acceptedLong/submission_12.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Ceusters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Strategies for referent tracking in electronic health records</article-title>
          .
          <source>J. Biomedical Informatics</source>
          <volume>39</volume>
          (
          <year>2006</year>
          )
          <fpage>362</fpage>
          -
          <lpage>378</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liefield</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Globally distributed object identification for biological knowledgebases</article-title>
          .
          <source>Briefings in Bioinformatics 5</source>
          (
          <year>2004</year>
          )
          <fpage>59</fpage>
          -
          <lpage>70</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>Paslaru</given-names>
            <surname>Bontas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Mochol</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Tolksdorf</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          :
          <article-title>Case studies on ontology reuse</article-title>
          .
          <source>In: Proc. 5th Int. Conf. on Knowledge Management (I-Know-05)</source>
          . (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Noy</surname>
          </string-name>
          , N.:
          <article-title>Order from chaos</article-title>
          .
          <source>Queue</source>
          <volume>3</volume>
          (
          <issue>8</issue>
          ) (
          <year>2005</year>
          )
          <fpage>42</fpage>
          -
          <lpage>49</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Ontology development 101: A guide to creating your first ontology</article-title>
          .
          <source>Stanford Knowledge Systems Laboratory Technical Report</source>
          (
          <year>2001</year>
          ) Available at: http://ksl.stanford.edu/people/dlm/papers/ ontology
          <article-title>-tutorial-noy-mcguinness</article-title>
          .
          <source>pdf.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rees</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zucker</surname>
          </string-name>
          , J.:
          <article-title>What BioPAX communicates and how to extend OWL to help it</article-title>
          .
          <source>In: Proc. 2nd Workshop on OWL: Experiences and Directions</source>
          . (
          <year>2006</year>
          ) Available at: http://owl-workshop.man.ac.uk/acceptedLong/ submission_26.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Knublauch</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drummond</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seidenberg</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          :
          <article-title>The Protégé OWL experience</article-title>
          .
          <source>In: Proc. OWL: Experiences and Directions Workshop</source>
          <year>2005</year>
          . (
          <year>2005</year>
          ) Available at: http://www.mindswap.org/OWLWorkshop/sub14.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Reynolds</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thompson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mukerji</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coleman</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>An assessment of RDF/OWL modelling</article-title>
          .
          <source>Technical report, Hewlett Packard Labs</source>
          (
          <year>2005</year>
          ) Available at: http://www.hpl.hp.com/techreports/2005/HPL-2005-189.html.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rees</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Luciano</surname>
          </string-name>
          , J.:
          <article-title>Experience using OWL DL for the exchange of biological pathway information</article-title>
          .
          <source>In: Proc. OWL: Experiences and Directions Workshop</source>
          <year>2005</year>
          . (
          <year>2005</year>
          ) Available at: http://www.mindswap.org/OWLWorkshop/ sub37.pdf.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>