<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>TNM-O an Ontology for the Tumor-Node-Metastasis Classification of Malignant Tumors: a Study on Colorectal Cancer</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Martin Boeker</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fábio França</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Bronsert</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Schulz</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>: Center for Clinical Pathology, University Medical Center Freiburg</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>: Center for Medical Biometry and Medical Informatics, University Medical Center Freiburg</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>: Department of Informatics, University of Minho</institution>
          ,
          <addr-line>Braga</addr-line>
          ,
          <country country="PT">Portugal</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>: Institute of Medical Computer Sciences</institution>
          ,
          <addr-line>Statistics and Documentation</addr-line>
          ,
          <institution>Medical University of Graz</institution>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <abstract>
        <p>Objectives: To (1) present an ontological framework for the TNM classification system, (2) implement a TNM ontology for colon and rectum tumors based on this framework, and (3) evaluate this ontology with a classifier for pathology data. Methods: The TNM ontology uses the Foundational Model of Anatomy for anatomical entities and BioTopLite 2 as a domain top-level ontology. General rules for the TNM system and the specific TNM classification for colorectal tumors were formulated. Additional information was collected from tumor documentation practice in an academic Comprehensive Cancer Center. Based on the ontology, an automatic classifier for pathology data was developed. Results: TNM was represented as an information artefact which consists of single representational units. Corresponding to every representational unit, tumors and tumor aggregates were defined. Tumor aggregates consist of the primary tumor and (if existent) of infiltrated regional lymph nodes and distant metastases. TNM codes depend on the location and certain qualities of the primary tumor (T), the infiltrated regional lymph nodes (N) and the existence of distant metastases (M). Tumor data from clinical and pathological documentation were successfully classified with the ontology.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Conclusion: A first version of the TNM Ontology represents the TNM
system for the description of the anatomical extent of malignant tumors. The
presented work is already sufficient to show its representational correctness
and completeness as well as its applicability for classification of instance
data.</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        Colorectal cancer is the third most common cancer worldwide and
accounts for 9 % of all cancer incidence
        <xref ref-type="bibr" rid="ref13 ref15">(Marmot et al., 2007; Haggar
and Boushey, 2009)</xref>
        . In 2002, it affected more than one million
humans. Treatment of cancer patients and research on causes of
cancer are main goals of worldwide cancer control programs1.
The premise for an evidence-based cancer treatment is a correct
and unambiguous cancer diagnosis. Interdisciplinary expert groups,
e.g. from clinical medicine, imaging and pathology, work closely
together to establish precise tumor diagnoses
        <xref ref-type="bibr" rid="ref10">(DeVita et al., 2011)</xref>
        .
One of the most challenging tasks in clinical oncology is to correctly
classify and code clinical findings, using a multitude of available
coding systems.
*to whom correspondence should be addressed
1 http://www.who.int/cancer/modules/en/
Clinical and pathological staging of malignant tumors is one of
the most important procedures in the diagnosis of cancer to assess
prognosis and to plan the treatment necessary. The staging procedure
compiles several clinical and pathological parameters: the location
and the size of the primary tumor, the location and the number of
the infiltrated regional lymph nodes, and the existence of distant
metastases.
      </p>
      <p>
        By far, the most important coding system for staging information
is the Tumor-Node-Metastasis (TNM) classification
        <xref ref-type="bibr" rid="ref23">(Sobin et al.,
2009)</xref>
        for malignant tumors, published by the Union for International
Cancer Control (UICC)2. Despite its importance and formal
precision, no logic-based representation of TNM is available so far. Such a
formal representation would have several advantages over its current
natural language release. An initial attempt to represent staging of
lung tumors and glioma tumors was not continued
        <xref ref-type="bibr" rid="ref16 ref9">(Dameron et al.,
2006; Marquet et al., 2007)</xref>
        .
      </p>
      <p>
        One advantage would be the enhanced support for the TNM
development and refinement. With a taxonomic backbone and axiomatic
descriptions the existing complex natural language descriptions
would be made explicit. This would help decompose the
descriptions into all their defining criteria. This could help to detect errors,
inconsistencies and ambiguities in definitions
        <xref ref-type="bibr" rid="ref7 ref8">(Ceusters et al., 2004;
Cornet and Abu-Hanna, 2005)</xref>
        . Many combinations of tumor
findings are difficult to code due to ambiguos or overlapping criteria
(non-disjoint definitions) or non-exhaustive definitions, which often
results in cases where no TNM code or more than one TNM code is
applicable to a given tumor state.
      </p>
      <p>Additionally, logical inconsistencies and coding problems due to
complexity could be detected earlier by automated reasoning.
Description logics (DL) would here be the method of choice. Such a
TNM DL ontology could be further used for automatic classification
of instance data from clinical databases on a sound logical basis.
Advanced retrieval and querying tools would be additional benefits.
For these use cases, a formalized TNM version could constitute a
unified source from which a variety of clinical documentation and
analysis tools could be derived.</p>
      <p>With this work we propose to close the gap of a missing formal
representation by outlining and prototyping a TNM ontology
(TNMO).</p>
      <p>
        Following up initial attempts in the breast cancer domain
        <xref ref-type="bibr" rid="ref6">(Boeker et
al., 2014)</xref>
        the objectives of this work are (1) to present an ontological
      </p>
      <sec id="sec-2-1">
        <title>2 http://www.uicc.org</title>
        <p>framework for the TNM classification system, (2) to implement a
TNM ontology describing colon and rectum tumors based on this
framework, and (3) to evaluate this ontology with a classifier for
pathology data.</p>
        <sec id="sec-2-1-1">
          <title>The TNM classification</title>
          <p>
            The UICC published the first edition of the TNM coding system
based on the anatomic extent of disease (EOD) in 1968. Since then,
the system has undergone several revisions and arrived in 2009 at
the 7th edition. The objectives of the TNM classification are six-fold.
It supports treatment planning, prediction of outcomes (prognosis),
evaluation of treatment results, exchange of information between
different participants in the treatment process, continuing research in
malignant diseases, and cancer control
            <xref ref-type="bibr" rid="ref23 ref24">(Sobin et al., 2009; Webber
et al., 2014)</xref>
            .
          </p>
          <p>
            The TNM coding procedure requires a high degree of both domain
knowledge and experience in tumor documentation. Even
documentation experts frequently engage in discussions about how a given case
should be coded correctly. This is mainly due to the development
of the TNM classification as an evolutionary process
            <xref ref-type="bibr" rid="ref24">(Webber et al.,
2014)</xref>
            , which has to account for the huge amount of new scientific
insights in tumor prognosis and the dependency of therapeutic effects
on tumor stage. Controlled by medical experts, TNM’s underlying
structure has become more and more complex over the years.
Experts in different fields of oncology require for a change in TNM
maintenance representing the increasing complexity, the separation
from clinical practice and the resources needed for documentation
            <xref ref-type="bibr" rid="ref18 ref19">(Quirke et al., 2010, 2007)</xref>
            .
          </p>
          <p>
            Dependent on the location of the primary tumor, the three parts
of the code (T, N, and M) represent different aspects of a tumor. T
describes size and sometimes infiltrative level of the primary tumor, N
describes infiltrated regional lymph nodes, and M distant metastases.
T and N usually provide three to four levels with increasing severity,
viz. T0–T3 and N0–N3, respectively. For distant metastases, there is
only a binary classification into M1 (evidence) an M0 (no evidence).
The results from the clinical assessment have to be accurately
discerned from the pathological assessment due to their different meanings
and evidence levels. This distinction is symbolized by a prefix c
(clinical) and p (pathological) for most primary tumor locations.
Many users of the TNM struggle with the correct coding as well
as with the interpretation of TNM codes. This is one of the reasons
for the need in improvement of tumor documentation and coding in
primary documentation, clinical studies and cancer registries
            <xref ref-type="bibr" rid="ref1 ref17 ref2">(Abernethy et al., 2009; Aumann et al., 2012; Nagtegaal et al., 2000)</xref>
            .The
classification of the different primary tumor locations differs to the
same extent as the underlying diseases. As a consequence, even
expert coders resp. physicians in one organ system might encounter
difficulties in the correct application or interpretation of TNM to a
different organ system.
          </p>
          <p>Besides the complex semantics of the main numeral TNM codes, a
series of additional symbols exists, which might have largely
different meanings in the different tumor locations. Prefixes, suffixes, and
certainty factors increase the confusion, e.g. for carcinoma in situ
the suffix “is” has to be used (Tis). With the possibility to always
use a code of “X” if the underlying clinical or pathological situation
Type
adenocarcinoma
Mucinous adenocarcinoma
Signet-ring cell carcinoma
Small cell carcinoma
Squamous cell carcinoma
Adenosquamous carcinoma
Medullary carcinoma
Undifferentiated carcinoma</p>
          <p>ICO-O 3 morphology
8140/3
8480/3
8490/3
8041/3
8070/3
8560/3
8510/3
8020/3
provides incomplete information, inaccurate and incomplete code
assignments become widespread (MX for “no statement on metastases
possible”).</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>METHODS</title>
      <p>
        The TNM ontology uses the Foundational Model of Anatomy
        <xref ref-type="bibr" rid="ref20">(Rosse
and Mejino Jr., 2003)</xref>
        for anatomical entities and BioTopLite 2 as
a domain top-level ontology (
        <xref ref-type="bibr" rid="ref5">Beißwanger et al., 2008</xref>
        ;
        <xref ref-type="bibr" rid="ref21">Schulz and
Boeker, 2013</xref>
        ). Tailored for the biomedical domain and based on
description logics
        <xref ref-type="bibr" rid="ref3">(Baader et al., 2007)</xref>
        , BioTopLite 2 (BTL2) provides
upper-level types both for general categories like Material object,
Process, Information object, Quality etc., as well as constraints on
all of them, using a set of sixteen canonical relations, partly derived
from the OBO Relation Ontology (RO)
        <xref ref-type="bibr" rid="ref22">(Smith et al., 2005)</xref>
        . They
constrain each category by means of a set of general class axioms.
It also contains other axioms such as relationship chains, existential
and value restrictions. Thus, the building of domain ontologies
under BTL2 heavily constrains the freedom of the ontology engineer,
which is fully intended as this guarantees a higher predictability of
the domain ontologies produced under BTL2.
      </p>
      <p>
        The general rules for the TNM system and the specific TNM for
tumors of the colon and the rectum (ICD-O topography chapters
C18C21, for ICD-O morphology codes see Table 1) were represented as
described in
        <xref ref-type="bibr" rid="ref23">Sobin et al. (2009)</xref>
        and
        <xref ref-type="bibr" rid="ref14">Hamilton et al. (2000)</xref>
        .
A classifier for individuals (instances) derived from pathology reports
was developed employing the OWL API (version 4.0.1)3 and the
HermIT DL reasoner (version 1.3.8)4. It classifies breast tumor and
colorectal tumor data based on the corresponding TNM ontologies.
The classifier reads either tabular input data from files or can process
data from manual entry via a graphical user interface.
      </p>
    </sec>
    <sec id="sec-4">
      <title>RESULTS</title>
      <p>TNM-O is designed as a modular system of independent ontologies.
For every organ or organ system based module of the TNM
classification system, TNM-O provides a specific set of ontologies. The
TNM connecting ontology serves as a hub to import BioTopLite2
as well as the organ and organ system specific TNM ontologies (see
Table 2). The modular architecture allows for inclusion of only those
modules which are actually needed by an application.</p>
      <sec id="sec-4-1">
        <title>3 http://owlapi.sourceforge.net/</title>
      </sec>
      <sec id="sec-4-2">
        <title>4 http://hermit-reasoner.com/</title>
        <p>Without inclusion of BioTopLite2, the TNM hub ontology has the
description logic expressivity of ALC. It consists of 79 axioms,
38 logical axioms, and 39 classes. It includes 35 subClassOf and
1 EquivalentTo axioms. Most of the classes are proxy classes to
BioTopLite2. Inclusion of BioTopLite2 changes the DL expressivity
to SRI.</p>
        <p>The TNM ontology for colorectal tumors has the description logic
expressivity of ALC. For TNM version 7.0 (version 6.0 in brackets),
it consists of 386 (357) axioms, 291 (199) logical axioms, and 158
(149) classes. It includes 177 (160) subClassOf, 21 (18) EquivalentTo
and 18 (18) DisjointClasses axioms.</p>
        <sec id="sec-4-2-1">
          <title>Representational units in the TNM-Ontology</title>
          <p>The representation of the TNM system is decomposed in
representational units T, N and M and the location of the primary tumor.
Thus, for every existing code Tn, Nn and Mn in combination with a
specific organ there exists one TNM-O:RepresentationalUnit which
is an btl2:InformationObject. E.g. every TNM code for colorectal
cancer is represented by a separate class. These classes are connected
with their patho-anatomical relata of type PrimaryTumor or
TumorAggregate by the relation btl2:isRepresentedBy. In the remaining
text, the namespace of the TNM ontology is suppressed for clarity:
TumorOfColonAndRectumWith7OrMoreMetastaticRegionalLymphNodes
subClassOf
TumorAggregate and
btl2:isRepresentedBy some</p>
          <p>(ColonRectumTNM_pN2b or ColonRectumTNM_N2b) and
btl2:isRepresentedBy only</p>
          <p>(ColonRectumTNM_pN2b or ColonRectumTNM_N2b)</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>Representation of the primary tumor</title>
          <p>The primary tumor is represented as PrimaryTumor, a subclass of
MalignantAnatomicalStructure. The characteristics relevant for the
representational unit T of the TNM classification system are
represented as location and qualities of PrimaryTumor. For colorectal tumors
the exact localization of the tumor in the gut wall, the quality of the
tumor confinement with respect to neighboring organs (confined or
Name
BioTopLite2
TNM-O
TNM-O_breast_7
TNMO_colorectal_6
TNMO_colorectal_7</p>
          <p>
            Description
Upper domain level ontology
TNM-O central connecting ontology
TNM-O for breast cancer
(TNM version 7)
in:
            <xref ref-type="bibr" rid="ref6">Boeker et al. (2014)</xref>
            TNM-O for colorectal cancer
(TNM version 6)
TNM-O for colorectal cancer
(TNM version 7)
invasive), the quality of the assessment (no assessment, no evidence
or carcinoma in situ), are important. PrimaryTumor is directly related
to the corresponding representational unit:
InvasiveTumorOfSubmocosaOfColonAndRectum EquivalentTo
ColonAndRectumTumor and
(btl2:isBearerOf some (Confinement and
          </p>
          <p>(btl2:projectsOnto some Invasive))) and
(btl2:isIncludedIn some</p>
          <p>SubmocosaOfLargeIntestine)
InvasiveTumorOfSubmocosaOfColonAndRectum subClassOf
btl2:isRepresentedBy some
(ColonRectumTNM_T1 or</p>
          <p>ColonRectumTNM_pT1) and
btl2:isRepresentedBy only
(ColonRectumTNM_T1 or</p>
          <p>ColonRectumTNM_pT1)</p>
        </sec>
        <sec id="sec-4-2-3">
          <title>Representation of regional lymph nodes</title>
          <p>The most complex part of the TNM classification of many primary
tumor locations is the interpretation of the axis N, which describes to
which extent the primary tumor has infiltrated regional lymph nodes.
The anatomy of lymph nodes draining the colon and rectum was
modeled according to clinical anatomical conventions. Metastatic
regional lymph nodes can exactly be located by the exact subclass of
infiltrated regional lymph node:
MetastaticLymphNodeOfColonAndRectumTumor EquivalentTo
LymphNode and
(btl2:hasPart some</p>
          <p>MetastasisOfColonAndRectumTumor)
MetastaticRegionalLymphNodeOfColonAndRectumTumor EquivalentTo
MetastaticLymphNodeOfColonAndRectumTumor and</p>
          <p>ColonAndRectumRegionalLymphNode
To define regional lymph node metastases of colorectal cancers, the
aggregate of primary tumor and infiltrated lymph nodes around the
colon and rectum (TumorAggregate) has to be considered as one
(composite) entity. The representational unit N of the TNM
classification of colorectal cancers is dependent on the count of metastatic
regional lymph nodes and the presence of subserosal tumor deposits
without regional lymph node metastases. The count of metastatic
lymph nodes is represented by subclasses of CardinalityValueRegion:
TumorOfColonAndRectumWith2or3MetastaticRegionalLymphNodes
EquivalentTo
TumorOfColonAndRectumWith1to3MetastaticRegionalLymphNodes and
(btl2:isBearerOf some
(Cardinality and
(btl2:projectsOnto some</p>
          <p>Cardinality2or3) and
(btl2:projectsOnto only</p>
          <p>Cardinality2or3)))</p>
        </sec>
        <sec id="sec-4-2-4">
          <title>Representation of distant metastases</title>
          <p>For the representational unit M of the TNM classification system
the existence and number of distant metastases is evaluated. The
definition of distant metastases excludes regional lymph nodes as
their localization:
DistantMetastasisOfColonAndRectumTumor EquivalentTo</p>
          <p>MetastasisOfColonAndRectumTumor and</p>
          <p>TumorAggregate
TumorOfColonAndRectumAggregate</p>
          <p>TumorOfColonAndRectumWith</p>
          <p>MetastaticLymphNodes
isRepresentedBy</p>
          <p>TumorOfColonAndRectumWith
2or3MetastaticRegionalLymphNodes
The hub TNM Ontology for all tumors can be downloaded from
http://purl.org/tnmo/TNM-O.owl. The ontologies for breast tumors
and colorectal tumors are named according to Table 2 and can be
downloaded from the same site. They need to be loaded in the hub
ontology.</p>
        </sec>
        <sec id="sec-4-2-5">
          <title>Classification of pathology data</title>
          <p>We classified data on the state of regional lymph nodes (TNM: N)
of 382 specimens of colorectal carcinomas which were documented
at the Institute of Surgical Pathology, Medical Center – University
of Freiburg. All data were coded as RDF-OWL instance data and
classified by an application based on the OWL API using an OWL
classifier5. Automatic classification was solely based on axioms
defined in the colorectal TNM-O version 7 (TNM-O_colon_7.owl).
Criteria employed from instance data are shown in table 3.
All instance data could be classified to classes of the ontology.
Aposteriori comparison of the classification results with the findings</p>
        </sec>
      </sec>
      <sec id="sec-4-3">
        <title>5 http://owlapi.sourceforge.net/</title>
        <p>ColonRectumTNMClassification</p>
        <p>TNMClassification
RepresentationalUnit</p>
        <p>RepresentationalArtefactPart</p>
        <p>RepresentationalArtefact
Abbildung 1: Graph of the patho-anatomical structures represented by an N1b representational unit of the TNM-O for colorectal tumors
version 7 (TNM-O_colorectal_7.owl). T and M representational units are unspecified.
hasPart
hasPart
hasPart
hasPart
isBearer</p>
        <p>Cardinality</p>
        <p>projectsOnto
Cardinality2or3
isPartOf
isPartOf</p>
        <p>PrimaryTumor</p>
        <p>ColonAndRectumTumor
InvasiveTumorOfSubmucosa</p>
        <p>OfColonAndRectum
InferiorRectalLymphNode
InternalIliacLymphNode
RectosigmoidLymphNode</p>
        <p>etc.
hasPart</p>
        <p>Metastasis
Criterium
primary tumor
extension
primary tumor
growth pattern
primary tumor
epistemology
regional LN
number
regional LN
epistemology
distant Mx
location
distant Mx
no. of organs
distant Mx
epistemology
btl2 superclass
MaterialObject
Quality
Quality
Quality
Quality
Quality
Quality
MaterialObject</p>
        <p>Value
Epithelium, Submucosa,
Lamina propria,
Subserosa, Adventitia,
VisceralPeritoneum
Infiltrative, Confined
NoAssessment
NoEvidence
Cardinality1
Cardinality2or3
Cardinality4to6
Cardinality7orMore
NoAssessment
NoEvidence
Peritoneum
Cardinality1
Cardinality2orMore</p>
        <p>NoEvidence
from the pathology database by an experienced pathologist showed
100 % correct classification results.
6 http://cancerstaging.blogspot.de/2005/02/colon-and-rectum.html</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>DISCUSSION</title>
      <p>
        TNM is a globally accepted system to describe the anatomical extent
of malignant tumors
        <xref ref-type="bibr" rid="ref23 ref24">(Sobin et al., 2009; Webber et al., 2014)</xref>
        .
Although TNM is of high importance for the staging of tumor diseases,
to the knowledge of the authors, there exists no formal representation
of TNM so far. With this work, the authors provide a first outline
of a TNM ontology (TNM-O) and a prototypical implementation of
TNM for colorectal cancers. This work also shows also that TNM-O
classifies instance data.
      </p>
      <p>
        Over time, TNM has developed into a coding system which had to
accommodate both the pragmatics of coding and representational
accuracy. The literature on ambiguities and difficulties of TNM
in practice is abundant. The discussion of TNM for breast tumors
illustrates the dilemma of its maintainers
        <xref ref-type="bibr" rid="ref11 ref16 ref19 ref4">(Barr and Baum, 1992;
Gusterson, 2003; Güth et al., 2007)</xref>
        . They had to account for the
rapid progression of scientific knowledge on tumors and to keep it
usable at the same time: new versions of TNM were already outdated
when compared with new scientific insights. On the other hand, it
became increasingly complex, with a negative impact on usability by
non-expert and expert documentation staff and physicians.
This study is limited as far we provide here a first version of the TNM
Ontology (TNM-O) which has been developed only for mammary
gland
        <xref ref-type="bibr" rid="ref6">(Boeker et al., 2014)</xref>
        and colorectal tumors. As these two tumor
entities are the most complex and best represented ones in TNM, the
durrent version is already as far complete and stable to be used as a
blueprint for TNM-O extensions to other organ systems.
Due to the nature of the domain and the rich top-level ontology
employed, the computational resources needed to classify the ontology
are considerable. To alleviate performance issues TNM-O will be
provided as modules for different organ systems. Thus, the users can
import only the modules of interest into their application context.
Future research should evaluate the presented prototype ontology (i)
by implementing further tumor locations, and (ii) by systematical
application in clinical classification and retrieval scenarios. We will
provide the formalization of TNM for other primary tumor
locations in a modular way, so that users can select which part of the
TNM-O they would like to use. In this way, we hope to reduce the
computational resources already needed to a minimum.
      </p>
      <sec id="sec-5-1">
        <title>Conclusion</title>
        <p>We presented a first version of an ontology (TNM-O) that represents
the TNM tumor classification system. The presented work is already
sufficient to show the representational correctness and completeness
of the TNM-O as well as its applicability for classification of
instance data. This work provides a foundation for an exhaustive TNM
ontology.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Abernethy</surname>
            ,
            <given-names>A. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herndon</surname>
            ,
            <given-names>J. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wheeler</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rowe</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marcello</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Patwardhan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>Poor Documentation Prevents Adequate Assessment of Quality Metrics in Colorectal Cancer</article-title>
          .
          <source>JOP</source>
          ,
          <volume>5</volume>
          ,
          <fpage>167</fpage>
          -
          <lpage>174</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Aumann</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Amann</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gumpp</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hauschke</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kayser</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>May</surname>
            ,
            <given-names>A. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wetterauer</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Werner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Template-based synoptic reports improve the quality of pathology reports of prostatectomy specimens</article-title>
          .
          <source>Histopathology</source>
          ,
          <volume>60</volume>
          ,
          <fpage>634</fpage>
          -
          <lpage>644</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nardi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P. F.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>The Description Logic Handbook: Theory, Implementation, and</article-title>
          <string-name>
            <surname>Applications</surname>
          </string-name>
          , 2nd Edition 2nd ed. Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Barr</surname>
            ,
            <given-names>L. C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Baum</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>1992</year>
          )
          <article-title>Time to abandon TNM staging of breast cancer? The Lancet</article-title>
          ,
          <volume>339</volume>
          ,
          <fpage>915</fpage>
          -
          <lpage>917</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Beißwanger</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stenzhorn</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hahn</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          (
          <year>2008</year>
          )
          <article-title>BioTop: An Upper Domain Ontology for the Life Sciences - A Description of its Current Structure, Contents, and Interfaces to OBO Ontologies</article-title>
          .
          <source>Applied Ontology</source>
          ,
          <volume>3</volume>
          ,
          <fpage>205</fpage>
          -
          <lpage>212</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Boeker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faria</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>A Proposal for an Ontology for the TumorNode-Metastasis Classification of Malignant Tumors: a Study on Breast Tumors</article-title>
          . In, Jansen,
          <string-name>
            <surname>L</surname>
          </string-name>
          . (eds) et al.,
          <source>Ontologies and Data in Life Sciences (ODLS</source>
          <year>2014</year>
          ), IMISEREPORTS. Leipzig.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Ceusters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Dhaen</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2004</year>
          )
          <article-title>Ontology-based error detection in SNOMED-CT (R)</article-title>
          . In, Fieschi,M. (eds) et al.,
          <source>Medinfo 2004: Proceedings of the 11th World Congress on Medical Informatics, Pt 1 and 2</source>
          . IOS Press, Amsterdam, pp.
          <fpage>482</fpage>
          -
          <lpage>486</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Cornet</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Abu-Hanna</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>Description logic-based methods for auditing frame-based medical terminological systems</article-title>
          .
          <source>Artificial Intelligence in Medicine</source>
          ,
          <volume>34</volume>
          ,
          <fpage>201</fpage>
          -
          <lpage>217</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Dameron</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roques</surname>
          </string-name>
          , É.,
          <string-name>
            <surname>Rubin</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marquet</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Burgun</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Grading lung tumors using OWL-DL based reasoning</article-title>
          . In, Presentation Abstracts. Stanford, USA, p.
          <fpage>69</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>DeVita</surname>
          </string-name>
          , V. T.,
          <string-name>
            <surname>Lawrence</surname>
            ,
            <given-names>T. S.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rosenberg</surname>
          </string-name>
          , S. A. eds. (
          <year>2011</year>
          )
          <article-title>DeVita, Hellman, and Rosenberg's cancer: principles &amp; practice of oncology 9th ed</article-title>
          . Wolters Kluwer Health/Lippincott Williams &amp; Wilkins, Philadelphia.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Gusterson</surname>
            ,
            <given-names>B. A.</given-names>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>The new TNM classification and micrometastases</article-title>
          .
          <source>The Breast</source>
          ,
          <volume>12</volume>
          ,
          <fpage>387</fpage>
          -
          <lpage>390</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Güth</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jane Huang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holzgreve</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wight</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Singer</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>T4 breast cancer under closer inspection: A case for revision of the TNM classification</article-title>
          .
          <source>The Breast</source>
          ,
          <volume>16</volume>
          ,
          <fpage>625</fpage>
          -
          <lpage>636</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Haggar</surname>
            ,
            <given-names>F. A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Boushey</surname>
            ,
            <given-names>R. P.</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>Colorectal Cancer Epidemiology: Incidence, Mortality, Survival, and</article-title>
          <string-name>
            <given-names>Risk</given-names>
            <surname>Factors</surname>
          </string-name>
          .
          <source>Clin Colon Rectal Surg</source>
          ,
          <volume>22</volume>
          ,
          <fpage>191</fpage>
          -
          <lpage>197</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Hamilton</surname>
            ,
            <given-names>S. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aaltonen</surname>
            ,
            <given-names>L. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cancer</surname>
            ,
            <given-names>I. A.</given-names>
          </string-name>
          for R. on, Organization,
          <string-name>
            <surname>W. H.</surname>
          </string-name>
          ,
          <article-title>and others (2000) Pathology and genetics of tumours of the digestive system IARC press Lyon:</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Marmot</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Atinmo</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Byers</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hirohata</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jackson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>James</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kolonel</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumanyika</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leitzmann</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Powers</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reddy</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Riboli</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rivera</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Schatzkin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al. (
          <year>2007</year>
          )
          <article-title>Food, Nutrition, Physical Activity, and the Prevention of Cancer: a Global Perspective</article-title>
          World Cancer Research Fund / American Institute for Cancer Research, Washington DC, US.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Marquet</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dameron</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Saikali</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mosser</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Burgun</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>Grading glioma tumors using OWL-DL and NCI Thesaurus</article-title>
          .
          <source>AMIA Annu Symp Proc</source>
          ,
          <year>2007</year>
          ,
          <fpage>508</fpage>
          -
          <lpage>512</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Nagtegaal</surname>
            ,
            <given-names>I. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kranenbarg</surname>
            ,
            <given-names>E. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hermans</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Velde</surname>
            ,
            <given-names>C. J. H. van de</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krieken</surname>
            ,
            <given-names>J. H. J. M. van,</given-names>
          </string-name>
          and
          <string-name>
            <surname>Committee</surname>
            , the
            <given-names>P. R.</given-names>
          </string-name>
          (
          <year>2000</year>
          )
          <article-title>Pathology Data in the Central Databases of Multicenter Randomized Trials Need to Be Based on Pathology Reports and Controlled by Trained Quality Managers</article-title>
          . JCO,
          <volume>18</volume>
          ,
          <fpage>1771</fpage>
          -
          <lpage>1779</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Quirke</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cuvelier</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ensari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Glimelius</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laurberg</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ortiz</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piard</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Punt</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Glenthoj</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pennickx</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seymour</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valentini</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Nagtegaal</surname>
            ,
            <given-names>I. D.</given-names>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>Evidence-based medicine: the time has come to set standards for staging</article-title>
          .
          <source>J. Pathol.</source>
          ,
          <volume>221</volume>
          ,
          <fpage>357</fpage>
          -
          <lpage>360</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Quirke</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>G. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ectors</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ensari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piard</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Nagtegaal</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>The future of the TNM staging system in colorectal cancer: time for a debate?</article-title>
          <source>The Lancet Oncology</source>
          ,
          <volume>8</volume>
          ,
          <fpage>651</fpage>
          -
          <lpage>657</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Rosse</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <given-names>Mejino</given-names>
            <surname>Jr</surname>
          </string-name>
          .,
          <string-name>
            <surname>J. L.</surname>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>A reference ontology for biomedical informatics: the Foundational Model of Anatomy</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>36</volume>
          ,
          <fpage>478</fpage>
          -
          <lpage>500</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Boeker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>BioTopLite: An Upper Level Ontology for the Life Sciences. Evolution, Design and Application</article-title>
          . In, Hornbach,M. (ed),
          <source>INFORMATIK 2013</source>
          .
          <article-title>Ontologien in den Lebenswissenschaften</article-title>
          .,
          <source>Lecture Notes in Informatics. Gesellschaft für Informatik</source>
          , Bonn, pp.
          <fpage>1889</fpage>
          -
          <lpage>1899</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceusters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klagges</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Köhler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomax</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Neuhaus</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A. L.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rosse</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>Relations in biomedical ontologies</article-title>
          .
          <source>Genome Biology</source>
          ,
          <volume>6</volume>
          ,
          <fpage>R46</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Sobin</surname>
            ,
            <given-names>L. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gospodarowicz</surname>
            ,
            <given-names>M. K.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wittekind</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>TNM Classification of Malignant Tumours 7</article-title>
          . John Wiley &amp; Sons, Chichester, West Sussex, UK ; Hoboken, NJ.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Webber</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gospodarowicz</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sobin</surname>
            ,
            <given-names>L. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wittekind</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Greene</surname>
            ,
            <given-names>F. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mason</surname>
            ,
            <given-names>M. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Compton</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brierley</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Groome</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>Improving the TNM classification: Findings from a 10-year continuous literature review</article-title>
          .
          <source>Int. J. Cancer</source>
          ,
          <volume>135</volume>
          ,
          <fpage>371</fpage>
          -
          <lpage>378</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>