<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Blending FHIR RDF and OWL</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Harold R. Solbrig</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eric Prud'hommeaux</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Guoqian Jiang</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Health Sciences Research, Mayo Clinic</institution>
          ,
          <addr-line>Rochester, MN</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>W3C/MIT</institution>
          ,
          <addr-line>Boston, MA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>HL7 Fast Healthcare Interoperability Resources (FHIR) is rapidly becoming a major standard for the exchange of electronic healthcare information. FHIR defines a collection of “resources” to represent different information types and specifies how these resources are to be exchanged using XML, JSON and, as of the latest release, RDF. The FHIR specification also uses links to SNOMED CT and other ontologies as an integral component of the representation of clinical data. The combination of a standardized set of FHIR RDF tags with embedded ontology references offers a number of interesting new possibilities for classification and categorization of clinical data, including recognizing prescriptions that contain particular drug categories, procedures that use a specific technique or approach, diagnoses of general disease categoreis (e.g. cancer, diabetes), etc. In this paper we investigate how FHIR RDF can be combined with ontologies in a description logic reasoner to achieve these goals.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>? The SNOMED CT Concept Reference format (“code |name|”) will be used in this
document to identify SNOMED CT concept codes.</p>
    </sec>
    <sec id="sec-2">
      <title>FHIR</title>
      <p>We describe how an OWL reasoner can be used in combination with FHIR
RDF and SNOMED CT to realize this sort of possibility,? and touch on some
of the technical issues and next steps that will need to be addressed before this
approach can be incorporated into high performance, industrial-strength tools.
The HL7 Fast Healthcare Interoperability Resources FHIR 1 combines the key
features of the Health Level Seven (HL7) 8 V2 9, V3 10 and CDA 11 standards into
a framework based on the Resource Oriented Architecture (ROA) 12. FHIR
defines a collection of resources that can be “easily assembled into working systems
that solve real world clinical and administrative problems” 13. The FHIR
specification defines how instances of FHIR resources are represented and exchanged
using XML, JSON and, as of the latest version, RDF.</p>
      <sec id="sec-2-1">
        <title>RDF and FHIR</title>
        <p>The FHIR Standard for Trial Use Version 3 (STU3) 4 includes a proposed
specification for the representation of FHIR resources in RDF 5. This specification,
jointly developed by HL7 FHIR and the W3C Semantic Web Health Care and
Life Sciences Interest Group 14 includes:
– Documentation and tooling for the representation the “abstract” FHIR model
(FHIR StructureDefinition) as RDF.
– A set of Shape Expression (ShEx) 15 16 schemas that formally define the rules</p>
        <p>FHIR RDF compliance.
– The FHIR Metadata Vocabulary 17 an RDFS/OWL document that formally
defines the set of RDF URIs used in FHIR RDF instances.</p>
        <p>One the key requirements for the FHIR RDF specification was “round
trippability” – that all of the information in a abstract FHIR instance can be represented
in the RDF serialization and vice versa. The FHIR RDF specification was,
however, able to incorporate four optional “extensions” that help FHIR RDF to be
a full participant in a Linked Open Data 18 environment:
1. Resource link Allows an explicit fhir:link to the URI of a referenced
reference, e.g. the subject of a FHIR DiagnosticReport
2. Concept URI The RDF specification allows an optional “type arc” (i.e.
rdf:type) that can reference the URI (or OWL expression) of a FHIR coded
concept.
? The authors recognize that the application of automated reasoning to this sort of task
is hardly novel. The fact, however, that large quantities of healthcare data may soon
be directly in RDF using standardized URIs and representational ‘structures’ is new.
The purpose of this paper is to call attention to this fact and to demonstrate that
the sort of capabilities described in this paper are no longer hypothetical. Instead of
saying if healthcare data were available in this RDF structure we could do X, we
are saying now that large quantities of healthcare data is (or soon will be) available
in this format, X will become generally available in production level environments.
3. Link type Identifies the rdf:type of a resource link.
4. Ontology header Provides an OWL compatible name and version for the
resource instance, and imports the FHIR Ontology which allows the resource
to be correctly interpreted in an OWL context.</p>
        <p>While all of the above elements are optional, their presence enables a number
of interesting use cases, a few of which are discussed here. Figure 1 shows a
fragment of a JSON rendering of an example FHIR DiagnosticReport?. Figure 2
shows the equivalent information??, in RDF, with the extension elements shown
in bold text.
{"resourceType": "DiagnosticReport",
"id": "f201",</p>
        <p>...
"status": "final",</p>
        <p>...
"subject": {
"reference": "Patient/f201",
"display": "Roel" },</p>
        <p>...
"conclusion": "CT brains: large tumor sphenoid/clivus.",
"codedDiagnosis": [
{"coding": [
{"system": "http://snomed.info/sct",
"code": "188340000",
"display": "Malignant tumor of craniopharyngeal duct" }
}
]}</p>
        <p>]}
Much as the Dublin Core 20 serves as a vocabulary of metadata terms used to to
describe documents and other resources, the FHIR Metadata Vocabulary (FMV)
can be viewed a “vocabulary” of terms used in health care documents. The FMV
represents FHIR resources and their subcomponents as instances of owl:Class,
and the attributes within those resources as instances of owl:ObjectProperty.
Each owl:Class definition includes a description of its properties along with
their type and expected cardinality. Each owl:ObjectProperty instance includes
its rdf:domain and rdf:range, as well as any name(s), descriptions, etc. Figure 3
shows an excerpt from the definition of FHIR DiagnosticReport.
? http://hl7.org/fhir/diagnosticreport-example-f201-brainct.json
?? http://hl7.org/fhir/diagnosticreport-example-f201-brainct.ttl
fhir:DiagnosticReport/f201 a fhir:DiagnosticReport;
fhir:nodeRole fhir:treeRoot;
fhir:Resource.id [ fhir:value "f201"]</p>
        <p>...
fhir:DiagnosticReport.status [ fhir:value "final"];
fhir:DiagnosticReport.subject [
fhir:link &lt;http://hl7.org/fhir/Patient/f201&gt;; 1
fhir:Reference.reference [ fhir:value "Patient/f201" ];
fhir:Reference.display [ fhir:value "Roel" ]
];</p>
        <p>...
fhir:DiagnosticReport.conclusion [ fhir:value "CT brains: large tumor sphenoid/clivus."];
fhir:DiagnosticReport.codedDiagnosis [
fhir:index 0;
fhir:CodeableConcept.coding [
fhir:index 0;
a sct:188340000; 2
fhir:Coding.system [ fhir:value "http://snomed.info/sct" ];
fhir:Coding.code [ fhir:value "188340000" ];
fhir:Coding.display [ fhir:value "Malignant tumor of craniopharyngeal duct" ]</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Combining FHIR RDF and Ontology</title>
      <sec id="sec-3-1">
        <title>FHIR and SNOMED CT</title>
        <p>The RDF fragment shown in Figure 2 asserts that &lt;http://hl7.org/fhir/DiagnosticReport/
1. Is an instance of the class FHIR DiagnosticReport.
2. Has a FHIR DiagosticReport.codedDiagnosis that, in turn, references a FHIR
CodeableConcept.coding element that is (or represents) an instance of the
the SNOMED CT concept 188340000 |Malignant tumor of craniopharyngeal
duct|.</p>
        <p>Using this assertion as a staring point, it is now possible to use this report in
combination with the FMV, SNOMED CT and other ontologies to draw conclusions
about the nature of the report. We will begin with a relatively straight-forward
question: Does this report contain a cancer diagnosis? Using the SNOMED CT
browser 21, we can determine the concept code for a cancer finding is 363346000
|Malignant neoplastic disease|.? Figure 4 shows how we can use the OWL 2
Functional Syntax 22 to define the class ReportWithCancerDiagnosis to be the
set of fhir:DiagnosticReport instances that have at least one codedDiagnosis of
type sct:3633346000.</p>
        <p>Declaration(ObjectProperty(fhir:DiagnosticReport.codedDiagnosis.coding))
SubObjectPropertyOf(ObjectPropertyChain(
fhir:DiagnosticReport.codedDiagnosis fhir:CodeableConcept.coding)
fhir:DiagnosticReport.codedDiagnosis.coding)
Declaration(Class(:ReportWithCancerDiagnosis))
EquivalentClasses(
:ReportWithCancerDiagnosis</p>
        <p>ObjectSomeValuesFrom(:fhir:DiagnosticReport.codedDiagnosis.coding sct:363346000))</p>
        <p>When we load the diagnostic report itself, SNOMED CT, the FMV and the
above class definition into Protégé 6 and applied the FACT++ 7 reasoner to reach
the expected conclusion as shown in Figure 5.</p>
        <p>It turns out, however, that the FHIR subject of a FHIR DiagnosticReport can
be a FHIR Patient, Group, Device or Location. Figure 6 shows a class definition
that selects FHIR DiagnosticReports having a FHIR Patient subjects.</p>
        <p>A FHIR DiagnosticReport may or may not be “final”. If we want to restrict
our classifier to finalized reports, we need to add another classifier. The current
FHIR RDF specification doesn’t allow concept URI’s for simple codes such as
FHIR status, so we need to examine the text status values??. Assuming we decide
that “amended”, “appended”, “corrected” and “final” are the statuses that identify
a finalized report, the resulting classifier can be constructed as shown in
Figure 7. This approach, however, is brittle. “Appended” and “corrected” are both
? Note the distinction between this and 367651003 |Malignant neoplasm|, a
morphological abnormality. The finding represents a set of “things” that can appear in a
document, while the morphological abnormality represents the set of things that can
appear on the body of a living organism.
?? http://hl7.org/fhir/valueset-diagnostic-report-status.html</p>
        <p>Fig. 5: Cancer Diagnosis Classification Result
Declaration(ObjectProperty(fhir:DiagnosticReport.subject.link))
SubObjectPropertyOf(</p>
        <p>ObjectPropertyChain</p>
        <p>(fhir:DiagnosticReport.subject fhir:link) fhir:DiagnosticReport.subject.link)
Declaration(Class(:PatientReport))
EquivalentClasses(:PatientReport</p>
        <p>ObjectSomeValuesFrom(fhir:DiagnosticReport.subject.link fhir:Patient))
subclasses of “amended”. The FHIR community might decide, however, that a
status of “appended” should be a type “partial” or “preliminary”, and, were this
the case, there would be no way to recognize that a change had occurred. New
statuses could also be added such as, “fixed”, which might be defined as “final”
status with additional workflow implications. A better approach to the status
classifier would be to:
1. Publish an OWL rendering of the FHIR coding systems, including for FHIR</p>
        <p>DiagnosticReport.status.
2. Extend the FHIR RDF specification to include URI’s for the code data type.</p>
        <p>Figure 8 shows an excerpt from a proposed OWL rendering of the FHIR
DiagnosticReport.status ontology, Figure 9 how it would appear and Figure 10
the corresponding classifier.</p>
        <p>The categories defined above could then be combined into single classifier
that identifies finalized diagnostic reports for patients with a diagnosis for any
type of cancer, as shown in Figure 11. with the classification result in Figure 12.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <p>The FHIR RDF representation allows us to “join the planes” of the information
and ontology space. We have demonstrated that it, in the presence of the FHIR
diagnostic-report-status:
a owl:Ontology ;
rdfs:comment "The status of the diagnostic report as a whole." ;
rdfs:label "DiagnosticReportStatus" ;
owl:versionIRI "http://hl7.org/fhir/diagnostic-report-status/3.1.0" ;
owl:versionInfo "DiagnosticReportStatus(3.1.0)" .
diagnostic-report-status:root
a owl:Class ;
rdfs:label "DxStatus" ;
skos:definition "Diagnostic Report Status Values" ;
skos:preflabel "DxStatus" .</p>
      <p>...
diagnostic-report-status:final
a owl:Class ;
rdfs:subClassOf diagnostic-report-status:root ;
rdfs:label "Final" ;</p>
      <p>...
diagnostic-report-status:appended
a owl:Class ;
rdfs:label "Appended" ;
rdfs:subClassOf diagnostic-report-statustic-report-status:amended
skos:definition "Subsequent to being final, the report has been modified</p>
      <p>by adding new content. The existing content is unchanged." .
Import(&lt;http://example.org/swat4ls/patientreport&gt;)
Import(&lt;http://example.org/swat4ls/cancerreport&gt;)
Import(&lt;http://example.org/swat4ls/finalreport&gt;)
Declaration(Class(:FinalPatientReportWithCancerDiagnosis))
EquivalentClasses(:FinalPatientReportWithCancerDiagnosis</p>
      <p>ObjectIntersectionOf
(&lt;http://example.org/swat4ls/patientreport/PatientReport&gt;
&lt;http://example.org/swat4ls/cancerreport/ReportWithCancerDiagnosis&gt;
&lt;http://example.org/swat4ls/finalreport/FinalReport&gt;))
)
Metadata Vocabulary and one or more ontologies, one can use an OWL
Description Logic reasoner to classify and categorize FHIR resource instances. We have
demonstrated the usefulness of the “extensions” to the FHIR RDF
representation:
– Resource links Assigns URI’s to referenced resources, allowing them to be
typed and retrieved.</p>
      <p>Fig. 12: Final Classification Results
– Link type Identifies the type of a link – something that non-RDF
representations have to determine by a) constructing a URI and b) resolving
it.
– Concept URI Allows resource instances and ontologies to be joined in the
context of a DL reasoner.
– Ontology header Allows import and reference to resource instances</p>
      <p>We have also noted that the ability to assign URI’s to all FHIR code instances
and to make all code systems available in an RDF/OWL format would improve
general usability. This demonstration is only a first step, however. There are
a number of issues that still need to be resolved before FHIR, ontology and
reasoners can participate seamlessly, including:
Classification Algorithms – Snorocket 23 and ELK 24 are the only two
generally available reasoners that can currently classify the entirety of SNOMED CT
in a reasonable period of time. 25 The ELK reasoner, however, does not support
several required axioms such as ObjectPropertyRange, ObjectAllValuesFrom,
ObjectUnionOf, while the current Snorocket reasoner does not recognize the
anonymous individuals that form an integral part the FHIR RDF rendering.
We use the FACT++ 7 reasoner in this project, which takes over 20 minutes to
classify all of SNOMED CT on the machine we were using. As a work-around,
we used the RF2Filter? and SNOMEDToOWL?? tools to isolate the classification
tree that directly pertained to our particular problem. We plan to work with
the Snorocket developers to address the specific issues and hope to employ a
pre-classified server instance to achieve the sort of performance necessary to use
classifiers in a production environment.
? https://github.com/hsolbrig/SNOMEDToOWL/blob/master/scripts/RF2Filter.</p>
      <p>md
?? https://github.com/hsolbrig/SNOMEDToOWL/blob/master/scripts/
SNOMEDToOWL.md
FHIR data types – The FHIR Metadata Vocabulary (FMV) includes
references to xsd:date, xsd:time, xsd:base64Binary and fhir:xhtml, which are not
recognized in the current OWL specification. We had to change these to xsd:
dateTime or xsd:string before classification.</p>
      <p>Content Negotiation – The FHIR servers currently expect the text/turtle
mime type in the Accept header. Protégé currently requests applicaton/rdf+xml.
We need work with a combination of the Protégé , FHIR and, perhaps, the W3C
communities to arrive at an acceptable way for a client to say "I want OWL and
will accept any format".</p>
      <p>Anonymous individuals in Protégé - Protégé doesn’t appear to have a
useful way of displaying or editing the sort of nested blank nodes that appear in
the FHIR resource rendering?.</p>
      <p>None of these issues are insurmountable and we anticipate being able to
address all of them in the relative short term, with the goal of being able to connect
a DL classifier to a FHIR data flow and to use it to categorize and recognize
events that call for extra processing, adverse advent monitoring, clinical trial
enrollment, etc.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>This study is supported in part by NIH grants U01 HG009450 and U01 CA18094.
This work was conducted using the Protégé resource, which is supported by
grant GM10331601 from the National Institute of General Medical Sciences of
the United States National Institutes of Health.</p>
      <p>The files used in this project are available at https://github.com/BD2KOnFHIR/
BlendingFHIRandRDF/swat4ls.
? While it would possible provide dummy names for blank nodes for demonstration
purposes, doing so would be impractical in a large scale, production environment
(All URL’s accessed October 1, 2017.)</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>1. Welcome to FHIR R c . http://www.hl7.org/fhir.</mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>2. XML Representation of Resources. http://hl7.org/fhir/xml.html.</mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>3. JSON Representation of Resources. http://hl7.org/fhir/json.html.</mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>FHIR</given-names>
            <surname>Release</surname>
          </string-name>
          <article-title>3 (STU)</article-title>
          . http://hl7.org/fhir/STU3
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>5. RDF Representation of Resources. http://hl7.org/fhir/rdf.html</mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          <article-title>The Protégé project: A look back and a look forward</article-title>
          .
          <source>AI Matters. Association of Computing Machinery Specific Interest Group in Artificial Intelligence</source>
          ,
          <volume>1</volume>
          (
          <issue>4</issue>
          ),
          <year>June 2015</year>
          . DOI:
          <volume>10</volume>
          .1145/2557001.25757003.
          <article-title>W3C Resource Description Framework (RDF) 2016</article-title>
          . http://www.w3.org/RDF/.
          <source>Published February 25</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Tsarkov</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I.</given-names>
          </string-name>
          <article-title>FaCT++ Description Logic Reasoner: System Description</article-title>
          .
          <source>Proc. of IJCAR</source>
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Health</given-names>
            <surname>Level Seven R . International</surname>
          </string-name>
          . http://www.hl7.org.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <article-title>9. HL7 Version 2 Product Suite</article-title>
          . http://www.hl7.org/implement/standards/ product_brief.
          <source>cfm?product_id=185</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. HL7 Version 3 Product Suite http://www.hl7.org/implement/standards/ product_brief.
          <source>cfm?product_id=186</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>CDA R</surname>
          </string-name>
          <article-title>Release 2</article-title>
          . http://www.hl7.org/implement/standards/product_brief.
          <source>cfm?product_id=7</source>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Fielding</surname>
          </string-name>
          , Roy T.; Taylor, Richard N. “
          <article-title>Principled Design of the Modern Web Architecture" ACM Transactions on Internet Technology</article-title>
          , New York: Association for Computing Machinery,
          <volume>2</volume>
          (
          <issue>2</issue>
          ):
          <volume>115</volume>
          ?
          <fpage>150</fpage>
          ,
          <string-name>
            <surname>ISSN</surname>
          </string-name>
          1533-5399, doi:10.1145/514183.514185
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <article-title>Introducing HL7 FHIR</article-title>
          . http://www.hl7.org/fhir/summary.html
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <article-title>W3C Semantic Web Health Care and Life Sciences Interest Group</article-title>
          . https://www. w3.org/blog/hcls/
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>SHEX - Shape Expressions</surname>
          </string-name>
          . http://shex.io/
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Solbrig</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prud'hommeaux</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grieve</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McKenzie</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mandel</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharma</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <article-title>Jiang j. Modeling and Validating HL7 FHIR Profiles Using Semantic Web Shape Expressions (ShEx)</article-title>
          .
          <source>JBI 67:1</source>
          ,
          <fpage>90</fpage>
          -
          <lpage>100</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <article-title>The FHIR Metadata Vocabulary</article-title>
          . http://hl7.org/fhir/fhir.ttl
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Heath</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
            <given-names>C</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Linked Data: Evolving the Web into a Global Data Space (1st edition)</article-title>
          .
          <source>Synthesis Lectures on the Semantic Web: Theory and Technology</source>
          ,
          <volume>1</volume>
          :
          <issue>1</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>136</lpage>
          . Morgan &amp; Claypool.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <article-title>FHIRPath STU1 Release</article-title>
          . http://hl7.org/fhirpath/index.html
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>20. Dublin Core Metadata Initiative. http://dublincore.org/</mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>SNOMED International SNOMED CT</surname>
          </string-name>
          <article-title>Browser</article-title>
          .
          <year>v1</year>
          .
          <volume>36</volume>
          .1. http://browser. ihtsdotools.org
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <article-title>OWL 2 Web Ontology Language: Structural Specification</article-title>
          and
          <string-name>
            <surname>Functional-Style Syntax (Second Edition) Motik</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          , eds.
          <source>W3C Recommendation</source>
          ,
          <issue>11</issue>
          <year>December 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <article-title>The Snorocket classifier</article-title>
          . https://github.com/aehrc/snorocket
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Yevgeny</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krötzsch</surname>
            <given-names>M</given-names>
          </string-name>
          , Siman˘cík,
          <string-name>
            <surname>F.</surname>
          </string-name>
          <article-title>The Incredible ELK</article-title>
          .
          <article-title>From Polynomial Procedures to Efficient Reasoning with</article-title>
          E
          <string-name>
            <given-names>L</given-names>
            <surname>Ontologies. J Autom Reasoning</surname>
          </string-name>
          (
          <year>2014</year>
          )
          <volume>53</volume>
          :
          <fpage>1</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Dentler</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Cornet</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          et. al.:
          <article-title>Comparison of Reasoners for large Ontologies in the OWL 2 EL Profile</article-title>
          .
          <source>Semantic Web Journal</source>
          <volume>2</volume>
          (
          <issue>2</issue>
          ),
          <fpage>71</fpage>
          -
          <lpage>87</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>