<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Building A Semantic Web-based Metadata Repository for Facilitating Detailed Clinical Modeling in Cancer Genome Studies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Guoqian Jiang</string-name>
          <email>jiang.guoqian@mayo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Deepak K. Sharma</string-name>
          <email>sharma.deepak2@mayo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Harold R. Solbrig</string-name>
          <email>solbrig.harold@mayo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cui Tao</string-name>
          <email>cui.tao@uth.tmc.edu</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Chunhua Weng</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christopher G. Chute</string-name>
          <email>chute@mayo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Columbia University</institution>
          ,
          <addr-line>New York City, NY</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Health Sciences Research, Mayo Clinic College of Medicine</institution>
          ,
          <addr-line>Rochester, MN</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>University of Texas Health Science Center at Houston Houston</institution>
          ,
          <addr-line>TX</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Detailed Clinical Models (DCMs) have been regarded as the basis for retaining computable meaning when data are exchanged between heterogeneous computer systems. To better support clinical cancer data capturing and reporting, there is an emerging need to develop informatics solutions for standardsbased clinical models in cancer study domains. The objective of the study is to develop and evaluate a use case-driven approach that enables a Semantic Webbased cancer study metadata repository based on both ISO11179 metadata standard and Clinical Information Modeling Initiative (CIMI) Reference Model (RM). We used the common data elements (CDEs) defined in The Cancer Genome Atlas (TCGA) data dictionary, and extracted the metadata of the CDEs using the NCI Cancer Data Standards Repository (caDSR) CDE dataset rendered in the Resource Description Framework (RDF). The ITEM/ITEM_GROUP pattern defined in the latest CIMI RM is used to represent reusable model elements (mini-Archetypes). We performed a case study of the domain “clinical pharmaceutical” in the TCGA data dictionary to demonstrate the clinical utility of our approach. We produced a metadata repository with 38 clinical cancer genome study domains, comprising a rich collection of mini-Archetype pattern instances. In summary, our informatics approach leveraging Semantic Web technologies provides an effective way to build a CIMIcompliant metadata repository that would facilitate the detailed clinical modeling to support use cases beyond TCGA in clinical cancer study domains.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>Detailed Clinical Models (DCMs)</kwd>
        <kwd>Clinical Information Modeling Initiative (CIMI)</kwd>
        <kwd>Common Data Elements (CDEs)</kwd>
        <kwd>The Cancer Genome Atlas (TCGA)</kwd>
        <kwd>Cancer Studies</kwd>
        <kwd>Semantic Web Technologies</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Detailed Clinical Models (DCMs) have been regarded as the basis for retaining
computable meaning when data are exchanged between heterogeneous computer systems
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). Several independent DCM initiatives have emerged, including HL7 DCMs (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ),
ISO/CEN EN13606/Open-EHR Archetype (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ), Intermountain Healthcare Clinical
Element Models (CEMs) (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ), and the Clinical Information Model in the Netherlands
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        ). The collective DCM community has recently initiated an international
collaboration effort known as the Clinical Information Modeling Initiative (CIMI) (
        <xref ref-type="bibr" rid="ref6">6</xref>
        ). The
primary goal of CIMI is to provide a shared repository of detailed clinical information
models based on common formalism.
      </p>
      <p>
        While the primary focus of these DCM efforts has been on interoperability between
electronic health record (EHR) systems, there are also emerging interests in the use of
DCMs in the context of clinical research and broad secondary use of EHR data. A
typical use case is the Office of the National Coordinator (ONC) Strategic Health IT
Advanced Research Projects Area 4 (SHARPn) (
        <xref ref-type="bibr" rid="ref7 ref8">7-8</xref>
        ), in which the Intermountain
Healthcare CEMs have been adopted for normalizing patient data for the purpose of
secondary use. In the context of clinical research, for example, Clinical Data
Interchange Standards Consortium (CDISC) intends to build reusable domain-specific
templates under its SHARE project (
        <xref ref-type="bibr" rid="ref10 ref9">9-10</xref>
        ).
      </p>
      <p>
        To better support clinical cancer data capturing and reporting, there is an emerging
need to develop informatics solutions for standards-based clinical models in clinical
cancer study domains. For example, National Cancer Institute (NCI) has implemented
the Cancer Data Standards Repository (caDSR) (
        <xref ref-type="bibr" rid="ref11">11</xref>
        ), together with a controlled
terminology service (known as Enterprise Vocabulary Services – EVS), as the
infrastructure to support a variety of use cases from difference clinical cancer study
domains. NCI caDSR has adopted the ISO 11179 metadata standard that specifies a
standard data structure for a common data element (CDE) (12-13).
      </p>
      <p>The use case in this study is based on The Cancer Genome Atlas (TCGA)
Biospecimen Core Resource (BCR) data dictionary (14). The data dictionary is used to create
clinical data collection forms for different clinical cancer genome study domains.
TCGA clinical data include vital status at time of report, disease-specific diagnostic
information, initial treatment regiments and participant follow-up information (15).
The data dictionary groups a preferred set of CDEs per TCGA cancer study domain
and renders them as an XML Schema document. All clinical data collected are
validated against these schemas, which provides a layer of standards-based data quality
control. All the CDEs are recorded in the NCI caDSR repository, the implementation
of which is based on the ISO 11179 standard. We envision the definition of a
preferred set of CDEs for each clinical cancer study domain is analogous to the DCM
modeling effort.</p>
      <p>The objective of the study is to develop and evaluate a use case-driven approach that
enables a Semantic Web-based metadata repository based on both ISO11179
metadata standard and Clinical Information Modeling Initiative (CIMI) Reference Model
(RM). We first used the XML2RDF Transformation technology to transform TCGA
data dictionary and caDSR CDE dataset from XML format to RDF-based
representation. This transformation allows us to use SPARQL queries to retrieve the caDSR
metadata elements that correspond to the CDEs defined in TCGA data dictionary. We
then transformed the CIMI Reference Model from UML to a corresponding OWL
representation and harmonized it with a subset of ISO 11179 metadata model, from
which, we extracted the ITEM/ITEM_GROUP patterns out of the data structures of
the CDEs in each TCGA cancer genome study sub-domain, and populated the
patterns as the instances of the CIMI Reference Model schema. Finally, we performed a
case study in a sub-domain clinical pharmaceutical to demonstrate clinical utility of
our proposed approach.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Materials and Methods</title>
      <sec id="sec-2-1">
        <title>Materials</title>
        <sec id="sec-2-1-1">
          <title>2.1.1 ISO 11179 and its OWL representations</title>
          <p>ISO 11179 is an international standard known as the ISO/IEC 11179 Metadata
Registry (MDR) standard (12). It consists of six parts. Part 3 of the standard uses a
metamodel to describe the information modeling of a metadata registry, which provides a
mechanism for understanding the precise structure and components of
domainspecific models.</p>
          <p>
            Figure 1 shows a diagram illustrating the high-level data description meta-model in
the ISO 11179 specification. The Data Element is one of foundational concepts in the
specification. ISO 11179 also specifies the relationships and interfaces between data
elements, value sets (i.e., enumerated value domains) and standard terminologies.
Several Semantic Web-based representations of the ISO 11179 Part 3 meta-model
have been created for projects including the XMDR project (16), Semantic MDR in a
European SALUS project (17) and CDISC2RDF in FDA PhUSE Semantic
Technology project (18). In the present study, we utilize a meta-model schema in OWL/RDF
developed in the CDISC2RDF project, which is a subset of ISO 11179 Part 3
metamodel.
The CIMI Reference Model (RM) is an information model from which CIMI’s
clinical models (i.e., archetypes) are derived (
            <xref ref-type="bibr" rid="ref6">6</xref>
            ). The CIMI DCM’s are expressed as
formal constraints on the underlying RM. The CIMI RM is represented in the Unified
Modeling Language (UML). The September 5, 2014 version of the CIMI RM (v2.0.1)
had four packages: 1) CIMI Core Model; 2) Data Value Types; 3) Primitive Types
and 4) Party. Core Model package includes the main classes in the CIMI RM. The
Data Value Types and Primitive Types packages defines the data types used in the
other two packages, The Party package defines the generic concepts of PARTY,
ROLE and related details that provide a flexible way for defining demographic
attributes that may be required.
          </p>
          <p>Figure 2 shows the Version v2.0.1 of CIMI Core Model. The classes ITEM,
ITEM_GROUP, and ELEMENT form a generic pattern that can be used to represent
a wide variety of clinical information. We will refer to this pattern as as the
“ITEM/ITEM_GROUP pattern”. ITEM is the abstract parent of both ITEM_GROUP
and ELEMENT. ITEM_GROUP represents the grouping variant of ITEM as an
ordered list. ELEMENT represents a “leaf” ITEM which carries no further recursion.
Figure 3 shows Archetype Definition Language (ADL) (19) definition of a “Body
Temperature” archetype, which illustrates how ITEM_GROUP and ELEMENT can
be combined when representing a clinical concept.</p>
        </sec>
        <sec id="sec-2-1-2">
          <title>2.1.3 caDSR CDE dataset</title>
          <p>
            NCI caDSR is part of the NCI Cancer Common Ontological Representation
Environment (caCORE) infrastructure and uses caCORE resources to support data
standardization in cancer clinical research studies (
            <xref ref-type="bibr" rid="ref11">11</xref>
            ). The system includes an administrator
web interface for overall system and CDE management activities. Integrated with
caCORE Enterprise Vocabulary Services (EVS), the CDE Curation Tool aids
developers in consumption of NCI controlled vocabulary and standard terminologies for
naming and defining CDEs.
          </p>
          <p>NCI caDSR provides the ability to download CDEs in either Excel or XML format
(20), which we used to download an XML image of all non-retired production CDEs
(i.e., CDEs with Workflow status NOT = “RETIRED”) as of August 7, 2014. Figure 4
shows an XML rendering of the CDE “Pharmacologic Substance Begin Occurrence
Month Number”.</p>
        </sec>
        <sec id="sec-2-1-3">
          <title>2.1.4 TCGA data dictionary</title>
          <p>The Cancer Genome Atlas (TCGA), a joint venture supported by the NCI and the
National Human Genome Research Institute (NHGRI), is a comprehensive and
coordinated effort to accelerate the understanding of the molecular basis of cancer through
the application of genome analysis technologies, including large-scale genome
sequencing. Being a component of TCGA Research Network, the Biospecimen Core
Resource (BCR) serves as the centralized tissue processing and clinical data
collection center. A BCR data dictionary has been produced using the standard CDEs from
NCI caDSR. The CDEs in the data dictionary are publicly available in the XML
format. In this project, we will download a snapshot of the data dictionary from the
TCGA website (14).</p>
        </sec>
        <sec id="sec-2-1-4">
          <title>2.2.1 RDF transformation of caDSR and TCGA datasets</title>
          <p>The XML2RDF tool, developed by the Redefer project (21), was used to transform
the XML based TCGA data dictionary and caDSR production CDEs into a
corresponding RDF representation. We loaded the resulting RDF datasets into a 4store
instance (CITE), an open-source RDF triple-store and exposed them via a SPARQL
endpoint, allowing us to use the SPARQL query language to preform semantic
queries across the datasets.
2.2.2 OWL-based schema for CIMI Reference Model and ISO 11179
We used the latest version of CIMI RM (v2.0.1) in XMI format. We then converted
the CIMI RM from XMI to RDF format using the Redefer XML2RDF transformation
services (21). We then defined the SPARQL queries to retrieve the UML based
elements of the CIMI RM such as classes, attributes and associations. We created a
JAVA program that produces an OWL rendering of the CIMI RM using the
UML2OWL mappings specified by the Object Management Group (OMG) Ontology
Definition meta-model (ODM) standard (22). We finally harmonized and created an
OWL-based schema for CIMI RM and ISO11179.
2.2.3 Defining and populating reusable archetype patterns
We defined reusable archetype patterns that capture the clinical cancer domains
defined in TCGA data dictionary, their associated CDEs and the metadata structures
(Object Class, Property, Value Domain, etc.) recorded in the caDSR data repository.
We then defined a collection of SPARQL queries to retrieve the metadata elements
from both TCGA data dictionary and caDSR CDE dataset. Figure 7 shows a
SPARQL query example that retrieves all CDEs of the domain “clinical
pharmaceutical” defined in TCGA data dictionary and their metadata recorded in caDSR CDE
dataset. We also developed a JAVA program that populates all reusable archetype
patterns in TCGA clinical cancer domains into the instance data against OWL-based
schema as we created.</p>
        </sec>
        <sec id="sec-2-1-5">
          <title>2.2.4 Evaluation of clinical utility</title>
          <p>We finally performed a case study for the domain Clinical Pharmaceutical to
demonstrate clinical utility of our approach. Specifically, we demonstrated how many
properties and enumerated value domains are enriched for the domain through the ISO
11179-based data elements recorded in the NCI caDSR. We then evaluate clinical
utility of the enriched data elements using a Medication template defined in CDISC
Clinical Data Acquisition Standards Harmonization (CDASH) standard (23).</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>In total, TCGA data dictionary contains 38 clinical cancer domains and 775 CDEs,
which covers 21 cancer types. Table 1 shows a list of examples showing the clinical
cancer domains and the number of CDEs in each domain.
We created an OWL rendering of CIMI RM and harmonized it with the ISO 11179
metadata model schema, in which all classes defined in the CIMI RM are asserted as
the subclasses of an ISO 11179 class mms:AdministeredItem. Figure 8 shows a
screenshot of Protégé 4 environment illustrating the class hierarchy of OWL-based
schema for harmonized CIMI RM with ISO 11179 model.
We populated reusable archetype patterns against the OWL-based schema and
produced a metadata repository based in RDF format. The repository covers all 38
clinical cancer study domains, comprising 316 distinct object classes, 4719 distinct
properties, 1015 non-enumerated value domains and 1795 enumerated value domains (i.e.,
value sets).</p>
      <p>Table 2 shows two pattern examples extracted from the TCGA domain “clinical
pharmaceutical”. Pattern 1 captures a number of CDEs asserted in the TCGA data
dictionary; Pattern 2 captures equivalent metadata structures (Object Class, Property,
Value Domain, etc.) recorded in the caDSR data repository. The 7 CDEs captured in
Pattern 1 have their “Object Class” in common that is “Pharmacologic Substance.”
The “Pharmacologic Substance” is linked with three “Property” instances: “Begin
Occurrence,” “End Occurrence” and “Continue Occurrence.” The properties are
associated with 4 Value Domains: “Event Year Number”, “Event Month Number,”
“Event Day Number”, and “Yes No Character Indicator”.</p>
      <sec id="sec-3-1">
        <title>Evaluation results</title>
        <p>As a case study, we looked into the domain Clinical Pharmaceutical that contains 18
CDEs. We retrieved the object classes recorded in caDSR and identified 11 distinct
object classes. And then, we retrieved globally in the caSDR CDE datasets for all
properties and value domains associated with the 11 object classes. Figure 9 shows a
bar graph illustrating the enrichment for the domain Clinical Pharmaceutical by data
element, property, value domain and enumerated value domain. The graph indicated
that the domain is greatly enriched with properties and value domains associated with
those 11 object classes, which forms a pool of data elements that could be used to
build detailed clinical models in this domain.</p>
        <p>500
450
400
350
300
250
200
150
100
50
0
Data Element</p>
        <p>Property</p>
        <p>Value Domain
6</p>
        <p>124
Enumerated</p>
        <p>Value Domain
Before enrichment</p>
        <p>After enrichment
To evaluate clinical utility of our approach, we aligned the data elements between
CDASH Medication and TCGA Clinical Pharmaceutical. Table 3 shows the
alignment results. Out of 20 CDASH data elements with their data collection questions, 9
of them aligned with the CDEs asserted in TCGA data dictionary whereas 10 of them
aligned with those enriched data elements identified from our system. We believe that
the results demonstrated the enriched data elements are useful in building a clinical
model for the use cases beyond original TCGA data dictionary.
Cumulative Agent Total Dose
Total Dose Units;Prescribed Dose
Units
Pharmaceutical Dosage Form Code
Number Cycles
Route Of Administration
Year Of Drug Therapy Start;Month Of
Drug Therapy Start;Day Of Drug
Therapy Start
Agent Administered Begin Time
Prior Therapy Treatment Regimen
Year Of Drug Therapy End; Month Of
Drug Therapy End; Day Of Drug
Therapy End
Agent Administered End Time
Therapy Ongoing
The metadata repository system proposed in this study has the following three major
implications. The first implication is that the system would enable producing a profile
of CIMI-compliant DCM models for TCGA clinical cancer study domains by
leveraging the best practice of DCM modeling in CIMI community. Pattern 1 as shown in
Table 2 is designed to capture a preferred set of CDEs and metadata for each domain
asserted in the TCGA data dictionary. The semantics captured in Pattern 1 should be
equivalent to those asserted in TCGA XML Schemas. In other words, Pattern 1 serves
as the CIMI-compliant representation of a preferred set of CDEs in a TCGA cancer
study domain.</p>
        <p>The second implication is that we gained new insights on how ISO 11179 standard
could interact with CIMI RM for supporting detailed clinical modeling. The added
value would ultimately be the ability to represent ISO 11179 based constructs as
constraints on CIMI RM. Pattern 2 is designed to capture equivalent metadata structures
(Object Class, Property, Value Domain, etc.) of a CDE informed by ISO 11179. As
shown in Table 2, Pattern 2 is represented in a post-coordination manner following
certain rules. The approach used in Pattern 2 is similar to the dissection approach that
is a common practice used in the terminology space for development of re-usable
terminologies. The dissection approach was originally used by the GALEN project
(24). In fact, the components in the metadata structure are usually annotated with
concept codes from a standard terminology. In NCI caDSR, NCI Thesaurus has been
largely used for the annotation purpose. Taking a look at Pattern 2 as shown in Table
2, “Pharmacologic Substance”, an object class, has NCIt code C1909 annotated;
“Begin Occurrence”, a property, has NCI codes “C25431:C25275” annotated. In
addition, the post-coordination-based approach enabled us to globally retrieve all
properties associated with a particular object class. For example, there are globally 40
properties associated with the object class “Pharmacologic Substance” in NCI caDSR,
resulting in additional 37 more properties and 5 more associated value domains.
Figure 9 also shows such enrichment for the domain Clinical Pharmaceutical. We believe
that our approach would produce a rich collection of archetype patterns and
constraints (e.g., datatypes, value sets, terminology bindings, etc.) that could be used to
facilitate detailed clinical modeling in clinical cancer study domain for use cases
beyond TCGA.</p>
        <p>The third implication is that we demonstrated the value of using Semantic Web
technologies and tools in building such metadata repository. First, we created an OWL
rendering of CIMI RM. This allowed us to seamlessly integrate the CIMI RM with an
existing OWL-based ISO 11179 model. We envision that CIMI RM and ISO 11179
are two complementary standards that could greatly enhance the DCM modeling and
its metadata management. Second, we used XML2RDF Transformation technology to
transform XML-based TCGA data dictionary and caDSR CDE dataset into
RDFbased format. This allows us to use standard SPARQL query language to define
queries to retrieve metadata of a CDE across datasets while this enables a
highthroughput approach for globally searching metadata of nearly 50,000 CDEs recorded
in the NCI caDSR. Third, we populated reusable archetype patterns against the
OWLbased schema using a RDF-based representation. This will allow us to leverage the
built-in OWL DL reasoning capability and the RDF validation tools such as Shape
Expressions (25) to check the consistency and data quality of CIMI-compliant DCM
models.
5</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In summary, we developed a use case-driven approach that enables a Semantic
Webbased metadata repository in support of authoring DCMs in clinical cancer study
domains. All schemas and datasets produced in this study can be accessible publicly at:
http://informatics.mayo.edu/caCDE-QA/index.php/Download. Future work will
include 1) developing Semantic Web-based RESTful services for the archetype patterns
recorded in the metadata repository; 2) building quality assurance mechanism for
CIMI-compliant DCMs leveraging OWL DL reasoning and RDF validation tools; 3)
creating DCM authoring tools using the metadata repository as the backend; 4)
developing tools that enable the transformation of DCM models between RDF/OWL-based
format and ADL-based format.</p>
      <p>Acknowledgements: The study is supported in part by a NCI U01 Project –
caCDEQA (1U01CA180940-01A1). The authors would like to thank Julie Evans and Dr.
Rebecca Kush from CDISC, for their kindly support and input.
6
12) ISO 11179 Specification [September 10, 2014].
http://standards.iso.org/ittf/PubliclyAvailableStandards/c050340_ISO_IEC_1117
9-3_2013.zip
13) Warzel DB, Andonaydis C, McCurry B, Chilukuri R, Ishmukhamedov S, Covitz
P. Common data element (CDE) management and deployment in clinical trials.
AMIA Annual Symposium proceedings / AMIA Symposium AMIA
Symposium. 2003:1048. Epub 2004/01/20. PubMed PMID: 14728551; PubMed
Central PMCID: PMC1480162.
14) TCGA BCR Data Dictionary 2014 [September 10, 2014]. Available from:
https://tcga-data.nci.nih.gov/docs/dictionary/.
15) TCGA Clinical Data 2014 [September 10, 2014]. Available from:
https://wiki.nci.nih.gov/display/TCGA/Clinical+data.
16) XMDR Project [September 10, 2014]. http://en.wikipedia.org/wiki/XMDR
17) Semantic MDR Project [September 10, 2014].</p>
      <p>https://github.com/srdc/semanticMDR
18) CDISC2RDF Project [September 10, 2014].
https://github.com/phuseorg/rdf.cdisc.org .
19) Body Temperature Archetype in ADL. [September 10, 2014].
https://github.com/opencimi/archetypes/blob/master/miniCIMI/CIMI-COREITEM_GROUP.body_temperature.v1.0.0.adls.
20) caDSR Downloads [September 10, 2014].</p>
      <p>https://wiki.nci.nih.gov/display/caDSR/caDSR+Downloads.
21) Redefer Project [September 10, 2014]. http://rhizomik.net/html/redefer/.
22) OMG ODM Specification [September 10, 2014].</p>
      <p>http://www.omg.org/spec/ODM/.
23) CDISC CDASH [September 28, 2014]. http://www.cdisc.org/cdash.
24) Rector AL, Rogers JE, Zanstra PE, Van Der Haring E;
OpenGALEN.OpenGALEN: open source medical terminology and tools. AMIA Annu
Symp Proc. 2003:982.
25) Shape Expressions [September 10, 2014]. http://www.w3.org/2013/ShEx/Primer.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1)
          <string-name>
            <surname>Coyle</surname>
            <given-names>JF</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mori</surname>
            <given-names>AR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huff</surname>
            <given-names>SM</given-names>
          </string-name>
          .
          <article-title>Standards for detailed clinical models as the basis for medical data exchange and decision support</article-title>
          .
          <source>International journal of medical informatics</source>
          .
          <year>2003</year>
          ;
          <volume>69</volume>
          (
          <issue>2-3</issue>
          ):
          <fpage>157</fpage>
          -
          <lpage>74</lpage>
          . Epub 2003/06/18. PubMed PMID:
          <volume>12810120</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <source>2) HL7 Detailed Clinical Models 2014 [September 10</source>
          ,
          <year>2014</year>
          ]. Available from: http://wiki.hl7.org/index.php?title=Detailed_Clinical_Models.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3)
          <string-name>
            <surname>Beale</surname>
            <given-names>T.</given-names>
          </string-name>
          <article-title>Archetypes and the EHR</article-title>
          .
          <article-title>Studies in health technology and informatics</article-title>
          .
          <year>2003</year>
          ;
          <volume>96</volume>
          :
          <fpage>238</fpage>
          -
          <lpage>44</lpage>
          . Epub 2004/04/06. PubMed PMID:
          <volume>15061551</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <source>4) Clinical Element Model 2014 [September 10</source>
          ,
          <year>2014</year>
          ]. Available from: http://www.clinicalelement.com/.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5)
          <string-name>
            <surname>van der Kooij</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goossen</surname>
            <given-names>WT</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goossen-Baremans</surname>
            <given-names>AT</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plaisier</surname>
            <given-names>N.</given-names>
          </string-name>
          <article-title>Evaluation of documents that integrate knowledge, terminology and information models</article-title>
          .
          <source>Studies in health technology and informatics</source>
          .
          <year>2006</year>
          ;
          <volume>122</volume>
          :
          <fpage>519</fpage>
          -
          <lpage>22</lpage>
          . Epub 2006/11/15. PubMed PMID:
          <volume>17102312</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6)
          <string-name>
            <given-names>Clinical</given-names>
            <surname>Information Modeling Initiative</surname>
          </string-name>
          (CIMI)
          <year>2014</year>
          [September 10,
          <year>2014</year>
          ]. Available from: http://informatics.mayo.edu/CIMI/index.php/Main_Page.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7)
          <string-name>
            <surname>Chute</surname>
            <given-names>CG</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pathak</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savova</surname>
            <given-names>GK</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bailey</surname>
            <given-names>KR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schor</surname>
            <given-names>MI</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hart</surname>
            <given-names>LA</given-names>
          </string-name>
          , et al.
          <article-title>The SHARPn project on secondary use of Electronic Medical Record data: progress, plans, and possibilities</article-title>
          .
          <source>AMIA Annual Symposium proceedings / AMIA Symposium AMIA Symposium</source>
          .
          <year>2011</year>
          ;
          <year>2011</year>
          :
          <fpage>248</fpage>
          -
          <lpage>56</lpage>
          . Epub 2011/12/24. PubMed PMID: 22195076;
          <string-name>
            <surname>PubMed Central</surname>
            <given-names>PMCID</given-names>
          </string-name>
          :
          <fpage>PMC3243296</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8)
          <string-name>
            <surname>Pathak</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bailey</surname>
            <given-names>KR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beebe</surname>
            <given-names>CE</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bethard</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carrell</surname>
            <given-names>DC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            <given-names>PJ</given-names>
          </string-name>
          , et al.
          <article-title>Normalization and standardization of electronic health records for highthroughput phenotyping: the SHARPn consortium</article-title>
          .
          <source>Journal of the American Medical Informatics Association : JAMIA</source>
          .
          <year>2013</year>
          ;
          <volume>20</volume>
          (
          <issue>e2</issue>
          ):
          <fpage>e341</fpage>
          -
          <lpage>8</lpage>
          . Epub 2013/11/06. doi:
          <volume>10</volume>
          .1136/amiajnl-2013
          <article-title>-001939</article-title>
          . PubMed PMID: 24190931;
          <string-name>
            <surname>PubMed Central</surname>
            <given-names>PMCID</given-names>
          </string-name>
          :
          <fpage>PMC3861933</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <source>9) CDISC SHARE Project 2014 [September 10</source>
          ,
          <year>2014</year>
          ]. Available from: http://www.cdisc.org/cdisc-share.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10)
          <string-name>
            <surname>Jiang</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evans</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Endle</surname>
            <given-names>CM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Solbrig</surname>
            <given-names>HR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chute</surname>
            <given-names>CG</given-names>
          </string-name>
          , editors.
          <article-title>Using Semantic Web Technologies for the Generation of Domain Templates to Support Clinical Study Metadata Standards</article-title>
          .
          <volume>SWAT4LS</volume>
          <fpage>2013</fpage>
          -
          <article-title>-Semantic Web Applications and Tools for Life</article-title>
          <source>Sciences; 2013 December 10</source>
          ,
          <year>2013</year>
          ; Edinburgh, UK: CEUR Workshop Proceedings;
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11)
          <string-name>
            <surname>Covitz</surname>
            <given-names>PA</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hartel</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schaefer</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Coronado</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fragoso</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sahni</surname>
            <given-names>H</given-names>
          </string-name>
          , et al.
          <article-title>caCORE: a common infrastructure for cancer informatics</article-title>
          .
          <source>Bioinformatics</source>
          .
          <year>2003</year>
          ;
          <volume>19</volume>
          (
          <issue>18</issue>
          ):
          <fpage>2404</fpage>
          -
          <lpage>12</lpage>
          . Epub 2003/12/12. PubMed PMID:
          <volume>14668224</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>