<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Model-based Integration of Clinical Practice Guidelines in Clinical Pathways</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Katja Heiden</string-name>
          <email>katja.gippert@fh-dortmund.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Applied Sciences and Arts, Faculty of Medical Informatics</institution>
          ,
          <addr-line>Emil-Figge-Stra e 42, 44227 Dortmund</addr-line>
          ,
          <country>Germany Supervised by Professor Dr. Jakob Rehof</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Healthcare providers are facing an enormous cost pressure and a scarcity of resources, so that they need to realign in the tension between economic e ciency and demand-oriented healthcare. Clinical Practice Guidelines (CPGs) and clinical pathways have been established to improve the quality of care and to reduce costs at the same time. CPGs have a positive impact on the health outcome. However, their inuence on the clinical routine is still very low due to their narrative and non-formalized form. This paper presents a model-based approach, how CPGs can be operationalized by transforming the CPGs in clinical pathways and therefore translate the abstract recommendations in concrete process ows. A metamodel will be developed to represent guidelinecompliant pathways and to support the users in the derivation process by information technology.</p>
      </abstract>
      <kwd-group>
        <kwd>Katja Heiden</kwd>
        <kwd>Clinical Practice Guidelines</kwd>
        <kwd>Clinical Pathways</kwd>
        <kwd>Business Process Management</kwd>
        <kwd>Metamodel</kwd>
        <kwd>Health Level 7</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Clinical practice guidelines (CPGs) and clinical pathways have been established
as instruments for the quality assurance and process optimization in the
healthcare domain. Both concepts de ne a standardized best practice for a speci c
disease. CPGs are de ned as "systematically developed statements to assist
practitioner and patient decisions about appropriate health care for speci c clinical
circumstances" [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. CPGs provide evident medical knowledge for diagnostic and
therapeutic issues and contain aggregated information for one speci c medical
indication. The European Pathway Association (E-P-A) de nes a clinical
pathway as "a complex intervention for the mutual decision making and organisation
of care processes for a well-de ned group of patients during a well-de ned
period" [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. In addition, the E-P-A indicates several characteristics, which should
be considered by clinical pathways; e.g. "the coordination of the care process by
coordinating the roles and sequencing the activities of the multidisciplinary care
team, patients and their relatives" [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Thus, clinical pathways can be seen as
a road map of patient management.
The positive impact of clinical practice guidelines on the quality of care has been
scienti cally proven in Grimshaw et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However, their in uence on patient
care in Germany is still very low [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. A decisive factor for the success of CPGs
is the provision of the knowledge at the point of care [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The guideline
recommendations are abstract and therefore not directly applicable. Thus, these
recommendations have to be implemented and tailored to local settings.
Clinical pathways are appropriate for that purpose; they can adapt the content of
clinical guidelines in form of concrete process ows [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. That way, the latest
scienti c ndings can be applied in everyday healthcare and therefore lead to a
best quality of patient care [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
1.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Signi cant Problems</title>
      <p>
        The consideration of CPGs during pathway development is highly recommended,
but there are no standardized mechanisms, which ensure a guideline-compliant
care. The research of pertinent CPGs, the extraction of the relevant medical
knowledge and the integration of these recommendations in the pathway
development process is very time-consuming and resource-intensive. A further
problem in this context is the publication of CPGs in narrative form, e.g. as text or
hypertext documents [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Thus, they are not directly applicable. The rst step
towards a computer-based process support is the formalization of the guideline
content [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. This translation is burdensome, because the narrative guidelines
needs to be mapped onto coded data. Therefore, domain knowledge is required
as well as knowledge about the target language to describe the CPG.
The de nition of the pathways is done by domain experts. For this purpose, an
interdisciplinary team is built composed of all professional groups involved, e.g.
physicians, nurses, medical controllers, quality assurance representatives. The
results of the development process are text documents or informal process models,
which describe the clinical pathway. Thus, they cannot directly be interpreted
by IT-systems; a formal logic is needed and additional technical information for
the enactment of the pathways needs to be de ned, e.g., mapping of service calls
or forms to speci c tasks. The implementation of clinical pathways is a separate
step, which is performed by IT-specialists. It is an error-prone task, because
these experts often do not have detailed domain knowledge and sometimes the
pathway de nitions are ambiguous. There is a high need for communication
between the domain- and the IT-specialists [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Several cycles are necessary to
implement the pathways in the information systems. Thus, a gap between
development and implementation of clinical pathways exists as well as a media break
between both process steps.
      </p>
      <p>The CPGs o er a lot of additional information, which are not directly relevant for
the control ow of the patient treatment. For example, complications or guiding
symptoms of a disease are pointed out. This information is often not
considered in the pathway development process, although it would mean an increase
of information during patient care. Clinical pathways are used for training and
education purposes, where they represent reliable action guidelines especially
for young professionals. The additional information from the CPGs could create
added values and should be integrated in pathway models.
1.2</p>
    </sec>
    <sec id="sec-3">
      <title>Research Questions and Objectives</title>
      <p>To adress the problems mentioned in Sect. 1.1, the main research question is
"how clinical pathways can be derived from clinical practice guidelines and how
the interdisciplinary team can be supported in the translation process by
information technology".</p>
      <p>Therefore, a model-based integration of CPGs in the clinical pathways should be
realized and a metamodel is being developed to describe evidence-based
pathways1. Structures and elements of both concepts are merged to one generic
model. This approach supports the entire process and life-cycle of clinical
pathways by one metamodel.</p>
      <p>The research objectives are:
1. Development of a concept describing the derivation process of clinical
pathways from CPGs
2. Collecting all pertinent information pieces and translate them into
components of a generic metamodel
3. Implementation of an editor to support the domain experts in the derivation
process
4. Development of algorithms, which translate the clinical pathways described
by the metamodel into the target language of a speci c system
5. Evaluation of the results in a concrete setting2
2</p>
      <sec id="sec-3-1">
        <title>Related work</title>
        <p>
          Di erent methological approaches exist to implement guideline recommendations
in the operational practice. Those show considerable di erences concerning the
aim or result of the translation process (de ning clinical pathways or creating
alerts and reminders in form of computer-interpretable guidelines). Additionally,
they vary in the degree of automation (highly manual vs. semi-automated
approaches):
One approach is to formalize the content of the CPGs by the help of guideline
representation languages (see [
          <xref ref-type="bibr" rid="ref19 ref9">9, 19</xref>
          ]). The narrative CPGs are translated in a
computer-interpretable form, which can be processed in decision support
systems. It is cumbersome and error-prone to map prose text to coded data [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ],
because CPGs can partly be ambiguous, incomplete, and even inconsistent [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
Several guideline representation languages exist, which di er in the degree of
formalization; task network models, which formally represent medical guidelines
1 The term evidence-based pathway should illustrate that the metamodel combines
characteristic information of the evident CPGs and the clinical pathways (see [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]).
2 This is done in a cooperation with a German hospital.
and medical knowledge (e.g. GLIF [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ], Asbru [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ], PROforma [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]) or XML
representations for structuring guideline documents (e.g. GEM [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]). If
computerinterpretable guidelines (CIGs) should be used by a hospital in order to provide
the medical knowledge in everyday healthcare, the hospital information systems
(HIS) need to have the ability to interpret and use those formalizations. The
result of this translation process is not a clinical pathway by de nition; rather
computer-interpretable guidelines are created, which support the decision
making process during the patient treatment. It provides one way to implement
guidelines in daily routine, but, according to [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], the translation of CPGs into
alerts and reminders does not support the patient treatment as a unit.
The second approach is a highly manual process, where clinical pathways are
developed on the basis of related CPGs (see [
          <xref ref-type="bibr" rid="ref1 ref14 ref6">1, 6, 14</xref>
          ]). The pathway development
process starts with an extensive literature research, where pertinent CPGs for
the clinical pathway can be identi ed. This analysis needs to be done manually
by the interdisciplinary team. In some hospitals even a special group is built to
perform this time-consuming task. The recommendations from the CPGs can
be used as an input for the pathway development. The content of the
medical guidelines needs to be tailored to local conditions and therefore a consensus
among the participating health professionals needs to be reached [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
Information technology is mainly used for modeling tasks. The result of this development
process is a clinical pathway for one speci c healthcare facility. Additionally, it
is an informal or even a paper-based description, which needs to be implemented
in the IT-system of the institution. This approach is very time-consuming and
resource-intensive. Information technology is not used for the whole life-cycle
management of clinical pathways.
        </p>
        <p>
          The last approach focuses the systematic derivation of clinical pathways from
CPGs by the help of a model-based methodology (see [
          <xref ref-type="bibr" rid="ref3 ref8">3, 8</xref>
          ]). Jacobs et al. [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]
developed a reference model for the methodical transfer of CPGs in clinical
pathways. The reference model was exemplary deduced from the breast cancer
treatment. Jacobs et al. try to derive an universal pathway for one CPG, which
can be adapted to a special institution in a further step. Schlieter et al. used the
results from Jacobs et al. and carried them forward. They chose a di erent
representation language for the modeling of clinical pathways. They added rule sets
to the reference model in order to de ne the adaption and extension of speci c
models. That way they o er a description how to use the formalized CPG in an
institution. Both approaches only use the clinical algorithms to derivate clinical
pathways and to link both concepts; additional information of the CPGs are not
employed.
3
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Proposed Solution and Preliminary Result</title>
        <p>We propose a model-based approach for deriving clinical pathways from CPGs
(Fig. 1 shows the main steps of this process).</p>
        <p>The rst step is done by the domain experts. They design a clinical pathway by
considering the recommendation from the CPG and by adding additional
information, which cannot be found in CPGs, e.g. resources, responsibilities, costs,
nursing care. The experts are supported by an interactive editor, which
facilitates the extraction of pertinent information from the CPGs and which provides
functions to record further information. The second step has to be prepared
by IT-specialists. Every clinical pathway is described through the metamodel.
In order to use the clinical pathways in di erent HIS or Work ow Management
Systems (WFMS), they need to be transferred in the target language of a speci c
system (mapping process). This is the precondition for the translation process,
which generates the formalism of the target system. Thus, the metamodel has
two key tasks; it provides a formalized representation and a vendor independent
description of evident pathways. The whole life-cycle management of clinical
pathways is taken into account.
For the purpose of deriving clinical pathways from CPGs, we rstly compared
both concepts based on the following criteria: 1. representation; 2. structure;
3. content; 4. key users; 5. development; 6. dissemination; 7. implementation;
8. standardization; 9. quality improvement; 10. cost e ectiveness; and 11.
liability. We performed a detailed literature research to point out the di erences and
similarities. Tab. 1 summarizes our ndings and outlines the main aspects. These
ndings are further used to de ne the derivation process. The comparison points
out, which information can be extracted from the CPGs, which information has
to be added by the users to describe clinical pathways, which community
functions needs to be provided by the editor to support the development process and
how the information extraction from the CPGs might be realized.
1. arbitrary; prose; tables; clinical paper-based pathways: comparable to
algorithms CPG representation; eletronic
pathways: formalized; process-oriented
2. no binding agreement; very di erent clinical pathway; sub processes;
elements; attributes; values
3. abstract recommendations; statements medical and nursing activities;
for diagnostic and therapeutic issues; resources; responsibilities; timeline;
additional information; strength of costs; treatment goals; inclusion and
evidence; quality indicators exclusion criteria
4. physicians; patients; insurance providers physicians; controlling; patients
5. initiative of the physicians; national, initiative of the health organization;
regional and local developments; cyclic local development; interdisciplinary
process; systematic approach team; cyclic process
6. passive dissemination; electronic and active dissemination</p>
        <p>paper-based media
7. combining di erent implementation implementation is done by IT-experts;
strategies; the most e ective strategy: integration in the HIS creates the most
integration in IT-systems added values
8. reduction of variances; standardization standardized treatment; coordination of
of the decision making process responsibilities; uni cation of the
documentation; elimination of variances
9. best practice; evident knowledge; quality improvement of the processes,
consensus among experts; reliable data structures, outcomes; improvement of
education purposes; controlling
10. bene t-cost analysis; elimination of reduction of average length of stay;
ine ective, outdated and cost-intensive resource-e cient treatment;
procedures transparency of the treatment costs
11. legally non-binding legally non-binding; deviations must be
documented (variance documentation)
3.2</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Development of the Metamodel</title>
      <p>CPGs and clinical pathways show considerable di erences (see Sect. 3.1). Thus, a
metamodel is required, which provides a formalized re ection of evidence-based
pathways. We used di erent sources of information to gather pertinent elements
for the metamodel (see Sect. 4). The identi ed components were transferred into
a preliminary metamodel. The elements can be classi ed into ve categories, (1)
descriptive elements to represent guideline information, e.g. title, validity range,
(2) structural components, e.g. phases and stages of the treatment process, (3)
constructs for the de nition of the control ow, e.g. branches, synchronizations,
decision steps, (4) components to describe the activities, e.g. medical and nursing
activities, and (5) components to de ne responsibilities, e.g. competences and
resources. Additionally, there are information, which cannot be directly mapped
to any of the ve categories. The CPGs provide a lot of unstructured additional
information, e.g. epidemiological facts, causes, risk factors, or complications.
Those information will be represented by a generic parameter system in order
to nd a consistent description of this information.</p>
      <p>
        The selection of an appropriate representation for the metamodel was done by
the evaluation of three guideline representation languages, namely Asbru [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ],
GLIF [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], GEM [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Additionally the Health Level 7 Care Plan Model3 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] was
taken as a reference. We analysed, which language or model can depict most
of the elements. None of them can describe all components of the metamodel;
the guideline representation languages do not provide elements e.g. to describe
responsibilities or resources. The HL7 Care Plan Model does not provide all
required elements to describe the guideline information, e.g., strength of evidence.
Tab. 2 shows the results of the analysis. It outlines the quantity, how many
elements of the metamodel can be depicted (X), partly depicted ((X)), and which
components cannot be described (-) by the representation language.
      </p>
      <p>
        The HL7 Care Plan Model is the most feasible approach to represent the
metamodel. It is not a normative standard yet; rather it is a draft, which is
steadily being re ned [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. As a consequence, it can be used as a basis and new
RIM4-compliant artifacts can be added to represent the remaining elements. In
addition, the HL7 standard is accepted worldwide and it ensures that individual
solutions for speci c target systems and proprietary formats can be avoided. The
HL7 Care Plan Model was extended by de ning the following RIM-compliant
elements, which are not provided by the original model:
1. assignment of CPGs to a clinical pathway (evident basis)
3 HL7 provides standards for interoperability that improve care delivery, optimize
work ow, reduce ambiguity and enhance knowledge transfer among all of the
stakeholders in the healthcare domain (see [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]). The HL7 Care Plan Model can be used
to de ne action plans for various clinical pictures.
4 HL7 version 3 information models are derived from the Reference Information Model
(RIM), which is an information model for health care data.
2. structural components to de ne intersectoral pathways as mentioned in the
CPGs; mapping of di erent clinical pathways to one speci c treatment phase,
e.g. diagnostic and therapeutic care, follow-up, rehabilitation
3. speci cation of costs, strength of evidence and recommendation, etc.
4. de ning the detailed control ow (integrating the HL7 Work ow Control
      </p>
      <p>Suite of Attributes)
5. providing additional information, which are pointed out in CPGs; e.g.
complications, and guiding symptoms
3.3</p>
    </sec>
    <sec id="sec-5">
      <title>Derivation Process</title>
      <p>The conception of the derivation process is still being de ned. The ndings
from the comparison between the CPGs and clinical pathways (see Sect. 3.1)
already show, that the translation is a semi-automated process, which will be
completed by decisions and interactions of the interdisciplinary team. The main
requirements for the editor can be de ned based on the present results:
1. Model component (a clinical pathway should be derived gradually based on
a CPG; functions for the information extraction and recording of additional
information are as well provided as functions to support the division of labor,
e.g. version control, groupware functions, reviews)
2. Translation component (it is a multi-level process to translate the evident
pathways into the formalism of the target system; the technical de nition of
the mapping between the elements of the metamodel and the target system
is done here)
There will be some challenges to meet concerning the creation of concrete path
models, e.g. how to deal with the information, which cannot directly mapped to
an element of the target system?; can the additional information create added
values for the users?; how can they be displayed e.g. by a wiki, which can be
perceived on demand (f.i. by young professionals)?
A detailed requirements analysis will be done in cooperation with a German
hospital, where the local development process will be investigated.
4</p>
      <sec id="sec-5-1">
        <title>Research Methodology</title>
        <p>
          In order to investigate the main research question mentioned in Sect. 1.2, we
conducted a detailed literature review of related approaches, which focus on
the automated or partly automated translation of CPGs in clinical pathways
(see [
          <xref ref-type="bibr" rid="ref17 ref19 ref8 ref9">8, 9, 17, 19</xref>
          ]). We gathered information about remaining problems in that
research area and speci ed them by consulting an experienced process manager
and path designer. That way, a problem-solving approach could be investigated
based on the ndings of the literature review and the practical evaluation in a
healthcare facility.
        </p>
        <p>
          Components for the metamodel were gathered through the analysis of guideline
representation languages (GEM [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], GLIF [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ], Asbru [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]), existing CPGs5,
clinical pathways and path modules6. Thus, characteristic information of both
concepts could be collected and transferred to a preliminary metamodel. The
analysis of existing languages and models substantiate the hypothesis, that there
is no language or model, which can merge the information contained in the CPGs
and the clinical pathways.
        </p>
        <p>The resulting system prototype will be evaluated in a concrete local setting.
5</p>
      </sec>
      <sec id="sec-5-2">
        <title>Expected Contributions</title>
        <p>This model-based approach supports hospitals or other healthcare facilities in
considering the CPGs during the pathway development process and therefore
in transferring the latest scienti c ndings into everyday healthcare. The editor
should enable the domain experts to model the clinical pathway on their own and
therefore closes the gap between development and implementation (domain- vs.
IT-specialists). The result of the translation process is the ready-to-use clinical
pathway for a speci c target system. In addition, the HL7 representation ensures
a non-proprietary solution; for IT systems, which can import clinical pathways
using a HL7 interface, the last translation step is not even required. In
contrast to other approaches in that research area, the whole development process
(de nition, implementation, life-cycle management) is supported by information
technology. Each presented approach in Sect. 2 covers only one aspect of the
entire derivation process; a formal representation (see CIGs), the development
of concrete clinical pathways for one speci c institution (manual process), or
the systematic translation (model-based approach). With the aid of information
technology it is expected that the development time of clinical pathways can be
reduced and the de nition of guideline-compliant pathways can be ensured.
5 We chose CPGs with di erent complexity, scope, and degree of interdisciplinary. We
analysed in a rst step CPGs for the following medical indications: chronic cardiac
insu ciency, breast carcinoma, and calculous biliary disease. The metamodel needs
to be veri ed by further CPGs.
6 We evaluated di erent HIS modules for the enactment of
clinical pathways: Carestation (http://www.commed-kis.ch/),
iMedOne (http://www.tieto.de/branchen/healthcare/KIS), and Orbis
(http://www.agfahealthcare.com/germany/de/main/)</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Biber</surname>
            ,
            <given-names>F.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schnabel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kopp</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Implementierungsstrategien klinischer Pfade Barrierenorientierte Interventionen am Beispiel "proximale Femurfraktur"</article-title>
          .
          <source>Marburg</source>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Boxwala</surname>
            ,
            <given-names>A.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peleg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tu</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ogunyemi</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zeng</surname>
            ,
            <given-names>Q.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel</surname>
            ,
            <given-names>V.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Greenes</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          , Shortli e, E.H.:
          <article-title>GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines</article-title>
          .
          <source>J Biomed Inform</source>
          ,
          <volume>37</volume>
          (
          <issue>3</issue>
          ),
          <fpage>147</fpage>
          -
          <lpage>161</lpage>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Burwitz</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schlieter</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Esswein</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Modellgestutztes Management in Krankenhausinformationssystemen am Beispiel der Klinischen Prozesssteuerung</article-title>
          . Tagungsband
          <string-name>
            <surname>Informatiktagung</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Field</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lohr</surname>
            ,
            <given-names>K.N.:</given-names>
          </string-name>
          <article-title>Clinical practice guidelines: directions for a new program</article-title>
          . National Academies Press (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Grimshaw</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>R.E.</given-names>
          </string-name>
          , MacLennan, G.,
          <string-name>
            <surname>Fraser</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ramsay</surname>
            ,
            <given-names>C.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vale</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whitty</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eccles</surname>
            ,
            <given-names>M.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matowe</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shirran</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wensing</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dijkstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Donaldson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>E ectiveness and e ciency of guideline dissemination and implementation strategies</article-title>
          .
          <source>Health Technol Assess</source>
          ,
          <volume>8</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>72</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Haeske-Seeberg</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zenz-Aulenbacher</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Das Sana-Projekt - Geplante Behandlungsablaufe</article-title>
          . In: Hellmann,
          <string-name>
            <surname>W</surname>
          </string-name>
          . (ed.)
          <article-title>Praxis Klinischer Pfade - Viele Wege fuhren zum Ziel</article-title>
          .
          <source>Ecomed Landsberg</source>
          ,
          <fpage>116</fpage>
          -
          <lpage>179</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>7. Health Level Seven International , http://www.hl7.org/about/index.cfm?ref= nav</mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Jacobs</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stausberg</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oberho</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Ableitung von klinischen Pfaden aus evidenzbasierten Leitlinien am Beispiel der Behandlung des Mammakarzinoms der Frau</article-title>
          . (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Kaiser</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akkaya</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miksch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>How can information extraction ease formalizing treatment processes in clinical practice guidelines? A method and its evaluation</article-title>
          .
          <source>Artif Intell Med</source>
          ,
          <volume>39</volume>
          (
          <issue>2</issue>
          ),
          <fpage>151</fpage>
          -
          <lpage>163</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Lenz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reichert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : IT Support for Healthcare Processes - Premises, Challenges, Perspectives.
          <source>Data Knowl Eng</source>
          ,
          <volume>61</volume>
          (
          <issue>1</issue>
          ).
          <fpage>39</fpage>
          -
          <lpage>58</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Lenz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blaser</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beyer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heger</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Biber</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bumlein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schnabel</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>IT support for clinical pathways { Lessons learned</article-title>
          .
          <source>Int J Med Inform</source>
          ,
          <volume>76</volume>
          (
          <issue>3</issue>
          ).
          <fpage>397</fpage>
          -
          <lpage>402</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Marcos</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roomans</surname>
          </string-name>
          , H., ten
          <string-name>
            <surname>Teije</surname>
          </string-name>
          , A.,
          <string-name>
            <surname>van Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Improving medical protocols through formalisation: a case study</article-title>
          .
          <source>In: Proceedings of the 6th World Conference on Integrated Design and Process</source>
          Technoloy (IDPT-
          <year>2002</year>
          ), California (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Silvia</surname>
          </string-name>
          <article-title>Miksch: Plan Management in the Medical Domain</article-title>
          .
          <source>AI</source>
          Communications
          <volume>12</volume>
          ,
          <fpage>209</fpage>
          -
          <lpage>235</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. Muller, H.,
          <string-name>
            <surname>Schmid</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          : Qualitatsmanagement: Interne Leitlinien und Patientenpfade: Medizinische Klinik,
          <volume>96</volume>
          (
          <issue>11</issue>
          ),
          <fpage>692</fpage>
          -
          <lpage>697</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Oberender</surname>
            ,
            <given-names>P.O.:</given-names>
          </string-name>
          <article-title>Clinical Pathways: Facetten eines neuen Versorgungsmodells. 1</article-title>
          . ed.
          <source>Stuttgart: Kohlhammer</source>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Reuter</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Modellierung und dynamische Adaption klinischer Pfade auf Basis semantischer Prozessfragmente</article-title>
          . Technische Universitat Dortmund.
          <source>phd thesis</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Schlieter</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Esswein</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>From Clinical Practice Guideline to Clinical Pathway - Issues of Reference Model-Based Approach</article-title>
          .
          <source>In: Proceeding of 11th IFIP Working Conference on Virtual Enterprises</source>
          <year>2010</year>
          (
          <article-title>PRO VE 2010), Collaborative Networks for</article-title>
          a Sustainable World,
          <fpage>251</fpage>
          -
          <lpage>259</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Shi</surname>
            <given-names>man</given-names>
          </string-name>
          , R.N.,
          <string-name>
            <surname>Karras</surname>
            ,
            <given-names>B.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agrawal</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marenco</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nath</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>GEM: a proposal for a more comprehensive guideline document model using XML</article-title>
          .
          <source>J Am Med Inform Assoc</source>
          <volume>7</volume>
          (
          <issue>5</issue>
          ),
          <fpage>488</fpage>
          -
          <lpage>498</lpage>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Shi</surname>
            <given-names>man</given-names>
          </string-name>
          , R.N.,
          <string-name>
            <surname>Michel</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Essaihi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Bridging the Guideline Implementation Gap: A Systematic, Document-Centered Approach to Guideline Implementation</article-title>
          .
          <source>J Am Med Inform Assoc</source>
          ,
          <volume>11</volume>
          (
          <issue>5</issue>
          ),
          <fpage>418</fpage>
          -
          <lpage>426</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Sutton</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fox</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <source>The Syntax and Semantics of the PROforma Guideline Modeling Language J Am Med Inform Assoc</source>
          ,
          <volume>10</volume>
          (
          <issue>5</issue>
          ),
          <fpage>433</fpage>
          -
          <lpage>443</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Vanhaecht</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Witte</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Sermeus</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>The impact of clinical pathways on the organisation of care processes</article-title>
          .
          <source>PhD dissertation KULeuven</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>