<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Automatically Identifying Drug Conflicts in Clinical Practice Guidelines</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Anto´ nio Silva</string-name>
          <email>asilva@algoritmi.uminho.pt</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tiago Oliveira</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ken Satoh</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paulo Novais</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Algoritmi Centre, University of Minho</institution>
          ,
          <addr-line>Braga</addr-line>
          ,
          <country country="PT">Portugal</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Existing Systems for Identification of Conflicts Between Concurrently Executed CPGs</institution>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>National Institute of Informatics</institution>
          ,
          <addr-line>Tokyo</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Clinical Practice Guidelines (CPGs) are documents developed in a systematic way that aim to improve the quality of health care, reduce variations in medical practice, and reduce health care costs. However, when concurrently apply them, this can lead to adverse drug-drug interactions that can impair the patient's condition. Several efforts have been made in order to provide systems capable of identifying these conflicts. However, the current approaches for this purpose have some limitations. This paper presents a solution that represents CPGs as Computer-Interpretable Guidelines (CIGs) and allows for the automatic drug conflict identification and resolution. Also, we provide the identification of improvements to include in a future model. Moreover, this system provides clinical recommendations in an agenda, being capable of identifying drug interactions when drugs are prescribed simultaneously and provide conflict-free alternatives.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        To improve the utilisation of clinical practice guidelines
(CPGs) at the point of care, there have been numerous efforts
to computerise CPGs in ontologies and incorporate them
within Clinical Decision Support Systems (CDSSs). There
are several guideline description languages such as Arden
Syntax (Samwald et al. 2012), Guideline Interchange
Format (GLIF)
        <xref ref-type="bibr" rid="ref19">(Peleg et al. 2000)</xref>
        , Asbru
        <xref ref-type="bibr" rid="ref2">(Balser, Duelli, and
Reif 2002)</xref>
        , EON
        <xref ref-type="bibr" rid="ref14">(Musen et al. 1996)</xref>
        , PROforma
        <xref ref-type="bibr" rid="ref27">(Vier et al.
1997)</xref>
        and Guideline Acquisition, Representation and
Execution (GLARE)
        <xref ref-type="bibr" rid="ref3">(Bottrighi et al. 2006)</xref>
        that are aimed at
the representation of CPGs as computer-interpretable
guidelines (CIGs) in order to provide computer-assisted tools that
help health care professionals make decisions. Through the
formalisation of CIGs in CDSSs, a new range of operations
can be performed with the knowledge they enclose. Such
includes automated reasoning for the generation of
recommendations, automatic identification of conflicts between
different CIGs, consistency checking within the same CIG and
across different CIGs, and merging CIG knowledge with
contextual information such as patient and physician
preferences or available health care resources. So, the objective
of these approaches is to provide support to the processes of
diagnosis and planning of the clinical treatments, as well as
to promote the use of the best clinical practices.
      </p>
      <p>
        However, these systems lack the flexibility to support
cases where multiple protocols need to be combined; this
is especially problematic for patients with multimorbidity.
Multimorbid patients have complex treatment plans and face
a high burden of the disease since they suffer from
multiple diseases at the same time. There are also several
problems regarding the application of treatment plans of
multiple disease-specific CPGs to multimorbid patients. Such
includes adverse drug events, increased treatment
complexity, and cost of treatment
        <xref ref-type="bibr" rid="ref25">(Tinetti, Bogardus Jr, and Agostini
2004)</xref>
        <xref ref-type="bibr" rid="ref4">(Boyd et al. 2005)</xref>
        . Thus, the application of multiple
CPGs individually can result in complex multiple drug
regimens (polypharmacy) with the potential for harmful
combinations of drugs
        <xref ref-type="bibr" rid="ref6">(Dumbreck et al. 2015)</xref>
        .
      </p>
      <p>Therefore, new needs arise in order to provide
computerassisted tools that automatically identify the common
potential conflicts or interactions that can happen when merging
CIGs, namely, those that happen when there are drug-drug
interactions.</p>
      <p>The work described herein presents a system that
automatically identifies recommendation interactions, conflicts,
and alternatives using existing terminology services such as
the RxNorm API. Thus, the contributions featured in this
work are: characterisation of main approaches to handle the
combination of CIGs, especially for multimorbid patients
and a solution to address this problem.</p>
      <p>The paper is organised as follows. Section 2 describes
related work regarding systems for combining CPGs. Section
3 presents an architecture for combining CIGs as well as
the contributions for the deployment of CPGs in CDSSs.
Finally, Section 5 presents the conclusions drawn so far with
the development of the system and future directions for the
work.</p>
      <p>
        2
When treating multimorbid patients, health care
professionals need to retrieve clinical recommendations from multiple
chronic disease CPGs. From the combination of these
recommendations, several problems can happen, for instance
when a drug, prescribed for one condition, has an adverse
effect on another condition
        <xref ref-type="bibr" rid="ref4">(Boyd et al. 2005)</xref>
        . With the
growing number of multimorbid patients, identification of these
inconsistencies becomes increasingly essential
        <xref ref-type="bibr" rid="ref28">(Wilk et al.
2011)</xref>
        . Computerised CDSSs have been used to alert health
care professionals to adverse drug events at the point of
care
        <xref ref-type="bibr" rid="ref5">(De Clercq, Kaiser, and Hasman 2008)</xref>
        . In this section,
we will provide a literature review of the existing CDSSs
for identification of conflicts between concurrently executed
CIGs.
2.1
      </p>
      <sec id="sec-1-1">
        <title>Constraint Logic Programming</title>
        <p>
          Wilk et al. propose an approach that combines logic
programming with constraint satisfaction problems
          <xref ref-type="bibr" rid="ref28">(Wilk et al.
2011)</xref>
          . They use CIGs as an activity graph and use constraint
logic programming to identify and mitigate possible adverse
interactions between CIGs, it means, to identify conflicts
associated with potentially contradictory and adverse
activities resulting from applying two CPGs to the same
patient. Although this approach provides automatic
identification of conflicts and solutions, it depends on the availability
of knowledge bases containing information about both
diseases and the whole work of combining CIGs remains
manual. So, in order to provide automatic identification conflicts
and solutions need to be defined in a medical background
knowledge as protocol-dependent rules/constraints.
2.2
        </p>
      </sec>
      <sec id="sec-1-2">
        <title>Rule-based Combinations</title>
        <p>
          The RBC approach provides identification and
reconciliation of drug conflicts between recommendations of two
concurrently executed CPGs
          <xref ref-type="bibr" rid="ref11 ref8">(Lo´pez-Vallverdu´, Rian˜o, and
Collado 2013)</xref>
          . They use a standard terminology called ATC
(Anatomical Therapeutic Chemical Classification System
for drugs) in order to provide as output, a final treatment plan
without interaction, i.e., a set of ATC-codes of medicines
that should be prescribed.
        </p>
        <p>For the identification of all possible drug conflicts that
can occur when combining two specific CPGs, they use the
knowledge from health care professionals and knowledge
engineers in order to manually build knowledge units for the
pairwise combination of three diseases: hypertension,
diabetes mellitus and heart failure. These knowledge units rely
on the existence of drug-drug interactions, the presence of
a drug which is adverse to a specific disease (drug-disease
interaction) and the absence of a necessary drug for a
combination of diseases.</p>
        <p>Although this approach can only combine pairs of CPGs,
a final treatment plan based on two CPGs could again be
combined in a pairwise manner with a new CPG.
2.3</p>
      </sec>
      <sec id="sec-1-3">
        <title>OntoMorph</title>
        <p>
          The objective of the OntoMorph
          <xref ref-type="bibr" rid="ref8 ref9">(Jafarpour 2013)</xref>
          approach
is to propose a treatment plan, consisting of several tasks,
that do not conflict and that are time and resource
efficient. Jafarpour et al.
          <xref ref-type="bibr" rid="ref8 ref9">(Jafarpour and Abidi 2013)</xref>
          used
ontologies to develop systems to merge two concurrent CPGs
into a comorbid personalised guideline. They extracted
clinical tasks from the CPGs and converted them to CIGs with
an OWL-based CPG ontology. An ontology is a
methodology for CPG representation. It consists of rules to
represent declarative knowledge (medical statements and
propositions) and procedural knowledge (workflow structures and
actions). OWL is a W3C standard for web ontologies, for
which CPG concepts are converted to RDF triplets and XML
file
          <xref ref-type="bibr" rid="ref8 ref9">(Jafarpour and Abidi 2013)</xref>
          . This model defines four
types of constraints for concurrent execution of tasks from
multiple guidelines: workflow constraints, operational
constraints, temporal constraints and medical constraints.
        </p>
        <p>Workflow constraints are rules that specify whether tasks
should be combined with, substituted by, executed
simultaneously with or executed before or after a task from
another guideline. Operational constraints refer to limitations
for combining tasks at a specific medical Institute; temporal
constraints specify the time required between the first and
second task of two guidelines. Medical constraints are
divided in Task Substitutes (a substitute for a task of protocol
A that does not conflict with a task of protocol B) and use
results constraints ( a rule that specifies expiry date of task
results).</p>
        <p>They also built a merging representation ontology to
capture merging criteria in order to achieve the combination of
CIGs. Semantic Web Rule Language (SWRL) rules were
used to identify potential conflicts during the merging
process. All conditions related to the merging process need to be
described by the rules, increasing the effort to maintain the
system up-to-date, and reducing the possibility of sharing
knowledge. However, some related problems were not yet
(completely) addressed in their work, for instance, potential
contradictions between rules, the scalability of the merging
model to combine several CIGs, and how the ontology/rules
are maintained up-to-date.
2.4</p>
      </sec>
      <sec id="sec-1-4">
        <title>Transition-based Medical Recommendations</title>
      </sec>
      <sec id="sec-1-5">
        <title>Model</title>
        <p>
          The TMR4I model has been developed for the automatic
inference of interactions between recommendations
          <xref ref-type="bibr" rid="ref29">(Zamborlini et al. 2016)</xref>
          . Its scope is currently limited to conflicts
between CPG statements on drug prescription, but it could be
used for non-pharmacological treatment recommendations
as well.
        </p>
        <p>This model defines meta-rules for identification and
reconciliation of three categories of drug conflicts using
SPARQL queries (SPARQL is a W3C-standard for semantic
queries). The meta-rules define how a conflict is identified,
and how drugs with similar effects but without conflicts can
be selected from CPG-knowledge. The categories of
conflicts within CPGs are repetition interactions, contradiction
interactions and alternative interactions.</p>
        <p>A web-tool for execution of guidelines was developed. In
this tool, clinicians firstly enter all guideline
recommendations applicable to a patient. The execution engine creates a
new, merged guideline with all recommendations. With the
SPARQL meta-rules, interactions are identified and
classified. Then, the engine consults the alternative
recommendations, in order to choose solutions for the conflicts. Finally,
a list of conflicts and recommended solutions is presented to
the clinician.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Architecture to Automatically Identify</title>
    </sec>
    <sec id="sec-3">
      <title>Drug Interactions and Conflicts</title>
      <p>There are some limitations regarding the systems
aforementioned which should be taken into account. These limitations
regard with the necessity of manually defining all
guidelinedependent rules, limitations in the number of CIGs that can
be combined and necessity of all conflicts and solutions to
be available in a knowledge base.</p>
      <p>
        Thus, the present work not only aims to provide
recommendations to support medical decision-making but also to
represent automatically the conflicts and interactions that
can happen when merging CPGs. To accomplish the goal
mentioned above, as shown in Figure 1, we provide a
solution in three levels: representation of CPGs in CIGs,
identification of recommendation interactions and provision of
recommendation alternatives in case that some
recommendations, when applied together, are adverse. The following
sections provide an explanation of the architecture in the
different stages regarding the different level mentioned before.
The work described herein uses the CompGuide ontology
to represent CPGs in the form of a task network. The
CompGuide ontology
        <xref ref-type="bibr" rid="ref17 ref8">(Oliveira, Novais, and Neves 2013)</xref>
        contains different types of clinical tasks such as Question,
Action, Decision, End, Plan and Condition and constraints
expressed in the form of conditions on the patients state,
such as TriggerConditions, PreConditions and Outcomes.
Moreover, it provides a model of temporal representation
        <xref ref-type="bibr" rid="ref16 ref23">(Oliveira et al. 2017)</xref>
        that aims to represent the temporal
constraints placed on clinical tasks. This model represents
temporal constructors on the execution of tasks such as
Durations, Repetitions, Periodicities, Waiting Times and
Repetition Conditions and temporal constraints about the state
of a patient. To acquire and represent CPGs we use the
CompGuide plugin which provides information step-by-step
on how to fill the data for the guideline entries (Gonc¸alves
et al. 2017). This plugin performs the role of managing the
creation and editing of CIGs.
      </p>
      <p>The final output will be a CIG that will be saved in
the Guideline Repository. This component is responsible
for keeping different CIGs represented according to the
CompGuide ontology. The Guideline Handler is
responsible for managing the access to recommendations of CIGs
in the Guideline Repository, providing the clinical tasks and
constraints placed on the tasks to the Guideline Execution
Engine.
3.2</p>
      <sec id="sec-3-1">
        <title>Identification of Recommendation</title>
      </sec>
      <sec id="sec-3-2">
        <title>Interactions</title>
        <p>The Guideline Execution Engine with the information of
the clinical tasks provided by the Guideline Handler
interprets all the scheduling constraints on the tasks and produces
enactment times. The applications implemented to interact
with the health care professionals are then responsible for
verifying starting and ending times of the tasks.</p>
        <p>This component is also responsible for calling the
RxNorm service in order to identify the interactions and
recommendation conflicts. RxNorm (Liu et al. 2005)
integrates the Unified Medical Language System and offers
normalised names for clinical drugs and links its names to
many of the drug vocabularies commonly used in pharmacy
management and drug interaction software, including those
of First Databank, Micromedex, MediSpan, Gold Standard
Drug Database, and Multum. The RxNorm interaction API
uses two sources for its interaction information - ONCHigh
and DrugBank. The RxNorm interaction API provides
information such as source name, severity and description of
the interaction. Thus, the Guideline Execution Engine
processes all the clinical tasks that are being executed, retrieves
all drugs and for each pair of drugs calls the RxNorm
Interaction API to obtain the severity and description of the
interaction.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Determine Alternative Recommendations</title>
        <p>With the severity of recommendation interactions, it is
possible to determine the necessity of providing alternative
recommendations. The severity can assume values such as high
if there is an adverse drug event resulting from the
interaction, and N/A, if there is no adverse effect. In case the
interaction between drugs assumes as value high we call
RxNorm RxClass API. This service provides alternative
recommendations by offering ways to get similar classes of
drug members. This service provides information such as
similarity scoring (a score that determines the similarity
between drugs), the drug name, the source of the drug relations
and the relationship of the drug class to its members.</p>
        <p>After processing the constraints of clinical tasks,
determining the interactions between drugs and their alternatives,
the clinical recommendations are made available through the
Personal Assistant Web App and the health care assistant
Mobile App.</p>
        <p>
          The Personal Assistant Web Application access the data
through the web services available in the CompGuide
system
          <xref ref-type="bibr" rid="ref16 ref23">(Silva et al. 2017)</xref>
          . This component was developed as a
web application following the Model-View-Control (MVC)
paradigm using Java Server Faces (JSF). The Health care
assistant Mobile Application is an android application
developed in Java, which also uses the same web services.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Execution Example</title>
      <p>
        This section describes how CompGuide processes the
interactions between drugs given a case test example. For this
purpose, we used two CIGs based on the NCCN Clinical
Practice Guideline for Prostate Cancer
        <xref ref-type="bibr" rid="ref13">(Mohler et al. 2018)</xref>
        and the IDF Clinical Practice Recommendations for
managing Type 2 Diabetes
        <xref ref-type="bibr" rid="ref1">(Aschner 2017)</xref>
        . These guidelines were
a comprehensive case study since it was possible to test
several aspects of the deployment of CIGs, namely those that
concern with CIG representation, acquisition and execution
in the CompGuide system. So, it is possible to examine all
the stages of the deployment of CIGs, representing several
types of tasks, various temporal constraints and several
conflicts among the guidelines. However, in this section, we
only address the conflicts between recommendations from
many guidelines.
      </p>
      <p>For demonstrations purposes, we will consider two
recommendations from the mentioned guidelines. The first one,
named recommendation A belongs to the guideline for
managing Type 2 Diabetes: ”Apply insulin 0.2 units/kg and
titrate once weekly at one unit each time during six months
to achieve a target fasting blood glucose between 3.9 and
7.2 mmol/L (70 and 130 mg/dL)”. The second
recommendation, named recommendation B belongs to the guideline
for prostate cancer: ”Apply goserelin, leuprolide, histrelin
180 mg/m2 or Triptorelin 100mg/m2 as part of Androgen
Deprivation Therapy”.</p>
      <p>The recommendation A has the action apply insulin, a
periodicity value of 1 with a temporal unit of week, a duration
value of six, and the respective temporal unit of month. In
this case, starting on the 18th of July of 2018 the system will
create one event for each week with a duration of one day,
during 6 months. The expected conclusion of this task will
be on the 18th of January of 2019. As for recommendation B,
the action to apply goserelin, leuprolide, histrelin or
triptorelin can be identified, with a duration value of 1 and temporal
unit of day, starting and finishing on the 18th of July of 2018.</p>
      <p>In this case, the two recommendations are concurrently
being applied in 18th of July of 2018 and have drug
conflicts, namely the drugs goserelin, leuprolide, histrelin and
triptorelin have adverse effects on the therapeutic efficacy of
insulin. The Figure 2 shows the output regarding these
conflicts.</p>
      <p>
        Later, the application tries to provide alternative drugs to
address the identified conflicts, by calling RxNorm API as
described in section 3.3. Through a mitigation function, the
system calculates which one will be applied. This function
has different mitigation principles, such as the similarity
between drugs or user preferences. The objective is to
determine which alternatives best fit the needs of users. One
possible principle, which possibly will increase the
effectiveness of this function, is a multiple criteria mechanism for
supporting decision-making such as Multiple-criteria
Decision Analysis (MCDA)
        <xref ref-type="bibr" rid="ref24">(Thokala et al. 2016)</xref>
        . This method
allow to evaluate possible solutions based on conflicting
criteria in decision problems. There are complex drug
interactions that can impair the patient’s condition as well as several
solutions with conflicting objectives. Thus, it is essential to
evaluate the possible solutions according to criteria such as
user preferences in the best treatment alternative, benefit/risk
assessment of different decision alternatives, the similarity
between different drugs, the severity of disease for which
recommendations are advised, among others. However, in
this case study we only use the similarity between drugs
as the mitigation principle. This function is responsible for
finding the conflicts between drugs. For each conflict this
function finds alternative drugs by calling the RxNorm API,
according to section 3.3. Later, it calculates the high
similarity score provided by RxNorm API for the set of alternatives
drugs. For each alternative with the higher score, it tries to
find if a drug conflict exists. If there is a conflict, the
algorithm finds the next alternative with the higher score, if there
is no conflict, it stores the alternative in the database and
displays the alternative drug. Based on the given case example,
the reproduced recommendation alternatives are shown in
Figure 3.
      </p>
      <p>In the work described herein, we provide a system that
automatically identifies conflicts and interactions between
drugs for many guidelines. Comparing with OntoMorph,</p>
      <p>
        CLP and RBC, where conflicts are defined as constraints
in the knowledge base having to be manually specified,
CompGuide uses existing terminology services that
aggregate different drug sources such as ONCHigh and
DrugBank. Thus, through the reuse and integration of existing
terminology services such as RxNorm, it is possible to identify
conflicts and interactions automatically, without the need
to manually define them in the knowledge base. So, using
existing terminology services is one of the possible
solutions for the limitation mentioned above. Other solution in
regard to the usage of meta-rules, such used by the TM4I
model. Meta-rules can be reused since they can be applied
to many CIGs, and conflicts do not need to be manually
identified for each guideline, because they can be
automatically derived from the guideline representation. However,
the bottleneck will be in converting guidelines to
computerinterpretable rules. Besides, these systems do not consider
aspects such as decision-making. In most cases, there are
several alternatives that can lead to conflicting objectives by
the decision makers. In other cases, it is necessary to
decide which recommendation we want to choose, or which
recommendation, in the case at hand, is less adverse. For
this specific case, an MCDA approach can be a possible
solution, since it allows the evaluation of possible solutions
based on conflicting criteria. In the given example we use a
mitigation function to determine which alternatives best fit
the needs of users, by using as a mitigation principle, the
similarity between drugs. One possible principle is a
multiple criteria mechanism for supporting decision making such
as Multiple-criteria Decision Analysis (MCDA)
        <xref ref-type="bibr" rid="ref24">(Thokala et
al. 2016)</xref>
        . Since there may be complex interactions
yielding multiple solutions with conflicting objectives, it is
useful to score these solutions according to criteria spawning
from sources as diverse as patient preferences, the severity
of disease for which recommendations are advised,
benefit/risk analysis, and so forth.
      </p>
    </sec>
    <sec id="sec-5">
      <title>Conclusions and Future Work</title>
      <p>There are several efforts in order to provide systems capable
of determining drug-drug interactions and conflicts among
guidelines. However, some of the studied systems are
unable to detect the conflicts for combinations of protocols
automatically. Other approaches cannot propose alternative
measures that would resolve the conflicts. Other CIG
models require all the possible conflicts and their solutions to be
available in a knowledge base. Moreover, they cannot lead
with cases where decision makers have conflicting solutions
or cannot decide on the best treatment alternatives.</p>
      <p>Although we currently do not provide an MCDA
approach, it is our intention to implement a multiple criteria
decision-making approach for not only assessing the
benefitrisk of applying the recommendations but also getting
patient preferences on best treatment alternatives since some
treatment plans can have harmful effects on the patients
health . This allows to evaluate all possible solutions and to
specify different criteria to solve conflicts with medical
recommendations, beyond the simple comparison of drug
interactions. Also, we intend to make a proper assessment of the
fitness of the system for CIG deployment, by performing a
study involving physicians interacting with the system.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work has been supported by COMPETE: POCI-01-0145-FEDER-0070 43 and
FCT Fundac¸a˜o para a Cieˆncia e Tecnologia within the Project Scope UID/CEC/
00319/2013. The work of Tiago Oliveira was supported by JSPS KAKENHI Grant
Number JP18K18115.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Aschner</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>New idf clinical practice recommendations for managing type 2 diabetes in primary care</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Balser</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Duelli</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Reif</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <year>2002</year>
          .
          <article-title>Formal semantics of Asbru-an overview</article-title>
          .
          <source>In Proceedings of the International Conference on Integrated Design and Process</source>
          Technology.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bottrighi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Terenziani</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Montani</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; Torchio,
          <string-name>
            <surname>M.</surname>
          </string-name>
          ; and Molino,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <year>2006</year>
          .
          <article-title>Clinical guidelines contextualization in GLARE</article-title>
          .
          <source>In AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium</source>
          , volume
          <year>2006</year>
          ,
          <volume>860</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Boyd</surname>
            ,
            <given-names>C. M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Darer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Boult,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Fried</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. P.</given-names>
            ;
            <surname>Boult</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ; and
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. W.</surname>
          </string-name>
          <year>2005</year>
          .
          <article-title>Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance</article-title>
          .
          <source>Jama</source>
          <volume>294</volume>
          (
          <issue>6</issue>
          ):
          <fpage>716</fpage>
          -
          <lpage>724</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>De Clercq</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Kaiser</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Hasman</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2008</year>
          .
          <article-title>Computerinterpretable guideline formalisms</article-title>
          .
          <source>Studies in health technology and informatics</source>
          <volume>139</volume>
          :
          <fpage>22</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Dumbreck</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Flynn</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Nairn</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; Wilson,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Treweek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Mercer</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. W.</surname>
          </string-name>
          ; Alderson,
          <string-name>
            <given-names>P.</given-names>
            ;
            <surname>Thompson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Payne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ; and
            <surname>Guthrie</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.</surname>
          </string-name>
          <year>2015</year>
          .
          <article-title>Drug-disease and drug-drug interactions: systematic examination of recommendations in 12 UK national clinical guidelines</article-title>
          .
          <source>Bmj</source>
          <volume>350</volume>
          (
          <year>mar11</year>
          2):
          <fpage>h949</fpage>
          -
          <lpage>h949</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          2017.
          <article-title>Compguide: Acquisition and editing of computerinterpretable guidelines</article-title>
          .
          <source>In World Conference on Information Systems and Technologies</source>
          ,
          <volume>257</volume>
          -
          <fpage>266</fpage>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Jafarpour</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Abidi</surname>
            ,
            <given-names>S. S. R.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Merging diseasespecific clinical guidelines to handle comorbidities in a clinical decision support setting</article-title>
          .
          <source>In Conference on Artificial Intelligence in Medicine in Europe</source>
          ,
          <volume>28</volume>
          -
          <fpage>32</fpage>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Jafarpour</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Ontology merging using semanticallydefined merge criteria and owl reasoning services: towards execution-time merging of multiple clinical workflows to handle comorbidity</article-title>
          . Dalhousie University.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          2005.
          <article-title>Rxnorm: prescription for electronic drug information exchange</article-title>
          .
          <source>IT professional 7</source>
          (
          <issue>5</issue>
          ):
          <fpage>17</fpage>
          -
          <lpage>23</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <article-title>Lo´pez-Vallverdu´</article-title>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            ; Rian˜o, D.; and
            <surname>Collado</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <article-title>Rule-based combination of comorbid treatments for chronic diseases applied to hypertension, diabetes mellitus and heart failure</article-title>
          .
          <source>In Process Support and Knowledge Representation in Health Care</source>
          . Springer.
          <fpage>30</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Mohler</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>R. T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Antonarakis</surname>
            ,
            <given-names>E. S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Armstrong</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. J.; D'Amico</surname>
            ,
            <given-names>A. V.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>B. J.</given-names>
          </string-name>
          ; Dorf,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Eastham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            ;
            <surname>Ellis</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          ; Enke,
          <string-name>
            <surname>C. A.</surname>
          </string-name>
          ; and Farrington,
          <string-name>
            <surname>T. A.</surname>
          </string-name>
          <year>2018</year>
          .
          <string-name>
            <given-names>National</given-names>
            <surname>Comprehensive Cancer Network - Prostate Cancer</surname>
          </string-name>
          .
          <source>Technical report, National Comprehensive Cancer Network.</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Tu</surname>
            ,
            <given-names>S. W.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Das</surname>
            ,
            <given-names>A. K.</given-names>
          </string-name>
          ; and Shahar,
          <string-name>
            <surname>Y.</surname>
          </string-name>
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <article-title>EON: A Component-Based Approach to Automation of Protocol-Directed Therapy</article-title>
          .
          <source>Emerging Infectious Diseases</source>
          <volume>3</volume>
          (
          <issue>6</issue>
          ):
          <fpage>367</fpage>
          -
          <lpage>388</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Oliveira</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Neves</surname>
            , J.; and Novais,
            <given-names>P.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>Decision support provided by a temporally oriented health care assistant</article-title>
          .
          <source>Journal of medical systems 41</source>
          <volume>(1)</volume>
          :
          <fpage>13</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Oliveira</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Novais</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Neves</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Representation of clinical practice guideline components in owl</article-title>
          .
          <source>In Trends in Practical Applications of Agents and Multiagent Systems.</source>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          Springer.
          <fpage>77</fpage>
          -
          <lpage>85</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Peleg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; Boxwala, a. a.;
          <string-name>
            <surname>Ogunyemi</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Zeng</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Tu</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; Lacson,
          <string-name>
            <given-names>R.</given-names>
            ;
            <surname>Bernstam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ;
            <surname>Ash</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ;
            <surname>Mork</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ; OhnoMachado, L.;
            <surname>Shortliffe</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. H.</surname>
          </string-name>
          ; and Greenes,
          <string-name>
            <surname>R.</surname>
          </string-name>
          <year>a</year>
          .
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <article-title>GLIF3: the evolution of a guideline representation format</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <source>In Proceedings / AMIA ... Annual Symposium. AMIA Symposium</source>
          ,
          <volume>645</volume>
          -
          <fpage>649</fpage>
          . American Medical Informatics Association.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <year>2012</year>
          .
          <article-title>The Arden Syntax standard for clinical decision support: Experiences and directions</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          <volume>45</volume>
          (
          <issue>4</issue>
          ):
          <fpage>711</fpage>
          -
          <lpage>718</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Oliveira</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Neves</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Satoh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ; and Novais,
          <string-name>
            <surname>P.</surname>
          </string-name>
          <year>2017</year>
          .
          <article-title>A system for the management of clinical tasks throughout the clinical process with notification features</article-title>
          .
          <source>In Agents and Multi-Agent Systems for Health Care</source>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Thokala</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Devlin</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Marsh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Baltussen</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ; Boysen,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Kalo</surname>
          </string-name>
          ,
          <string-name>
            <surname>Z.</surname>
          </string-name>
          ; Longrenn,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Mussen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ;
            <surname>Peacock</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Watkins</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ; et al.
          <year>2016</year>
          .
          <article-title>Multiple criteria decision analysis for health care decision makingan introduction: report 1 of the ispor mcda emerging good practices task force</article-title>
          .
          <source>Value in health 19(1)</source>
          :
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Tinetti</surname>
            ,
            <given-names>M. E.; Bogardus</given-names>
          </string-name>
          <string-name>
            <surname>Jr</surname>
          </string-name>
          , S. T.; and
          <string-name>
            <surname>Agostini</surname>
            ,
            <given-names>J. V.</given-names>
          </string-name>
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <article-title>Potential pitfalls of disease-specific guidelines for patients with multiple conditions</article-title>
          .
          <source>The New England journal of medicine</source>
          <volume>351</volume>
          (
          <issue>27</issue>
          ):
          <fpage>2870</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Vier</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Fox</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Johns,
          <string-name>
            <given-names>N.</given-names>
            ;
            <surname>Lyons</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Rahmanzadeh</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ; and Wilson, P.
          <year>1997</year>
          .
          <article-title>PROforma: systems</article-title>
          .
          <source>Computer Methods and Programs in Biomedicine</source>
          <volume>2607</volume>
          (
          <issue>97</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Wilk</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; Michalowski,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Michalowski</surname>
          </string-name>
          ,
          <string-name>
            <surname>W.</surname>
          </string-name>
          ; Hing,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>M.;</article-title>
          and
          <string-name>
            <surname>Farion</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <year>2011</year>
          .
          <article-title>Reconciling pairs of concurrently used clinical practice guidelines using constraint logic programming</article-title>
          .
          <source>In AMIA Annual Symposium Proceedings</source>
          , volume
          <year>2011</year>
          ,
          <volume>944</volume>
          . American Medical Informatics Association.
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Zamborlini</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Hoekstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ; Da Silveira,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Pruski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Ten Teije</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ; and
            <surname>Van Harmelen</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          <year>2016</year>
          .
          <article-title>Inferring recommendation interactions in clinical guidelines</article-title>
          .
          <source>Semantic Web</source>
          <volume>7</volume>
          (
          <issue>4</issue>
          ):
          <fpage>421</fpage>
          -
          <lpage>446</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>