<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>FAIRness of openEHR Archetypes and Templates</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Medical Informatics, University Medical Center Goettingen</institution>
          ,
          <addr-line>Robert-Koch-Str. 40, 37075 Goettingen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School</institution>
          ,
          <addr-line>Carl-Neuberg-Str.1, 30625 Hannover</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>Background: The FAIR Data Publishing Group designed 15 principles to quantify the FAIRness of scientific data. By using the FAIR Principles it is possible to make scientific data findable, accessible, interoperable and reusable. This paper checks the FAIRness of openEHR archetypes and templates as formalisms to preserve semantic interoperability in electronic health records. Objectives: Within the semantic framework of the HiGHmed project, the aim is to exchange harmonized data between various institutions and make them available for research, by modelling archetypes and templates within openEHR. To ensure interoperability across various locations, archetypes and templates have been examined in this paper with regard to the FAIR principles (Findable, Accessible, Interoperable and Re-Useable). Methods: Analysis of the archetypes developed in HiGHmed and stored in the HiGHmed Clinical Knowledge Manager to determine the degree of fulfillment of FAIRness. Results: All fifteen FAIR Principles are met, respectively partially fulfilled. The openEHR approach and the Clinical Knowledge Manager as a collaborative library are compatible with the FAIR Principles and are well suited for the exchange of research data.</p>
      </abstract>
      <kwd-group>
        <kwd>openEHR</kwd>
        <kwd>FAIR</kwd>
        <kwd>Principles</kwd>
        <kwd>HiGHmed</kwd>
        <kwd>Archetypes</kwd>
        <kwd>Clinical Knowledge Manager</kwd>
        <kwd>Modelling</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        The collection and processing of health data is a prerequisite for medical care and
patient management. Health data is often recorded electronically in a variety of
application systems (e.g. radiological information system or laboratory information system)
in different formats
        <xref ref-type="bibr" rid="ref1 ref7">(Bauer, et al., 2016)</xref>
        . In clinics, heterogeneity is intensified not only
by divergent departmental and personal documentation approaches, but also by the fact
that technical and clinical parameters of similar examination devices are not described
in the same way by different manufacturers
        <xref ref-type="bibr" rid="ref5">(Krefting, et al., 2010)</xref>
        . Often the exchange
and comparison of otherwise equivalent data is hindered by e.g. not using a
standardized format, which leads to redundancies and inconsistencies and thus has a significant
impact on data quality.
      </p>
      <p>*Both authors contributed equally to this manuscript
Copyright © 2019 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</p>
      <p>The HiGHmed project funded by the Federal Ministry of Education and Research
(BMBF) aims to establish a shared information governance framework connecting
local medical data integration centers. The primary goals are the shared use of
heterogeneous data from different clinical departments and the reuse of collected data for
research purposes and clinical care. Exemplary use cases established in the HiGHmed
project are demonstrating the feasibility of the planned governance framework. These
medical driven use cases are located in the areas cardiology, oncology and infection
control and pursuing different objectives. For example, the infection use case is
developing an early detection system trying to encounter outbreaks of multidrug-resistant
germs.</p>
      <p>
        To achieve the different use case objectives, the data has to be introduced and
managed in a semantic framework, which allows to separate “the knowledge and
information levels in information systems.”
        <xref ref-type="bibr" rid="ref2">(Beale, 2002)</xref>
        Information means specific
characteristics of an entity. This includes information that can be assigned to a dedicated
patient (for example John Doe with a blood pressure of 120 to 80). Interpretation of
information (knowledge) denotes statements, which apply to all entities of a class and
are not dependent on a patient. Archetypes, as described in openEHR, form the
distinction of the knowledge: “The term archetype is used to denote knowledge level models
which define valid information structures.”
        <xref ref-type="bibr" rid="ref2">(Beale, 2002)</xref>
        . Templates contain a
contextspecific set of archetypes, where the used archetypes can be further constrained to meet
the specific requirements. Templates are often used to represent medical reports or
findings.
      </p>
      <p>
        HiGHmed follows the openEHR approach to reach semantic interoperability
        <xref ref-type="bibr" rid="ref10 ref4">(Haarbrandt, 2018)</xref>
        . Clinical concepts, terminologies and services are combined and
converted into a machine-readable form that is still easily understandable by humans.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Objectives</title>
      <p>We aim to evaluate the FAIRness of our openEHR approach (archetypes and
templates) to create semantic interoperable data models within HiGHmed. The evaluation
of medical data is not part of this work.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Methods</title>
      <p>
        In the HiGHmed project, archetypes and templates are created to enable sharing of
harmonized data across various institutions for three different use cases (cardiology,
oncology, infection control). As described in Wulff et al.
        <xref ref-type="bibr" rid="ref9">(Wulff, 2019)</xref>
        , 79 archetypes
had been identified in the context of HiGHmed. Most of these archetypes were already
available at the public instance of the Clinical Knowledge Manager (CKM)
(https://www.openehr.org/ckm/) and could be used of-the-shelf with minor changes to
fit the HiGHmed requirements. The CKM in general serves as a collaborative tool to
support the modelling process and acts as a repository of archetypes and templates. The
identified archetypes are constrained and serve as building blocks for templates.
Currently, 12 templates, are part of the HiGHmed modelling process. The of-the-shelf
archetypes were already FAIR compliant and have not been modified within the
HiGHmed Project. Some archetypes such as “ethnic background” could not be adopted
from the international CKM and were created according to the requirements of the
clinicians involved.
      </p>
      <p>All templates were newly created in the course of the project, taking care that the
FAIR principles were taken into account. The role of the HiGHmed project is not only
to re-use archetypes and templates but also to create FAIR compliant archetypes and
templates, specific to the HiGHmed use cases, where needed.</p>
      <p>
        The FAIR Data Publishing Group designed fifteen principles to quantify levels of
FAIRness, such as the principle F2. “data are described with rich metadata”, in 2016.
To check the developed HiGHmed archetypes and templates for their FAIRness, the
FAIR Principles of Wilkinson et al.
        <xref ref-type="bibr" rid="ref1 ref7">(Wilkinson, et al., 2016)</xref>
        are taken into account.
The FAIR Principles define further characteristics for the terms Findable, Accessible,
Interoperable and Re-usable. To make data findable, it must be equipped with a globally
unique, persistent identifier and enriched with extensive metadata. Data has to be
registered or indexed in a searchable resource and the metadata needs to be specified by
the data identifier.
      </p>
      <p>
        In order to be accessible, data sets shall be retrievable by their unique identifier using
a standardized communication protocol that is open, free and universally
implementable. Furthermore, the protocol has to allow an authentication and authorization
procedure, where it is necessary. Metadata should be accessible, even when the data is no
longer available. For data to be interoperable, data should use a formal, accessible,
shared and broadly applicable language for knowledge representation and use FAIR
compliant vocabularies. The reference between data and other (meta)data needs to be
included
        <xref ref-type="bibr" rid="ref1 ref7">(Wilkinson, et al., 2016)</xref>
        .
      </p>
      <p>To be re-usable, data must have a plurality of accurate and relevant attributes and
need to be released with a clear and accessible usage licence. Moreover, data have to
be associated with their provenance and meet the domain-relevant community
standards.</p>
      <p>In scope of this examination, we assessed the archetypes and templates in their
compliance to the fifteen FAIR Principles in the HiGHmed CKM. They have been analysed,
regarding to the generally characteristic of an archetype or template such as header
information, concept name or reference information.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <p>The following sections are divided into the four categories of the FAIR principles
(Findable, Accessible, Interoperable and Re-Useable). In the category “Findable”, four
out of four principles could be met in the HiGHmed CKM. However, in the category
“Accessible” there were only two of the four principles that are fulfilled and two
principles that are partially fulfilled in the HiGHmed project. Furthermore, four out of four</p>
    </sec>
    <sec id="sec-5">
      <title>Findable</title>
      <p>principles could be met in the category “Re-usable” and three out of three principles in
the category “Interoperable”.</p>
      <p>The subsequent paragraphs describe which criteria have contributed to fulfil the
particular FAIR principles.</p>
      <p>The principle F1 is achieved by the Attribution Build Uid and Major Version ID.
The Build Uid is unique to the corresponding instance of the archetype and is initially
set during the creation of the archetype. It changes whenever the archetype is uploaded,
checked out or committed. Based on these two IDs, archetypes and templates can be
kept persistent at any time.</p>
      <p>Principle F2 is closely connected with principle R1. To fulfil the principle F2
archetypes and templates provide multiple mandatory attributes. In addition to the Build Uids
and Major Version ID, attributes contain information on the archetype ID, the assigned
licence, the original author, the current custodian, and other contributors or translators.
All these aspects are also available in the XML representation of the archetype. Within
the HiGHmed project, the tool Archetype Editor from Ocean Informatics was used to
create archetypes. In the process of creating an archetype, a unique ID is assigned to
every archetype created. This ID is checked every time an archetype is uploaded to any
instances of the CKM, so that the ID of an archetype is ensured to be the same across
all CKMs. It is therefore possible to describe which object is referenced by means of
an ID.</p>
      <p>Archetypes and templates include identifier of the data they describe (Archetype ID
and Template ID). Therefore, it is possible for machines to identify an archetype or a
template without appropriate support (principle F3).</p>
      <p>Archetypes and templates are indexed with several keywords to make them
searchable across the HiGHmed CKM (principle F4.) We consider F4 therefore as fulfilled.</p>
    </sec>
    <sec id="sec-6">
      <title>Accessible</title>
      <p>
        The HiGHmed clinical knowledge governance framework, as described in
        <xref ref-type="bibr" rid="ref10 ref6 ref8">(Wulff,
et al., 2018)</xref>
        , defines requirements to make archetypes and templates accessible within
the HiGHmed project. Hence, it is used as starting basis to investigate the accessibility
of archetypes and templates. The archetypes and templates are retrievable via the CKM
REST API, but the information of the server, which has to be requested, is not included
in the XML representation of archetypes nor templates. Principle A1 can therefore be
considered only as partially fulfilled.
      </p>
      <p>The openly documented CKM REST API (https://ckm.openehr.org/ckm/rest-doc/)
defines mechanisms to list selection of archetypes or update an archetype. It is also
possible to get a file set for all archetypes used in a template (principle A1.1).</p>
      <p>In addition, the CKM uses a role and rights management that supports authorization
and authentication (principle A1.2). To create and review archetypes and templates,
researchers and data stewards need appropriate roles so that special user-dependent
rights can be assigned. As part of the role and rights management of the CKM, a
differentiation can be made between system-wide roles, subdomain roles and project roles.
System-wide roles can create, change and delete ontology classes as well as release
sets. In addition, complete classification schemes can be created or deleted. The
translation of classification schemes is also part of the system-wide roles. At subdomain
level, the user can only take over the above rights for one project (e.g.
HiGHmed-specific). On project level (e.g. use case-specific), there are roles such as Editor or
Reviewer. These have their rights only for the corresponding project and cannot create or
change archetypes or templates in any other projects.</p>
      <p>The long-term archiving of data and documents faces several challenges. It must be
ensured that data can be retrieved over a long period of time and that data cannot be
changed unnoticed. When an archetype or template is completely and irrevocably
deleted in the CKM, all dependencies such as review rounds, comments, discussions,
change requests and history are removed. However, the deletion is only anticipated if
the archetype or template is no longer needed. It is preferred to set the status of an
archetype to “rejected” or “deprecated”. The status “deprecated” is used, when an
archetype has already been published in advance, however, the “rejected” status is applied
for archetypes still in development. Both status allow that archetypes to be accessible
under the tab "checked-out resources” within the CKM. It should be noted, that the
metadata is not kept separate from the actual data and thus not kept independent of each
other. Therefore, we consider principle A2 as partially fulfilled.</p>
    </sec>
    <sec id="sec-7">
      <title>Interoperable</title>
      <p>OpenEHR makes use of the Archetype Definition Language (ADL) to represent
knowledge formally, accessible, shared and broadly applicable (principle I1). ADL is
established and documented as an open, domain-relevant standard in the openEHR
environment.1 In addition to the representation in ADL, archetypes and templates can also
be represented in XML format.</p>
      <p>In addition, terminologies such as LOINC can also be integrated for each data item of
an archetype to be able to exchange data more easily and be interoperable according to
the FAIR Principles (principle I2).</p>
      <p>Within archetypes, cluster slots are defined, in which further archetypes can be
referenced to nest other archetypes. Furthermore, templates mainly contain references to
various archetypes. Templates map context-specific documents in which archetypes are
referenced as representations of clinical information. The relationships between
individual archetypes within a template can be queried using the CKM REST API. The
service queries the ID of the template together with the archetypes that are required for
the template (principle I3).</p>
      <p>Complying with all three interoperability principles, openEHR archetypes and
templates provide a FAIR basis for information exchange.</p>
      <sec id="sec-7-1">
        <title>1 https://specifications.openehr.org/releases/AM/latest/ADL2.html</title>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Re-Usable</title>
      <p>Every archetype or template in every CKM instance is licensed under the Creative
Commons Attribution-ShareAlike 3.0 License or higher, so that the (meta)data are
released with a clear and accessible data usage license (R1.1).</p>
      <p>To keep data reusable, a detailed history of editing (creation, modification or
deletion) is of high importance. The time, initiator, content and logged processes are
recorded. This audit trail is stored in the CKM as the history of archetypes and templates
and can be viewed without user authentication. Information such as current status, date
of last changes and modifier can be pictured. The history also includes all previous
versions of archetypes and templates. Additionally, the earlier versions can be
compared to avoid inconsistencies. Data and workflow provenance within openEHR is
stored in elements from the openEHR reference model. The feeder audit class and
feeder audit details class describe the semantic content of an audit trail, for example,
the source system, feeder system, and other audit information transferred. Statements
about when, by who and where which information was provided, can be referenced to
an archetype (principle R1.2).</p>
      <p>Firstly, all developed HiGHmed archetypes and templates are fully compliant to the
openEHR approach. The openEHR approach serves as a relevant standard for the
medical community. The semantic framework defines specifications regarding the
structuring of the data to store them in a standardized way. Specifications and APIs of the
openEHR community can be viewed via the openEHR specifications2 and form the
basis of every development in openEHR. In addition, the HiGHmed project has its own
community guidelines regarding the translation of international archetypes. This
ensures compliance with community standards within the project and within the openEHR
community (principle R1.3).
rbFie2clh.odwma)teataadraetdae(sdcerfiibneeddwbiythR1 ttdTreiihmtbieoupAntloaatrtltesrmisabepnutdrtaoidolviancitdeatenassbsueiocnsf.hfoaarrsmchaaeutittoyhnpoerassb,aocnuodtna-d- Fulfilled</p>
      <sec id="sec-8-1">
        <title>Degree of compliance</title>
      </sec>
      <sec id="sec-8-2">
        <title>Fulfilled</title>
      </sec>
      <sec id="sec-8-3">
        <title>2 https://specifications.openehr.org/</title>
        <p>F3. Metadata clearly and
explicitly include the identifier
of the data
F4. (meta)data are registered
or indexed in a searchable
resource</p>
      </sec>
      <sec id="sec-8-4">
        <title>A1. (meta)data are retrievable by their identifier using a standardized communications protocol</title>
        <p>A1.1. the protocol is open,
free and universally
implementable</p>
      </sec>
      <sec id="sec-8-5">
        <title>The archetype UID and template ID are contained as an attribution in archetypes and templates.</title>
      </sec>
      <sec id="sec-8-6">
        <title>Archetypes and templates are indexed via keywords in the Clinical Knowledge Manager.</title>
      </sec>
      <sec id="sec-8-7">
        <title>The archetypes and templates are retrievable via the CKM REST API, but the information of the server, which has to be requested, is not included.</title>
      </sec>
      <sec id="sec-8-8">
        <title>Archetypes and templates can be derived</title>
        <p>via the openly available CKM REST</p>
        <p>API.</p>
        <p>A1.2. the protocol allows for
an authentication and author- The HiGHmed CKM is access controlled
ization procedure, where through a username and password.
necessary</p>
      </sec>
      <sec id="sec-8-9">
        <title>A2. metadata are accessible, even when the data are no longer available</title>
      </sec>
      <sec id="sec-8-10">
        <title>I1. (meta)data use a formal,</title>
        <p>accessible, shared and
broadly applicable language
for knowledge representation
I2. (meta)data use
vocabularies that follow FAIR
principles
I3. (meta)data include
qualified references to other
(meta)data</p>
      </sec>
      <sec id="sec-8-11">
        <title>R1. meta(data) are richly described with a plurality of accurate and relevant attributes</title>
        <p>R1.1. (meta)data are released
with a clear and accessible
data usage license</p>
      </sec>
      <sec id="sec-8-12">
        <title>By setting the status of an archetype to DEPRECATED or REJECTED metadata Partially is still retrievable, but not if an archetype fulfilled is deleted.</title>
      </sec>
      <sec id="sec-8-13">
        <title>ADL and XML are used as formal syntax languages.</title>
      </sec>
      <sec id="sec-8-14">
        <title>The terminologies that are used include SNOMED-CT and LOINC.</title>
      </sec>
      <sec id="sec-8-15">
        <title>Nesting of archetypes due to Slots and within templates. Reference to FHIR resources and IHE concepts can be set.</title>
      </sec>
      <sec id="sec-8-16">
        <title>All attributes are displayed under the attribution tab of the archetype in the HiGHmed Clinical Knowledge Manager.</title>
      </sec>
      <sec id="sec-8-17">
        <title>The license used is stored under Attribution tab of the Archetype. Fulfilled Fulfilled</title>
      </sec>
      <sec id="sec-8-18">
        <title>R1.2. (meta)data are associated with their provenance</title>
      </sec>
      <sec id="sec-8-19">
        <title>Data Provenance is supported by Audit</title>
        <p>Trailing and Use/Misuse information.
Workflow Provenance is managed via
feeder audit classes, which contain
information about the workflow process.</p>
      </sec>
      <sec id="sec-8-20">
        <title>R1.3. (meta)data meet domain-relevant community standards</title>
      </sec>
      <sec id="sec-8-21">
        <title>Clinical and technical reviewers check whether archetypes and templates comply with the Community Standards.</title>
        <p>5</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>Discussion</title>
      <p>The FAIR Principles are designed to make research data findable, accessible,
interoperable and reusable for the public. As a part of the HiGHmed project, future research
data will be collected and stored by using openEHR archetypes and templates.
Therefore, the CKM is used as a library of clinical knowledge artefacts (archetypes and
templates).</p>
      <p>In the context of this work the archetypes and templates have been explored with regard
to the FAIR Principles. As a result, all 15 principles can be regarded as fulfilled or
partially fulfilled. Archetypes and templates have extraordinary strengths, especially in
the area of findability and interoperability. By using a clear ID management and
meaningful keywords, the required archetypes and templates can easily be found. Data
models are subject to a formal syntax and are enriched with terminologies and metadata to
make them exchangeable across various institutions.</p>
      <p>
        Archetypes are closely linked to their metadata. When an archetype is irrevocably
deleted, the corresponding metadata will also be removed. Therefore, it is necessary to
set archetypes and templates as deprecated or rejected within their lifecycles so that the
metadata is still available. This procedure is part of the community guidelines in
openEHR. However, it would also be possible to set up a Git repository, in which all
archetypes are additionally stored. The HiGHmed CKM would always push the
archetypes into the repository during an update. The use of a Git repository could thus
become part of the Clinical Knowledge Governance Framework
        <xref ref-type="bibr" rid="ref10 ref6 ref8">(Wulff, et al., 2018)</xref>
        .
Furthermore, there are additional approaches to extend the data and workflow
provenance, which can be incorporated into the Clinical Knowledge Governance Framework.
As described in
        <xref ref-type="bibr" rid="ref6 ref8">(Parciak, et al., 2018)</xref>
        , w3c prov can be used, to improve the provenance
process including further information on provenance for every interaction.
      </p>
      <p>
        The FAIR Principles are not specified as a mandatory set of rules, but they can be
used to provide sustainable data management. However due to the high influence of
FAIR Principles in the scientific community, the FAIRmetrics.org working group has
developed a framework to objectively test digital objects for FAIRness. Therefore,
fourteen FAIR Metrics are created, based on the FAIR Principles. The FAIR Metrics
Framework is currently in a test phase and was therefore not part of this paper.
Initiatives such as GO-FAIR3 evaluate and discuss the use of these metrics to test FAIRness
        <xref ref-type="bibr" rid="ref6 ref8">(Wilkinson, et al., 2018)</xref>
        . After the successful test phase of FAIR Metrics, all archetypes
and templates created within the HiGHmed project will be tested using the FAIR
Metrics Framework. It can be assumed that there will be a higher gradation of the degree
of compliance after the FAIR Metrics Framework application.
      </p>
      <p>In conclusion, it can be stated that openEHR supports the FAIRification process, as
described in the GO-Fair Initiative, with medical data. Using the semantic framework,
medical data becomes linkable and semantic-enriched. FAIR archetypes and templates
have an effect on the collected medical data. They offer the possibility to store data in
a structured way and link information on data provenance. This makes medical data
easy to find for future research questions as well as available for subsequent use.</p>
      <p>From the beginning, the data management of the HiGHmed project was aimed to
establish an infrastructure with findable, accessible, interoperable and reusable data in
a distributed environment. The FAIR compliance of the archetypes and templates used,
ensures that all clinical models are correct, understandable, available and complete.
They serve as the target schema for all data integration pipelines and are therefore the
basis for semantic interoperability.</p>
      <p>Based on the results of this work, we will investigate whether it is possible to
perform an automated examination of medical data for FAIRness on the basis of the
featured FAIR archetypes.</p>
    </sec>
    <sec id="sec-10">
      <title>Acknowledgment</title>
      <p>This work was supported by the German Federal Ministry of Education and Research
(BMBF) within the framework of the research and funding concepts of the Medical
Informatics Initiative (01ZZ1802B/HiGHmed).
33 https://www.go-fair.org/</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Bauer</surname>
            ,
            <given-names>C. R.</given-names>
          </string-name>
          et al.,
          <year>2016</year>
          .
          <article-title>Architecture of a Biomedical Informatics Research Data Management Pipeline</article-title>
          . In: Volume
          <volume>228</volume>
          :
          <article-title>Exploring Complexity in Health: An Interdisciplinary Systems Approach</article-title>
          . s.l.:s.n., pp.
          <fpage>262</fpage>
          -
          <lpage>266</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Beale</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <year>2002</year>
          . Archetypes:
          <article-title>Constraint-based Domain Models for Future-proof Informations Systems</article-title>
          . OOPSLA workshop on behavioural semantics, p.
          <fpage>18</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Brien</surname>
            ,
            <given-names>E. O.</given-names>
          </string-name>
          et al.,
          <year>2001</year>
          .
          <article-title>Blood pressure measuring devices: recommendations of the European Society of Hypertension</article-title>
          . BMJ, pp.
          <fpage>531</fpage>
          -
          <lpage>536</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Haarbrandt</surname>
            ,
            <given-names>B. e. a.</given-names>
          </string-name>
          ,
          <year>2018</year>
          .
          <article-title>HiGHmed - An Open Platform Approach to Enhance Care and Research across Institutional Boundaries</article-title>
          .
          <source>Methods of Information in Medicine, July</source>
          , pp.
          <fpage>e66</fpage>
          -
          <lpage>e81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Krefting</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loose</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Penzel</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <year>2010</year>
          .
          <article-title>Employment of a Healthgrid for Evaluation and Development of Polysomnographic Biosignal Processing Methods</article-title>
          .
          <source>Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society</source>
          . Conference.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Parciak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          et al.,
          <year>2018</year>
          .
          <article-title>PROV@TOS. a Java Wrapper To Capture Provenance for Talend Open Studio Jobs</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Wilkinson</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. D.</surname>
          </string-name>
          et al.,
          <year>2016</year>
          .
          <article-title>The FAIR Guiding Principles for scientific data management and stewardship</article-title>
          .
          <source>Scientific Data</source>
          , p.
          <fpage>4</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Wilkinson</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. D.</surname>
          </string-name>
          et al.,
          <year>2018</year>
          .
          <article-title>Evaluating FAIR-Compliance Through an Objective, Automated</article-title>
          , Community-Governed Framework, s.l.: s.n.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Wulff</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <year>2019</year>
          .
          <article-title>A Report on Archetype Modelling in a Nationwide Data Infrastructure Project</article-title>
          . In:
          <article-title>Studies in health technology and informatics (258)</article-title>
          . s.l.:IOS Press, pp.
          <fpage>146</fpage>
          -
          <lpage>150</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Wulff</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haarbrandt</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Marschollek</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <year>2018</year>
          .
          <article-title>Clinical Knowledge Governance Framework for Nationwide Data Infrastructure Projects</article-title>
          . s.l.:s.n.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>