<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Helping Nurses to Improve Their Work Organisation Using Process Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>An Vanthienen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>UHasselt, Digital Future Lab, Agoralaan</institution>
          ,
          <addr-line>3590 Diepenbeek</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Today, hospitals face increasing care demands and budgetary constraints, which challenge the delivery of highquality care. In addition, most organisations sufer from a chronic nurse understafing. To address these challenges, hospitals are looking into ways to improve the work organisation of nurses. However, current research on nursing work organisation predominantly relies on self-reported data and observational studies, both of which present significant limitations, such as data quality concerns (e.g., the Hawthorne efect in observational settings) and the added burden on participating nurses. This research aims to provide hospitals and nursing staf with data-driven insights into current work organisation practices, enabling more informed decision making. To this end, task execution data will be automatically collected through a combination of hospital information system (HIS) data and real-time location system (RTLS) data, gathered from both nurses and mobile equipment in hospital wards. This research focuses on two primary challenges: (i) the integration of HIS- and RTLS-data and (ii) the identification and visualisation of work organisation patterns. Through addressing these challenges, this research will ofer hospitals deep insights into nursing work organization without imposing additional burdens on healthcare staf, facilitating evidence-based decision making about how to best organise nursing work.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Process Mining</kwd>
        <kwd>Healthcare</kwd>
        <kwd>HIS-data</kwd>
        <kwd>RTLS-data</kwd>
        <kwd>Nurses</kwd>
        <kwd>Work organisation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Currently, hospitals are challenged with providing high-quality care while facing limited resources
and increased care needs (e.g. due to the ageing population) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In addition, a key struggle in many
countries is chronic nurse understafing [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Given the context of these tight budgets and the significant
shortages in nursing staf, hospitals are looking into ways to improve the work organisation of nurses
(i.e. the way tasks are organized and coordinated [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]).
      </p>
      <p>
        Work organisation improvement ideas can be generated through organising workshops with nurses
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However, caregivers experience dificulties in objectively expressing how their work is organised
and in stating how much time they spend on tasks [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In order to improve ideas generated in these
workshops, the discussion among nurses can be enriched with data-driven insights into the current
work organisation.
      </p>
      <p>
        To provide these insights, data on how nurses perform tasks and how they organise these tasks is
needed. In nursing literature, this data is often collected through self-reporting tools and observations
[
        <xref ref-type="bibr" rid="ref6 ref7 ref8">6, 7, 8</xref>
        ]. These methods are time-consuming, potentially add an extra burden on participating nurses
and come with their own specific limitations (e.g. the Hawthorne efect that may occur in observational
studies [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]).
      </p>
      <p>
        Because of the limitations of currently used methods, this research project aims to provide data-driven
support to nurses as they generate work organisation improvement ideas using automatically recorded
task execution data. This data will be collected from hospital information systems (HIS) and real-time
location system (RTLS) data, which is sensor data recording the location of nurses or mobile assets at
particular points in time [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Data-driven insights will be generated by integrating both data sources
and analysing it using process mining.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Related work</title>
      <p>
        Research eforts on process mining in healthcare soared over the past decade [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The discovery of
patients’ care pathways, indicating the order in which care interventions are delivered to a patient,
remains the most dominant use case. Process mining in healthcare has also been used to predict the
occurrence of events. A third application of process mining in healthcare aims at providing answers to
time-related questions [11].
      </p>
      <p>
        While HIS systems are a common data source for process mining in healthcare [12, 13], multiple data
quality issues have been reported [
        <xref ref-type="bibr" rid="ref1">14, 1, 15</xref>
        ]. In general, common data quality problems encountered
when using HIS-data for nonclinical purposes are accuracy, completeness, consistency, credibility,
uniqueness, correctness, concordance and timeliness [16, 17]. These inaccuracies in collected data result
in a fragmented and incomplete view of how nurses actually work.
      </p>
      <p>To overcome the limitations in using HIS-data, this research will consider RTLS-data as an additional
data source of automatically recorded information about task executions. The collected timestamps
from RTLS-data are linked to locations rather than tasks. As a result, the necessary context of the
specific executed task is missing which is a key limitation when relying solely on this data [18].</p>
      <p>From the previous, it follows that both HIS- and RTLS-data have their specific data quality challenges,
however they exhibit significant synergies. Whereas RTLS-data provides detailed information about
timing and location but lacks context information, HIS-data provides the necessary context [19].</p>
      <p>This research will address two fundamental research challenges to provide data-driven insights in
the work organisation of nurses: (i) a method has to be created to integrate HIS-data and RTLS-data
and (ii) starting from the combined data, process mining algorithms have to be build to identify and
visualise work organisation patterns.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Methodology</title>
      <p>This research addresses two main challenges, both of which will be approached with their own
methodology as described below.</p>
      <p>Challenge 1: The integration of HIS-data and RTLS-data</p>
      <p>This objective will be reached through four successive stages. First, a taxonomy of nursing tasks will
be created by conducting a literature review and observational research. Each identified nursing task
will be mapped to its potential to leave a trail in the HIS- and RTLS-data. To this end, an observational
study was conducted at two acute care wards of a Belgian hospital. Data was collected after approval
of the medical ethical committee and obtaining a written informed consent from participating nurses.
Preliminary results of the observational study can be found in section 4.</p>
      <p>During the second stage a method will be created to integrate both data sources. This will iterate
over two stages: (i) Task footprints (i.e. a representation that matches a nursing task to data points it
generates in the collected data) will be constructed for each nursing task and (ii) Occurrences of the
task footprints in the HIS- and RTLS-data will be automatically identified in the data. Each identified
occurrence will generate one entry in a nursing task log.</p>
      <p>Thirdly, the created method will be evaluated using both artificial and real-life data. Artificial
nursing task logs with their associated task footprints and their corresponding HIS- and RTLS-data will
be generated. Subsequently, the developed method will be applied, allowing a comparison between
the artificial task log and the created task log. Real-life data will be collected in collaboration with
a participating hospital. Ethical approval for this study was obtained from both the central ethical
committee at Hasselt University and the local ethical committee at the participating hospital. Prior to
data collection, informed consent will be obtained from participating nurses: (i) consent to extract a
predefined list of entries made by the nurse into the HIS and (ii) consent to gather RTLS-data from
designated areas within the hospital ward.</p>
      <p>Finally, the benefits of combining HIS- and RTLS-data will be assessed. Four diferent scenarios will
be compared (i) using only HIS-data, (ii) a combination of HIS-data with RTLS-data from mobile devices,
(iii) a combination of HIS-data with RTLS-data from nurses’ tags and (iv) the combination of HIS-data
with RTLS-data from both nurses’ tags as well as mobile devices. For each scenario a nursing task log
will be created after which a set of metrics is calculated to quantify their information value.</p>
      <p>Challenge 2: Identifying and visualising work organisation patterns</p>
      <p>After tackling the first challenge, the created nursing task log will be analysed for specific work
organisation patterns.</p>
      <p>First, a conceptual framework of work organisation patterns among nurses will be created through a
literature review. Every discovered pattern will be assessed for its ability to be detected in the created
nursing task log.</p>
      <p>Secondly, a series of novel algorithms will be created to detect the identified patterns in the created
log and to visualise them. Since the method will include a broad spectrum of work organisation patterns,
connections between patterns can also be investigated. Explicit attention will be attributed to the visual
output representation.</p>
      <p>Finally, the algorithms will be evaluated and the benefits of presenting the analysis results to nurses
will be assessed. Artificial nursing task logs will be used to evaluate the developed algorithms. To assess
the benefits of the addition of data-driven insights during workshops to generate work organisation
improvement ideas, two groups of nurses will be brought together to generate ideas. The control group
will use traditional brainstorming techniques, while the discussion in the treatment group will be
enriched with data-driven support. The output of both groups will be compared for both quality and
quantity of generated ideas.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Preliminary results</title>
      <p>To get an overview of the diferent nursing tasks performed at the hospital ward participating in this
research, a cross-sectional observational study with nurses as participants was conducted at two Belgian
hospital wards. Data about both the execution of nursing tasks and the registration of information
in the HIS was collected. Observed tasks were mapped to nursing interventions as described in the
Nursing Intervention Classification (NIC). The NIC is a comprehensive, research-based and standardized
classification of interventions performed by nurses. The classification ofers a broad spectrum of
interventions, ranging from direct patient care (i.e. nursing interventions performed in the presence of
patients and/or their families) to indirect care (i.e. nursing interventions performed away from patients
but on their behalf), like administrative functions and supply chain management [20]. A total of 63
distinct interventions and 43 unique types of data entries into the HIS were observed. Noteworthy
is that some interventions are never registered in the HIS. Furthermore, a complex relationship was
observed between interventions and their HIS registrations. For example, a single intervention could be
documented under multiple types of HIS entries, and conversely, a single HIS entry could correspond to
multiple interventions. Finally, a significant discrepancy in the timing of the execution of interventions
and their registrations was observed, with only 13.9% of interventions being registered simultaneously
with their execution. These findings will be critical throughout the remainder of the research project.
For instance, some interventions may leave a trail only in RTLS-data, as they are not captured in HIS.
Additionally, when analyzing HIS-data, careful consideration must be given to the correct corresponding
interventions to ensure accurate interpretation of findings. Finally, the study resulted in an overview of
the diferent rooms in which nurses perform their interventions, the mobile equipment they use during
their activities and the entries they make in the HIS. This list was added to the file submitted to the
medical ethical committee in order to get their approval for the remainder of the research project.</p>
      <p>A first literature research was conducted in an efort to conceptualise work organisation patterns and
to list existing patterns into a framework, thereby tackling the second research challenge. However, first
results seem to indicate there is not yet a clear description about what constitutes as a work organisation
pattern. Already described and investigated patterns are scattered among diferent research domains
and are mostly studied in isolation. Further literature research is needed to support this claim and will
be conducted during the project.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Research next steps</title>
      <p>The recently received approval from the medical ethical committee indicated a next stage in this research
project. Currently, practical arrangements are being made to set up data collection. This includes the
installation of the equipment needed for the RTLS-data at the hospital ward and setting up the data
extraction from the HIS in collaboration with the hospital’s IT department. Simultaneously, the nursing
team will be thoroughly informed about the research and informed consents will be gathered. Once
completed, data can be collected for several time periods.</p>
      <p>Meanwhile, the previously described task footprints in section 3 will be constructed based on the
data gathered on nursing interventions and their registrations during the observational study.</p>
      <p>In addition, the literature review on work organisation patterns will be continued. The objective
of this research is to conceptualise the term work organisation pattern and develop a framework that
identifies and categorizes distinct patterns within this concept.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusion</title>
      <p>This doctoral research aims to aid nurses in generating work organisation improvement ideas by ofering
them data-driven insights in their current work organisation. These data-driven insights will stem from
the analysis of a nursing task log that will be constructed using both HIS- and RTLS-data gathered from
nurses and mobile devices. The combination of these two data sources will allow us to investigate the
synergies between them in an empirical way. Moreover, this research will aid in understanding work
organisation patterns among nurses, their impact on work organisation in general, how to detect them
and how to visualise them in a usable way for nurses.
[11] N. Martin, Using indoor location system data to enhance the quality of healthcare event logs:
opportunities and challenges, in: Business Process Management Workshops: BPM 2018 International
Workshops, Sydney, NSW, Australia, September 9-14, 2018, Revised Papers 16, Springer, 2019, pp.
226–238.
[12] A. Guzzo, A. Rullo, E. Vocaturo, Process mining applications in the healthcare domain: A
comprehensive review, wires data mining knowl, 2022.
[13] A. Rule, M. F. Chiang, M. R. Hribar, Using electronic health record audit logs to study clinical
activity: a systematic review of aims, measures, and methods, Journal of the American Medical
Informatics Association 27 (2020) 480–490.
[14] R. S. Mans, W. M. Van der Aalst, R. J. Vanwersch, Process mining in healthcare: evaluating and
exploiting operational healthcare processes, Springer, 2015.
[15] L. Vanbrabant, N. Martin, K. Ramaekers, K. Braekers, Quality of input data in emergency
department simulations: Framework and assessment techniques, Simulation Modelling Practice and
Theory 91 (2019) 83–101.
[16] S. L. Feder, Data quality in electronic health records research: quality domains and assessment
methods, Western journal of nursing research 40 (2018) 753–766.
[17] K. Goel, S. Sadeghianasl, R. Andrews, A. Ter Hofstede, M. T. Wynn, D. Kapugama Geeganage,
S. J. Leemans, J. McGree, R. Eden, A. Staib, et al., Digital health data imperfection patterns and
their manifestations in an australian digital hospital, in: Proceedings of the 56th Annual Hawaii
International Conference on System Sciences, HICSS 2023, University of Hawai’i at Manoa, 2023,
pp. 3235–3244.
[18] T. L. Jones, C. Schlegel, Can real time location system technology (rtls) provide useful estimates of
time use by nursing personnel?, Research in nursing &amp; health 37 (2014) 75–84.
[19] N. Martin, N. Wittig, J. Munoz-Gama, Using process mining in healthcare, in: Process mining
handbook, Springer International Publishing Cham, 2022, pp. 416–444.
[20] H. Butcher, G. Bulechek, J. Dochterman, C. Wagner, Nursing Interventions Classification 7e (NIC),
2018.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J.</given-names>
            <surname>Munoz-Gama</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Fernandez-Llatas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. A.</given-names>
            <surname>Johnson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Sepúlveda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Helm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>GalvezYanjari</surname>
          </string-name>
          , E. Rojas,
          <string-name>
            <given-names>A.</given-names>
            <surname>Martinez-Millana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Aloini</surname>
          </string-name>
          , et al.,
          <article-title>Process mining for healthcare: Characteristics and challenges</article-title>
          ,
          <source>Journal of Biomedical Informatics</source>
          <volume>127</volume>
          (
          <year>2022</year>
          )
          <fpage>103994</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>K.</given-names>
            <surname>Van den Heede</surname>
          </string-name>
          , K. Balcaen,
          <string-name>
            <given-names>N.</given-names>
            <surname>Bouckaert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Bruyneel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Cornelis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Sermeus</surname>
          </string-name>
          , C. Van de Voorde,
          <article-title>Improving hospital nurse stafing during the pandemic: Implementation of the 2019 fund for health care staf in belgium</article-title>
          ,
          <source>Health policy 128</source>
          (
          <year>2023</year>
          )
          <fpage>69</fpage>
          -
          <lpage>74</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P. F.</given-names>
            <surname>Boxall</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Purcell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Wright</surname>
          </string-name>
          ,
          <source>The Oxford handbook of human resource management</source>
          , Oxford university press, USA,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>R. J.</given-names>
            <surname>Vanwersch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Shahzad</surname>
          </string-name>
          , I. Vanderfeesten,
          <string-name>
            <given-names>K.</given-names>
            <surname>Vanhaecht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Grefen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Pintelon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mendling</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. G. van Merode</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. A.</given-names>
            <surname>Reijers</surname>
          </string-name>
          ,
          <article-title>A critical evaluation and framework of business process improvement methods</article-title>
          ,
          <source>Business &amp; Information Systems Engineering</source>
          <volume>58</volume>
          (
          <year>2016</year>
          )
          <fpage>43</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Lopetegui</surname>
          </string-name>
          , P.-Y. Yen,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lai</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Jefries</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Embi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Payne</surname>
          </string-name>
          ,
          <article-title>Time motion studies in healthcare: what are we talking about?</article-title>
          ,
          <source>Journal of biomedical informatics 49</source>
          (
          <year>2014</year>
          )
          <fpage>292</fpage>
          -
          <lpage>299</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Congdon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Craft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Christensen</surname>
          </string-name>
          ,
          <article-title>Are we measuring nursing workflow correctly? a literature review</article-title>
          ,
          <source>British Journal of Nursing</source>
          <volume>29</volume>
          (
          <year>2020</year>
          )
          <fpage>1252</fpage>
          -
          <lpage>1259</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lavander</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Meriläinen</surname>
          </string-name>
          , L. Turkki,
          <article-title>Working time use and division of labour among nurses and health-care workers in hospitals-a systematic review</article-title>
          ,
          <source>Journal of Nursing Management</source>
          <volume>24</volume>
          (
          <year>2016</year>
          )
          <fpage>1027</fpage>
          -
          <lpage>1040</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Furåker</surname>
          </string-name>
          ,
          <article-title>Nurses' everyday activities in hospital care</article-title>
          ,
          <source>Journal of nursing management 17</source>
          (
          <year>2009</year>
          )
          <fpage>269</fpage>
          -
          <lpage>277</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Bendavid</surname>
          </string-name>
          ,
          <article-title>Rtls in hospitals: technologies and applications</article-title>
          , in: Encyclopedia of
          <string-name>
            <surname>E-Commerce</surname>
            <given-names>Development</given-names>
          </string-name>
          , Implementation, and Management,
          <source>IGI Global</source>
          ,
          <year>2016</year>
          , pp.
          <fpage>1868</fpage>
          -
          <lpage>1883</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>E. De Roock</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Martin</surname>
          </string-name>
          ,
          <article-title>Process mining in healthcare-an updated perspective on the state of the art</article-title>
          ,
          <source>Journal of biomedical informatics 127</source>
          (
          <year>2022</year>
          )
          <fpage>103995</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>