<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Building interfaces for self-assessment and feedback in the EMR</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Andrew L. Yin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Inna Wanyin Lin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pargol Gheissari</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Cornell Tech</institution>
          ,
          <addr-line>2 W Loop Rd, New York, NY</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Weill Cornell Medical College</institution>
          ,
          <addr-line>1300 York Avenue, New York, NY</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Electronic medical records (EMRs) have played an increasingly significant role in healthcare. With these major advances, however, have come major pitfalls like the increase in physician burnout and stress. This position describes interventions that can help to address these pitfalls by supporting the desires and interests of the clinicians using the EMR. It presents three augmentations related to self-assessment and feedback to attempt to address these needs: a retrospective dashboard, a collaboration tool, and a research and note taking interface.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Self-assessment</kwd>
        <kwd>feedback</kwd>
        <kwd>self-learning</kwd>
        <kwd>electronic medical record</kwd>
        <kwd>computer-supported cooperative work</kwd>
        <kwd>interfaces</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Since their widespread adoption, there has been
increasing understanding that electronic
medical records (EMRs) play a large role in
physician stress and burnout. Physicians find
themselves working more from home after
hours, answering more messages and emails
now sent and received at any time, and
suffering through both major and minor
usability issues [1,4,8]. Clinicians and
technologists alike cringe when reading Atul
Gawande’s Why Doctor’s Hate Their
Computers or Schulte and Fry’s Death By
1,000 Clicks – disturbed by the time demand of
the EMR, the legal-political complexities, the
introductions of new errors, and the impersonal
feeling that the whole journey has caused
[5,10]. These systems appear to do everything
to pull clinicians away from the work that they
find most meaningful, a key feature in
determining the likelihood of burnout [11]. One
might reasonably think that this problem must
be a global issue, impacting all health systems
relying heavily on EMRs. Unfortunately, US
clinicians appear to be uniquely burdened –
receiving more messages, spending more time
after hours, and spending more time on clinical
activities like note writing, ordering
medications or tests, and reviewing patient
charts [6]. With this said and all the
complexities considered, there continue to be
both technical and political advancements that
encourage and support growth of tools aimed at
improving the EMR for users [2,7].</p>
      <p>This position will argue that developing and
improving tools and interfaces to facilitate
hospital clinician self-assessment and feedback
can be one component to help address inpatient
clinician burnout related to the EMR. Many
innovations focus on reducing the time using
the EMR but few focus on increasing the
personal value obtained from using the EMR.
Adjusting interfaces to include tools that
provide physicians the ability to holistically
learn and grow could reduce the frustration and
burnout associated with using the EMR,
improve patient care, and provide a feeling of
growth to each clinician. We propose features
for adoption and discuss how they fit into key
components of computer-supported
cooperative work (CSCW), improving the
alignment of the EMR with incentive
structures, workflow, and awareness [9].
CSCW has long had a role in shaping EMR
development but the interplay between policy
makers, EMR vendors, hospitals, and care
teams continues to make implementation
complex [3]. These suggested features include
ways to retrospectively present previous patient
information, improvements to collaborative
tools, and tools for learning and research. Such
features could be integrated into the current
workflow of clinicians and could help make the
EMR a better tool for clinicians on the whole.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Discussion</title>
    </sec>
    <sec id="sec-3">
      <title>2.1 Improving Review of Previous</title>
    </sec>
    <sec id="sec-4">
      <title>Patient Information</title>
      <p>EMRs are primarily designed for real-time
clinical care as opposed to retrospective use.
However, clinicians spend significant time,
often more than they wish, looking up previous
patients and assessing themselves based on
what they find [12]. This aligns with both a
clinician’s personal incentive and interest to
improve on their work as well as the hospital’s
interest to improve the quality of care [9]. As
simple as this may seem, providing clinicians
with the opportunity to see what happens to
their patients after caring for them and get a
sense of how their patients are doing
collectively is a function that is unavailable to
most clinicians. Simple information like the
number of patients treated, number of patients
discharged, number of patients readmitted, why
patients are getting readmitted, etc. are
relatively inaccessible to a clinician without
fairly significant additional work. Emergency
room and inpatient clinicians have little to no
knowledge of what happens to a patient in the
long run unless they spend the time
intentionally tracking these patients [12].
We propose the potential value of a simple
dashboard aimed at presenting this information,
focusing specifically on a clinician’s collective
patient panel and allowing them to review
individual cases as they deem necessary. With
the added information, they could now have a
way to roughly sense whether the changes they
make to their practice are making a difference
for their patients, comparing themselves from
year to year or identifying trends or themes in
their patient population. Clinicians are already
spending large amounts of time finding ways to
tally portions of this information themselves.
An interface providing this information in a
readable and concise format will significantly
improve the efficiency in their workflow and
allow them to spend time thinking of solutions
rather than merely tallying data [12]. Given the
amount and the scope of clinical data in the
EMR, building such interfaces with existing
data could be an easy, user-focused
implementation with tremendous value-add.</p>
    </sec>
    <sec id="sec-5">
      <title>2.2 Rekindling peer to peer, genuine collaborations and connections between clinicians</title>
      <p>Clinicians have a common practice of
discussing challenging or tricky cases with one
another, relying on friends or close colleagues
in this process. At the same time, clinicians feel
relatively isolated in a lot of their work and feel
like they are left on their own to manage
patients that may benefit from multiple
perspectives and opinions [12]. The EMR has
the opportunity to build on this collaborative
nature of medicine. The current workings of
EMR inboxes/emails have created a level of
noise and message fatigue that sometimes
discourages genuine conversations between
providers [5]. These existing tools meant to
improve collaboration and communication
have become inundated with bureaucratic and
system related messages, losing sight of their
original intentions. This leaves a gap where
personal, formal peer-to-peer interaction is
missing in the everyday use of the
technology—a part of a clinicians desired daily
workflow that the technology could be
designed to support [9].</p>
      <p>We propose a focus on using the EMR to
facilitate connections between clinicians rather
than isolating them further. It could kindle and
start relationships with other providers to
strengthen the healthcare community and
improve collaboration on patient care. Tools
could aim at both communicating with the close
friends that clinicians already have as well as
finding new ones in different fields and
specialties. These collaborations would be
patient-based, driven by clinical questions and
curiosity about active care or retrospective
questions looking for feedback or teaching
points. Integrating such interfaces in the current
EMR systems also has the benefit of efficient
communication that aligns with the privacy
standards in the Health Information Portability
and Accountability Act (HIPPA). Again, the
EMR has an opportunity to reinforce and
encourage behaviors that clinicians actively
perform as a way to feel more complementary
to their work as opposed to antagonistic.</p>
    </sec>
    <sec id="sec-6">
      <title>2.3 Streamlining the process of research and discovery</title>
      <p>One of the most enjoyable features of clinical
work is the continuous learning and discovery
that occurs from patients, other providers, and
the literature. Although EMRs are designed to
contain thousands of different alerts to their
users, the platform does little to reinforce
education or provide the groundwork for new
learning to be made. Currently, many EMRs do
link to open outside learning tools like
UpToDate, Epocrates, or similar tools but leave
the user alone in finding and coordinating an
answer – something which might require
multiple resources, websites, and tools. In
addition, after finding the desired information,
there is nothing available for clinicians to more
systematically keep track of the information
learned, opening the door for inefficiency as the
same search may be repeated many times.
Clinicians try many different ways to keep track
of or organize this information but are unable to
find reliable and consistent methods [12].
We propose that the EMR has an opportunity to
support providers in these learning aspirations
by considering their workflow and helping
coordinate the tools related to them. Such
things could allow providers to highlight
important cases to be reviewed again later,
allowing them to insert or connect comments or
thoughts to a patient that may not be suitable for
the patient record but instead for the clinician’s
future reflection. Tools could help coordinate
searches among platforms, streamlining the
process for the clinician in finding answers to
clinical questions. Second, the EMR or a tool
within it has the potential to support the saving
and organizing of these learning points, helping
a clinician keep track of them and find them
again later on. These types of interventions
could reduce the frustrations associated with
inefficient learning and allow clinicians to more
tangibly feel progression in the knowledge they
have achieved.</p>
    </sec>
    <sec id="sec-7">
      <title>3. Conclusion</title>
      <p>Although the EMR has revolutionized the
healthcare industry, it has clearly been
accompanied by some frustrating side effects
that are creating new problems such as
physician burnout and stress. It is important that
one recognizes the components that are
contributing to these issues, such as increased
time using the EMR and reduction in time spent
doing the things that are most important, among
other things. Thus, augmenting the EMR
interface to support items that clinicians find
interesting and help them do those things more
efficiently is important to explore.</p>
      <p>This position describes behaviors and content
that clinicians are already engaging with while
using the EMR but with inefficient and
illdesigned methods. It argues that designing
interfaces that intentionally address these areas
around self-assessment and feedback would be
beneficial in combating these EMR-related
issues, while also providing tools within the
EMR that are designed for the clinician’s
growth. Although there are policies and
structures that can make implementation
challenging, we believe our suggestions do
little to go outside a clinician’s normal practice,
aiming to operationalize these practices. We
acknowledge that different types of clinicians
may also experience these features differently
and would advise a starting focus with
emergency and inpatient physicians as these
groups have little to no systematic follow up
with past patients. It is important to recognize
that the majority of the opportunity that exists
is in the interface and intention of the system,
without requiring new data, new variables, or
new data collection infrastructure. This should
make it all the more exciting to test and
implement within the EMR.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>Julia</given-names>
            <surname>Adler-Milstein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Wendi</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <surname>Rachel</surname>
            Willard-Grace,
            <given-names>Margae</given-names>
          </string-name>
          <string-name>
            <surname>Knox</surname>
            , and
            <given-names>Kevin</given-names>
          </string-name>
          <string-name>
            <surname>Grumbach</surname>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>Electronic health records and burnout: Time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians</article-title>
          .
          <source>J. Am.</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Med</surname>
          </string-name>
          . Inform. Assoc.
          <volume>27</volume>
          ,
          <issue>4</issue>
          (
          <year>2020</year>
          ),
          <fpage>531</fpage>
          -
          <lpage>538</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          DOI:https://doi.org/10.1093/jamia/ocz2 20 Alex
          <string-name>
            <surname>Azar</surname>
            <given-names>II</given-names>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>21st Century Cures Act: Interoperability, Information Blocking, and the ONC Health IT Certification Program</article-title>
          . Department of Health and
          <string-name>
            <given-names>Human</given-names>
            <surname>Services</surname>
          </string-name>
          . Retrieved from https://www.federalregister.gov/docum ents/
          <year>2020</year>
          /05/01/2020-07419/21stcentury-cures
          <article-title>-act-interoperabilityinformation-blocking-and-the-onchealth-it-certification Geraldine Fitzpatrick</article-title>
          and
          <string-name>
            <given-names>Gunnar</given-names>
            <surname>Ellingsen</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>A review of 25 years of CSCW research in healthcare: Contributions, challenges and future agendas</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          DOI:https://doi.org/10.1007/s10606- 012-9168-0
          <string-name>
            <surname>Rebekah L. Gardner</surname>
            , Emily Cooper, Jacqueline Haskell, Daniel A. Harris, Sara Poplau,
            <given-names>Philip J.</given-names>
          </string-name>
          <string-name>
            <surname>Kroth</surname>
            , and
            <given-names>Mark</given-names>
          </string-name>
          <string-name>
            <surname>Linzer</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>Physician stress and burnout: the impact of health information technology</article-title>
          .
          <source>J. Am. Med.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>Informatics</given-names>
            <surname>Assoc</surname>
          </string-name>
          .
          <volume>26</volume>
          ,
          <issue>2</issue>
          (
          <year>2019</year>
          ),
          <fpage>106</fpage>
          -
          <lpage>114</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          DOI:https://doi.org/10.1093/jamia/ocy1 45
          <string-name>
            <given-names>Atul</given-names>
            <surname>Gawande</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Why Doctors Hate Their Computers</article-title>
          .
          <source>The New Yorker</source>
          <volume>12</volume>
          . Retrieved from https://www.newyorker.com/magazine/ 2018/11/12/why-doctors
          <article-title>-hate-theircomputers</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Jay Holmgren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. Lance</given-names>
            <surname>Downing</surname>
          </string-name>
          ,
          <string-name>
            <given-names>David W.</given-names>
            <surname>Bates</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Tait D.</given-names>
            <surname>Shanafelt</surname>
          </string-name>
          , Arnold Milstein,
          <string-name>
            <given-names>Christopher D.</given-names>
            <surname>Sharp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>David M.</given-names>
            <surname>Cutler</surname>
          </string-name>
          , Robert S. Huckman, and
          <string-name>
            <surname>Kevin</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Schulman</surname>
          </string-name>
          .
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <article-title>Assessment of electronic health record use between us and non-us health systems</article-title>
          .
          <source>JAMA Intern. Med</source>
          .
          <volume>02163</volume>
          , (
          <year>2020</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          DOI:https://doi.org/10.1001/jamaintern med.
          <year>2020</year>
          .7071 Joshua
          <string-name>
            <surname>C. Mandel</surname>
            ,
            <given-names>David A.</given-names>
          </string-name>
          <string-name>
            <surname>Kreda</surname>
            ,
            <given-names>Kenneth D.</given-names>
          </string-name>
          <string-name>
            <surname>Mandl</surname>
          </string-name>
          , Isaac S. Kohane, and
          <string-name>
            <surname>Rachel</surname>
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Ramoni</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>SMART on FHIR: A standards-based, interoperable apps platform for electronic health records</article-title>
          .
          <source>J. Am. Med.</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>Informatics</given-names>
            <surname>Assoc</surname>
          </string-name>
          .
          <volume>23</volume>
          ,
          <issue>5</issue>
          (
          <year>2016</year>
          ),
          <fpage>899</fpage>
          -
          <lpage>908</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          DOI:https://doi.org/10.1093/jamia/ocv1 89
          <string-name>
            <surname>Edward R. Melnick</surname>
          </string-name>
          , Liselotte N.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Dyrbye</surname>
            ,
            <given-names>Christine A.</given-names>
          </string-name>
          <string-name>
            <surname>Sinsky</surname>
            , Mickey Trockel, Colin P. West, Laurence Nedelec,
            <given-names>Michael A.</given-names>
          </string-name>
          <string-name>
            <surname>Tutty</surname>
            , and
            <given-names>Tait</given-names>
          </string-name>
          <string-name>
            <surname>Shanafelt</surname>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians</article-title>
          .
          <source>Mayo Clin. Proc. 95</source>
          ,
          <issue>3</issue>
          (
          <year>2020</year>
          ),
          <fpage>476</fpage>
          -
          <lpage>487</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          DOI:https://doi.org/10.1016/j.
          <source>mayocp.2 019</source>
          .09.024
          <string-name>
            <given-names>Wanda</given-names>
            <surname>Pratt</surname>
          </string-name>
          , Madhu C. Reddy,
          <string-name>
            <given-names>David W.</given-names>
            <surname>McDonald</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Tarczy-Hornoch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and John H.</given-names>
            <surname>Gennari</surname>
          </string-name>
          .
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          Inform.
          <volume>37</volume>
          ,
          <issue>2</issue>
          (April
          <year>2004</year>
          ),
          <fpage>128</fpage>
          -
          <lpage>137</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          DOI:https://doi.org/10.1016/j.jbi.
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          04.001
          <string-name>
            <given-names>Fred</given-names>
            <surname>Schulte</surname>
          </string-name>
          and
          <string-name>
            <given-names>Erika</given-names>
            <surname>Fry</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <source>Death By</source>
          <volume>1</volume>
          , 000 Clicks 
          <article-title>: Where Electronic Health Records Went Wrong</article-title>
          . Fortune.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Retrieved</surname>
          </string-name>
          from https://khn.org/news/death-by
          <article-title>-athousand-</article-title>
          <string-name>
            <surname>clicks/ C P West</surname>
            , L N Dyrbye, and
            <given-names>T D</given-names>
          </string-name>
          <string-name>
            <surname>Shanafelt</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Physician burnout : contributors , consequences and solutions</article-title>
          . (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          DOI:https://doi.org/10.1111/joim.1275 2
          <string-name>
            <given-names>Andrew</given-names>
            <surname>Lukas</surname>
          </string-name>
          <string-name>
            <surname>Yin</surname>
          </string-name>
          , Pargol Gheissari, Inna Wanyin Lin,
          <string-name>
            <given-names>Michael</given-names>
            <surname>Sobolev</surname>
          </string-name>
          , John P. Pollak, Curtis Cole, and
          <string-name>
            <given-names>Deborah</given-names>
            <surname>Estrin</surname>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>Role of technology in self-assessment and feedback among hospitalist physicians: semistructured interviews and thematic analysis</article-title>
          .
          <source>J. Med. Internet Res</source>
          .
          <volume>22</volume>
          ,
          <issue>11</issue>
          (
          <year>2020</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>DOI:https://doi.org/10.2196/23299</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>