<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshop on Collaborative Technologies for Working and Learning, Sept.</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>A Sensemaking Interface for Doctors' Learning at Work: A Co-Design Study Using a Paper Prototype</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Vladimir Tomberg</string-name>
          <email>vtomberg@tlu.ee</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mohammad Al-Smadi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tamsin Treasure-Jones</string-name>
          <email>T.Treasure-Jones@leeds.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tobias Ley</string-name>
          <email>tley@tlu.ee</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Informatics, Tallinn University</institution>
          ,
          <country country="EE">Estonia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Leeds</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2013</year>
      </pub-date>
      <volume>21</volume>
      <issue>2013</issue>
      <abstract>
        <p>In the process of everyday work, medical doctors usually have no time for reflecting, organizing and making sense of information that reflects valuable informal learning experiences. In this paper we propose a prototype that supports retrieval from episodic memory of informal experiences and sensemaking in semantic memory. A paper prototype was used in several codesign sessions with healthcare professionals to validate the idea.</p>
      </abstract>
      <kwd-group>
        <kwd>Workplace Learning</kwd>
        <kwd>Sensemaking</kwd>
        <kwd>Health Care</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>While the importance of learning at the workplace and the significance of informal
learning in this process have been stressed by many, there exists a dilemma. Because
of the ever increasing economic and time pressures that today's workforce is subjected
to, there is less and less time to reflect and learn about experiences that have been
made in the workplace. For example, as economic pressures on the Health Care
System have proliferated, the workload of general practitioners (GP) in the UK has
dramatically increased over the past years. Nowadays a doctor sees more than 30 patients
(for 10 minute consultations) on a typical day as well as undertaking home visits. In
addition, she is dealing with administrative issues, and has therefore only limited
opportunity to reflect on and learn from the experiences encountered during the day.</p>
      <p>On the other hand, there is a wealth of informal learning opportunity in this
working day, such as experiencing “Patient Unmet Needs” that then lead to “Doctor’s
Educational Needs”, or performing reviews of significant events. Significant amounts of
informal discussions with colleagues about individual cases can also be observed.
GPs can submit a record of their informal learning experience in the appraisal
process, which is required for their re-validation. However, due to the aforementioned
time pressures, there is a risk that a lot of the valuable experiences get lost, if they are
not remembered or reflected upon.</p>
      <p>We created a sensemaking interface to support retrieval from episodic memory of
informal experiences and sensemaking in semantic memory. A paper prototype was
created in an early design stage to test our assumptions with healthcare professionals.</p>
      <p>Copyright © 2013 for the individual papers by the papers' authors.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Supporting Sensemaking in Informal Learning</title>
      <p>
        We see the task of remembering and making use of informal learning experiences
as a memory retrieval and sensemaking task. Informal learning is episodic in nature,
meaning that episodes of learning experiences are distributed over working time, and
stored in episodic memory. Making sense of these experiences then involves a process
of mental categorization and connecting it to other experiences which happens in
semantic memory [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>
        Tools to support this task usually cover two main phases: foraging (information
seeking, finding, and collecting), and sensemaking (building representations and
interpreting information) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In Healthcare, tools now emerge that help GPs during
information foraging by keeping track of their informal experiences to facilitate
showing evidence of learning for their appraisal process, such as Osmosis 1. However,
available tools lack the support for sensemaking. Sensemaking support, on the other
hand, can be found in systems for information collecting and categorizing [
        <xref ref-type="bibr" rid="ref2 ref3 ref4">2,3,4</xref>
        ],
systems for visual information seeking [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5,6,7</xref>
        ], information visualization [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">8,9,10</xref>
        ],
making sense of large networks [
        <xref ref-type="bibr" rid="ref11 ref12 ref13">11,12,13</xref>
        ], and collaborative sensemaking [
        <xref ref-type="bibr" rid="ref14 ref15 ref16">14,15,16</xref>
        ].
However, these do not focus on retrieving experiences from episodic memory.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>A Design for Supporting Memory Retrieval and Sensemaking</title>
      <p>To effectively support both foraging from individual experience and sensemaking,
the main support mechanisms in the two memory systems, episodic and semantic,
need to be considered. First, to access past episodes from memory, a retrieval process
uses cues, such as the time or location of the episode. Hence, these contextual cues
need to be represented in the interface. Second, categorization and enrichment then
happen in semantic memory in which the episodes are connected to meaningful
categories and other episodes. A support for this sensemaking process needs to provide
flexible ways to group, categorize and enrich the episodes.</p>
      <p>In Fig. 1, a general architecture of the design is presented. The system consists of
two main canvases arranged vertically. The upper canvas is intended for representing
collected informal experiences. These are represented by icons that symbolize
information that was collected in a learning episode, such as a picture that was taken, a
URL that was discovered, a textual or audio note that was taken or a conversation that
was held with a colleague. The collected information does not capture the entire
learning experience but rather provides cues that allow the person to retrieve the
episode from episodic memory to make sense of it at a later stage.</p>
      <p>The lower canvas is intended to support semantic memory, by means of
sensemaking and organization of resources in some meaningful way. Icons can be dragged and
dropped between both canvases, however a main moving direction is top-down. The
lower part then gives different ways to physically manipulate the icons by sorting,
organizing or grouping.</p>
      <p>1 http://osmosis.me
Both upper and lower canvases work as containers, which can be flexibly switched
between different ways of visualizations (a-c in Fig. 1). The upper canvas (Browse)
shows alternative cues that are important in memory retrieval, such as time, location,
topic or person. In (a), users browse resources by the time when they were collected
by shifting a timeline (time). In (b), users browse resources in a map that is arranged
by the places where they were collected (location). Finally, (c) allows for accessing
resources by using tags as filters (topic). Moreover, persons are included in each view
by means of a checkboxes that allow the user to filter resources shared by other users.</p>
      <p>In the lower canvas (Organize), users can arrange icons using round areas that
represent specific categories (a). Placing a resource into a ring assigns a tag to this
resource. By intersecting and placing rings inside each other, complex data structures
can be built. In (b) a layered model is presented, which allows arranging resources
according to different levels of abstraction. In the last example (c), information is
organized into a concept map.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Participatory Co-design Using a Paper Prototype</title>
      <p>Following a design research strategy, previously we have collected evidence
through ethnographic studies, the use of personas etc. Here we particularly focus on
testing assumptions on the general architecture of the design. Because physical
manipulation is a key feature of the design, we employed a paper prototype (as shown in
Fig 1) in which paper icons that represent collected information during learning
episodes can be manipulated (moved, categorized etc.).</p>
      <p>A series of co-design meetings have been held with clinical staff from two medical
practices: 2 GPs and 2 Diabetic Specialist Nurses (DSN) and 2 Health Care Assistants
(HCA). Participants were given an introduction to the tools and using the paper
prototype, could then explore the idea imagining their own collected experiences within
this interface. This allowed us to explore potential usage scenarios and questions
regarding the users’ perception and motivation to use the tools, perceived gaps and
desirable additional functionality.</p>
      <p>The paper prototype has been used in a series of co-design meetings over several
months in order to generate and validate initial ideas and discuss their suitability for
the professional’s working context as well as obtaining user input into the ongoing
designs and use cases.</p>
      <p>Overall participants felt that the tool could work well for them, providing them
with one place in which to record, develop and share both informal learning
experiences (an individual focused use case) and important formal documents (an
organizational focused use case).</p>
      <p>Functionality that they considered to be particularly useful included the timeline
view, the collections visualization, the tag cloud view and the links view. They saw
the tool as offering support at both an individual and organizational level. So whilst it
was important to them to be able to create their own collections, they also felt it
would be useful to have standard collection labels (e.g. collections based on the
revalidation/appraisal categories and/or collection sets agreed across their organisation).
This was also important when considering the tag clouds, as they felt this view could
help them identify common or important themes both within their own material and
also across the organisation if the tag clouds were shared.</p>
      <p>However, the participants thought there would be a risk that they would use the
system to move and sort material but would not do anything else with the material.
For this reason they suggested that one should be prompted to identify actions/tasks
for themselves (and colleagues) related to the material/bits they are working with.
Also related to prompting and showing development and progress, they thought they
would like to use the links in the Links View to present their learning path and the
actions they took during their sensemaking phase. Being able to export these learning
paths and collections, so they could be included as evidence of learning in the
appraisal process, was also important to them.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>From the initial feedback, we conclude that the general architecture of the interface
is perceived to be effective. During retrieval, Healthcare professionals rely on time
and topic cues rather than location cues. Their suggestion for reminders also suggests
that memory processes offer a suitable conceptualization for their informal learning
needs.</p>
      <p>Of course, the meetings were merely the first part of a much longer process and the
practices who are involved in the co-design work will also be working with us to
integrate the tools and pilot them.</p>
      <p>
        We are starting to investigate the important collaborative aspects which have come
out from the initial feedback, such as providing agreed categories and structures,
visualizing tags others have used and sharing material and sensemaking tasks with
colleagues. This can augment the development of meaningful representation of
information [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and we will particularly focus on how this collective knowledge
influences individual sensemaking [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
6
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Kittur</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peters</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diriye</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bove</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Telang</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Costs and benefits of structured sensemaking</article-title>
          .
          <source>CHI</source>
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Baldonado</surname>
            ,
            <given-names>M.W.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Winograd</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>1997</year>
          ).
          <article-title>SenseMaker: an information-exploration interface supporting the contextual evolution of a user's interests</article-title>
          .
          <source>In CHI 1997: Proceedings of the ACM Conference on Human-factors in Computing Systems.</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Terveen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hill</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Amento</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>1999</year>
          ).
          <article-title>Constructing, organizing, and visualizing collections of topically related web resources</article-title>
          .
          <source>Transactions on Computer-Human Interaction (TOCHI)</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <fpage>67</fpage>
          -
          <lpage>94</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Dontcheva</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drucker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wade</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Salesin</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Cohen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Collecting and Organizing Web Content</article-title>
          .
          <source>In IR 2006: Proceedings of the ACM Conference on Personal information Management.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ahlberg</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Shneiderman</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>Visual information seeking: tight coupling of dynamic query filters with starfield displays</article-title>
          .
          <source>In Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence</source>
          (p.
          <fpage>317</fpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Bendix</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kosara</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hauser</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Parallel sets: visual analysis of categorical data</article-title>
          .
          <source>In Information Visualization</source>
          ,
          <year>2005</year>
          .
          <article-title>INFOVIS 2005</article-title>
          . IEEE Symposium on (pp.
          <fpage>133</fpage>
          -
          <lpage>140</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Viégas</surname>
            ,
            <given-names>F.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wattenberg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Dave</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <article-title>Studying cooperation and conflict between authors with history flow visualizations</article-title>
          .
          <source>Proceedings of the SIGCHI conference on Human factors in computing systems</source>
          ,
          <source>ACM</source>
          (
          <year>2004</year>
          ),
          <fpage>575</fpage>
          -
          <lpage>582</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>an</given-names>
            <surname>Ham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            , &amp;
            <surname>Perer</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          (
          <year>2009</year>
          ). “Search, Show Context, Expand on Demand”
          <article-title>: Supporting Large Graph Exploration with Degree-of-Interest. Visualization and Computer Graphics</article-title>
          , IEEE Transactions on,
          <volume>15</volume>
          (
          <issue>6</issue>
          ),
          <fpage>953</fpage>
          -
          <lpage>960</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Bederson</surname>
            ,
            <given-names>B. B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hollan</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>Pad++: a zooming graphical interface for exploring alternate interface physics</article-title>
          .
          <source>In Proceedings of the 7th annual ACM symposium on User interface software and technology</source>
          (pp.
          <fpage>17</fpage>
          -
          <lpage>26</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Yi</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Melton</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stasko</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Jacko</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Dust &amp; Magnet: multivariate information visualization using a magnet metaphor</article-title>
          .
          <source>Information Visualization</source>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <fpage>239</fpage>
          -
          <lpage>256</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Herman</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Melançon</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Marshall</surname>
            ,
            <given-names>M. S.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Graph visualization and navigation in information visualization: A survey</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <fpage>24</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Perer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Shneiderman</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Balancing systematic and flexible exploration of social networks</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          ,
          <fpage>693</fpage>
          -
          <lpage>700</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Wattenberg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Visual exploration of multivariate graphs</article-title>
          .
          <source>In Proceedings of the SIGCHI conference on Human Factors in computing systems</source>
          (pp.
          <fpage>811</fpage>
          -
          <lpage>819</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Morris</surname>
            ,
            <given-names>M.R.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>Collaborative Search Revisited</article-title>
          .
          <source>Proceedings of CSCW</source>
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Balakrishnan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fussell</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiesler</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kittur</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Pitfalls of information Access with Visualizations in Remote Collaborative Analysis</article-title>
          .
          <source>CSCW</source>
          <year>2010</year>
          :
          <article-title>of the on Computer-Supported Cooperative Work</article-title>
          . New York: Press.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Heer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Agrawala</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Design considerations for collaborative visual analytics</article-title>
          .
          <source>Information Visualization</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <fpage>49</fpage>
          -
          <lpage>62</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Eraut</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Informal learning in the workplace</article-title>
          .
          <source>Studies in Continuing Education</source>
          ,
          <volume>26</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Cress</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Held</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kimmerle</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>The collective knowledge of social tags: Direct and indirect influences on navigation, learning, and information processing</article-title>
          .
          <source>Computers &amp; Education</source>
          ,
          <volume>60</volume>
          (
          <issue>1</issue>
          ),
          <fpage>59</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>