<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Use of Care Mapping for Statistical Purposes in Norwegian Municipalities - What are the Challenges for Nurses?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jorunn Bjerkan</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hildfrid Brataas</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Une Hallem</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Care Research Mid-Norway</institution>
          ,
          <addr-line>Steinkjer</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Municipality of Verdal</institution>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Nord University, dept. of Health Science</institution>
          ,
          <addr-line>Levanger</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
      </contrib-group>
      <fpage>21</fpage>
      <lpage>32</lpage>
      <abstract>
        <p>Introduction: “IPLOS” is a central health register providing the basis for mandatory national statistics on care in Norwegian municipalities. Data are entered in IPLOS under 16 variables, for example “dressing” or “social behavior”. A score reflecting the care level is assigned for each variable. The aim of this study was to explore knowledge, skills and needs for increased competence in IPLOS mapping among care providers and to pilot a collaborative “World Café” training intervention. Methods: A three-step sequential approach starting with a questionnaire, followed by field observation of an intervention using the “World Café” method. The third step was a followup questionnaire. Results: The first questionnaire showed that four IPLOS variables were challenging to map and score. The World Café activated the participants through discussions and reflections. The second questionnaire showed no general improvement in mapping skills. Discussion and conclusion: The nurses obtained an insight into their own IPLOS competence and lack of competence, and their motivation for mapping. There seems to be a need for more experience-based learning during everyday practice.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>Nursing assessment</kwd>
        <kwd>municipal care</kwd>
        <kwd>statistics</kwd>
        <kwd>electronic patient records</kwd>
        <kwd>World Café method</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        In Norway, IPLOS is a tool for documenting and reporting care needs in
municipalities [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The system type and amount statistics of care required to meet all
individual patients' needs, and is used for organizing healthcare. Health care personnel
in Norwegian municipalities carry out the care mapping for planning and statistical
purposes. This study explored care providers’ perceptions on IPLOS mapping
challenges, and their experiences of learning additional mapping skills by attending a
World Café intervention.
      </p>
      <p>Copyright © 2016 by the paper's authors. Copying permitted for private and academic purposes.</p>
      <p>
        Individual-based statistics for nursing and care services (IPLOS) is a Norwegian
system of care mapping. The name “IPLOS” is an acronym for “Individbasert
pleieog omsorgsstatistikk”, in English: “Statistics linked to individual needs for care”.
IPLOS was introduced in 2006 as a basis for mandatory national statistics for
municipal care. IPLOS information is collected about each individual patient or care
service recipient in care planning and care practice. (see Table 1 for an overview of
the variables and score levels). IPLOS mapping is carried out as soon as care needs
occur or change, unless the change is temporary. It is then followed up regularly.
National authorities collect municipal IPLOS statistics twice a year. The objectives
are to gain systematic knowledge of care in Norwegian municipalities, to develop
quality of care and to utilize resources optimally. IPLOS information is also used for
improving equality of care between municipalities, or even among care recipients
individually [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        Municipal care providers in Norway document healthcare in electronic health
records (EHRs) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The three main EPR systems used in Norwegian municipalities
all include domains for IPLOS registration. System functionality varies from full
integration between daily care documentation and IPLOS registration to separate
domains for daily care documentation and IPLOS registration.
      </p>
      <p>
        Implementing IPLOS, municipalities experienced discrepancies in IPLOS mapping
and documentation practices in different care districts. Therefore, one municipality in
mid-Norway conducted an internal survey on nurses’ practice and knowledge about
IPLOS mapping [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Nurses in the municipality expressed a need for more training in
IPLOS documentation. Our study was a follow-up. Were all the IPLOS variables and
criteria well understood? Could a collaborative learning intervention lead to more
knowledge and shared understanding of the IPLOS mapping among the care
providers?
      </p>
      <p>Aim of the study:
• To gain insight into which variables were hard to map and score
correctly according to the criteria for the IPLOS variables.
• To find out whether care providers experienced any IPLOS variables
as challenging to understand.
• To explore whether the World Café method could stimulate
collaborative learning and increase competence in IPLOS mapping
and scoring among care providers.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <p>In this study, we applied a multi-method, three-step sequential approach:
1: An initial questionnaire with questions on the 16 IPLOS variables as well as
some questions on the ICT system used.
2: Field observation of an intervention using the “World Café” method.
3: A follow-up questionnaire with identical questions to the initial questionnaire to
evaluate the result of the intervention.</p>
      <p>This study was carried out in a medium-sized municipality in mid-Norway
(1400015000 inhabitants in 2011).
2.1</p>
      <sec id="sec-2-1">
        <title>Sample and sampling</title>
        <p>
          The sample was information-rich and homogeneous [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] in that the respondents were
nurses and nursing assistants in health care services in the municipality who worked
with IPLOS mapping. Nurses and nurse assistants at one ward in a nursing home and
in one care district of the municipality were included. The 29 registered nurses
(bachelor’s degree level) and the 17 nursing assistants (technical college level)
working part-time or in fulltime positions at these two sites were asked to participate
in the study. An information note from the researchers requesting participation was
distributed in advance of the study. This study started in January 2011. The World
Café seminars took place during two weeks in April/May, and the last questionnaire
was distributed 20 weeks after the intervention period.
        </p>
        <p>
          The objectives of the World Café meetings were 1) to learn from university college
teachers, 2) to engage in meaningful conversations about the four IPLOS variables
that were experienced as difficult to score, and 3) to promote future IPLOS scoring
competence experiences among the World Café participants. The World Café format
[
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] created a dialog in order to explore questions in small group discussions and
cocreate a learning culture aimed at raising the nurses’ competence in future scoring
practice. “The World Café is a simple yet powerful conversational process that helps
people engage in constructive dialogue, build personal relationships, foster
collaborative learning, and discover new possibilities for action”. The World Café
method is useful for creating dialogs and stimulating learning through reflection [
          <xref ref-type="bibr" rid="ref6 ref7">6,
7</xref>
          ]. The World Café method emphasizes an informal style and atmosphere, without a
focus on the performance of the participants [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. The philosophy behind World Café
education is that each person has his or her interpretations and mental models of the
world, and individuals can broaden their understanding only by sharing viewpoints
and learning about alternative interpretations and understanding of various
alternatives for action [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>The questionnaires</title>
        <p>The questionnaires were developed especially for this study, because no
representative and validated questionnaire was found. We arranged a pilot test of the
initial questionnaire among 11 nurses who were using IPLOS mapping in a
neighboring municipality. After receiving their responses, we modified two questions
linguistically.</p>
        <sec id="sec-2-2-1">
          <title>The questionnaires focused on two main areas:</title>
          <p>• Understanding of IPLOS as a system for mapping nursing interventions and
care needs.
• Understanding of IPLOS registration challenges finding the correct level for
scoring care needs.</p>
          <p>A third, minor area of the questionnaire focused on ICT system challenges in
mapping and scoring IPLOS variables.</p>
          <p>The initial and follow-up questionnaires had identical questions about IPLOS
registration. There were four alternatives for answers in a Likert scale: Totally agree,
agree somewhat, disagree somewhat and totally disagree. Some parts of the
questionnaires included open areas for complementary comments. Questionnaires
were analyzed using SPSS 19, frequency analyses.</p>
          <p>We used the results from questionnaire 1 for the following intervention, the World
Café. In a World Café process, each table has its own host. Groups of five to seven
participants circulate between the “café tables”, discussing the theme in focus at each
The research project was approved by the Norwegian Social Science Data Services
(NSD). Participation in the study was voluntary. Department heads provided verbal
information to their employees before the questionnaires were distributed to
respondents. Written information and a consent form accompanied the distributed
questionnaires and the World Café intervention part of the study. All information was
kept confidential.
3</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>3.1</p>
      <sec id="sec-3-1">
        <title>The initial questionnaire</title>
        <p>We received 19 answers for the first questionnaire, a response rate of 41.3 % of the
nurses and nurse assistants asked to participate in the study. The results showed that
four variables were more challenging than others to map correctly and document in a
proper nursing professional style; results are presented in the next paragraph, and in
Table 2. The results also showed that scoring “Some need for help/assistance” was
less challenging than other levels and that scoring “Great need for help/assistance”
was more challenging than other scoring levels.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>The field study of the “World Café” intervention</title>
        <p>In total, 46 health care personnel (29 nurses and 17 nursing assistants) participated in
the seminars. Based on the results from the initial questionnaire, three themes that
refer to the four ‘difficult’ variables were introduced, and thereafter discussed in the
seminars:
1.
2.
3.</p>
        <sec id="sec-3-2-1">
          <title>To control one’s own behavior. To take care of one’s own health, AND to make daily life decisions (two variables in one seminar). To participate in social activities.</title>
          <p>The results from these seminars showed that participants reflected upon each of the
challenging IPLOS variables in a professional way. They discussed which data and
which identification of patient needs by nurses would be relevant to include in IPLOS
mapping, and how to score variables at correct levels.</p>
          <p>“To control one’s own behavior” was regarded as referring to both verbal and
physical behavior related to each individual health situation, illness and
emotional balance. The seminar participant’s interpretations of behavior and
causal connections then influenced criteria for score levels. Challenges in
understanding of the “behavior” variable were the staff’s acceptance level for
“uncontrolled” behavior, and variations for each patient during a day, e.g. in
connection with patients with dementia.
“To take care of one’s own health and to make daily life decisions”: The
participants showed little confidence in scoring these variables. They discussed
the patients’ scope and capability for decision-making and the difference between
scoring these variables in a home-care situation and in an institutional situation.
“To participate in social activities”: Motivation for and confidence in the
situation were elements highlighted in the discussion about the patient’s social
life. Challenges were factors such as scoring the possibility of active living and
needs for activity for the patients. Individual mapping including available
background information about individual patients was regarded as essential.</p>
          <p>Summarizing comments from seminar participants were: “It is necessary to
implement IPLOS mapping routines”, and “All my colleagues should have
participated here”. Participants suggested changes in mapping practice, scoring more
frequently and pairs of two nurses mapping IPLOS.</p>
        </sec>
      </sec>
      <sec id="sec-3-3">
        <title>The follow–up questionnaire</title>
        <p>The second questionnaire was distributed to 15 nurses who had participated in two or
three seminars. Fourteen nurses answered (93.3 %). Comparing results from
questionnaire 1 and 2, we found minor, but no clear changes in understanding the
meaning of each IPLOS variables. See Table 2.</p>
        <p>Was there a difference in knowledge about how to score each IPLOS variable from
the first to the second survey? Comparing the results, we found changes from
questionnaire 1 to questionnaire 2. The majority of answers showed increased
understanding for the “somewhat agree” statement. Fewer nurses totally disagreed
with the statement on knowing how to score all IPLOS variables after the
intervention. For those who totally agreed that they knew how to score some of the
variables in the first questionnaire, the results varied from no change to both higher
and lower agreement with the statement in the second questionnaire.
Score levels:
Score no 1: No
problems or challenges
Score no 2:
No need for assistance
Score no 3: Some need
for assistance
Score no 4: Great need
for assistance
Score no 5: Need for
full assistance
Score no 9:
Not applicable</p>
        <p>The responses to the initial questionnaire did not highlight ICT as one of the major
challenges in mapping practice, thus this subject was not specifically addressed in the
World Café seminars. The answers in the second questionnaire nevertheless showed
that fewer nurses answered ‘totally agree’ when asked whether they had had suitable
ICT training after the intervention period than in questionnaire 1, before the
intervention.</p>
        <p>Asked if they thought the EHR system was difficult to use for mapping and scoring
IPLOS variables, more nurses totally agreed with that statement after than before the
intervention, and vice versa: more nurses totally disagreed to the statement before
than after the intervention.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <p>The first survey identified challenging areas of IPLOS mapping. The World Café
activated the participants by discussions and reflections, but the second questionnaire
did not indicate an improvement in their understanding of the ‘difficult’ IPLOS
variables. There seems to be some change in their knowledge about how to score each
IPLOS variable.
•
•</p>
      <p>Understanding IPLOS as a system for mapping needs for nursing care seems to
be changing among the participants. Motivation for IPLOS mapping was
expressed during the intervention. The results from the second survey did not
reflect change in understanding and mapping practices.</p>
      <p>Understanding IPLOS registration challenges due to scoring the intervention
needs at a correct level still seemed problematic several weeks after the
intervention.</p>
      <p>
        It is uncertain whether the World Café participants had any learning outcome from
lectures given by the teachers of the University College. On the other hand, the
findings showed that the participants in the World Café seminars discussed both
relevant professional matters and technical mapping problems. The occurrence of
open discussions is consistent with World Café method theory [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ]. We found that
participants showed interest in increasing their competence, but results from
questionnaire 2 showed no clear indication of increased mapping or scoring
competence.
      </p>
      <p>
        The World Café method is considered to be a suitable methodology for educating
groups of people [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. In this project, the World Café method seem to be useful for
creating dialogs and to stimulate learning through reflection, in line with other
research findings [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. The participants were also motivated for collaborative
learning by suggesting mapping IPLOS variables together in pairs. This is also in
accordance with World Café method theory [
        <xref ref-type="bibr" rid="ref5 ref7">5, 7</xref>
        ]. In line with the philosophy of the
World Café method [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], participants expressed their own perspectives, collaborated,
and extended their knowledge.
      </p>
      <p>
        The data from the questionnaires and the seminars showed a change in
understanding of the content of IPLOS variables. The results from the World Café
method may indicate learning as described in the theory of group-based experiential
learning through reflection on experience from practical professional work [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. On the
other hand, the results of this study do not indicate that use of a World Café method
improved the care staff’s confidence in their own IPLOS mapping and scoring
competence, and therefore they were motivated for more collaborative learning and
mapping practice. This corresponds with results regarding needs for ICT training and
learning about how to overcome EHR documentation challenges regarding IPLOS
mapping.
      </p>
      <p>
        The intervention in this study, and use of the World Café method, relied on the
nurse’s experience-based knowledge. During the World Café discussions, they could
support each other in learning about the four mapping variables they all seem to feel
uncertain about. By collaborating, they could gain knowledge from the “zone of
proximal development” [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]; the zone of what was difficult was about the same for all
participants. This could lead to a feeling of equality that supported the collaborative
discussions underlined as a philosophy of the World Café method [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. This may have
led to an increase in collaborative learning confidence as well as a stronger focus on
participants’ own mapping and scoring challenges seen in the results of the second
questionnaire. We consider this to be relevant learning in the sense that nurses
obtained an insight in their own IPLOS competence and even more important;
insights into areas where they did not have enough knowledge.
      </p>
      <p>
        During everyday nursing practice, IPLOS mapping should be learned gradually,
like learning other complex skills. Ways of working that include organizational
changes and ICT systems have been found to take 17 years to implement [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ].
People learn from remembering something and may then analyse and evaluate
knowledge, and in the end learn to use the knowledge in a situation-based way [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
In the learning process during the World Café seminars, the participants stated that
they had increased their understanding of IPLOS mapping and scoring as such.
Understanding the challenge in utilizing this knowledge also seemed to increase. In
line with theory and research underlining that learning about new mapping systems
and change of practice may last several years, our results underline a need for more
time for learning activities [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The World Café created an opportunity for
reflections, although these were not necessarily followed up in daily mapping
practices. From the World Café experiences, we learned that nurses wanted to sit
down together in pairs to discuss, map and document the IPLOS variables and scores
before entering the results in the patient EHRs. This collaboration during mapping
practice may support learning in a situation-based way [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. On the other hand, there
seemed to be a need for development of methods and tools to support nurses in their
learning and mapping of countable care. After completion of this study, the
Norwegian Directorate of Health has identified training needs [
        <xref ref-type="bibr" rid="ref15">15, 16</xref>
        ], and generated
an e-learning platform to support nurses in learning IPLOS mapping practice [17].
4.1
      </p>
      <sec id="sec-4-1">
        <title>Study limitations</title>
        <p>No validated questionnaires regarding content, criteria and knowledge about IPLOS
variable scoring were found. Another limitation was the low number of participants in
the study. To obtain statistically significant results, there is a need for larger samples
in future research. Respondents from only two care entities of one municipality also
represented a limitation that may make the results of the study less representative.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>Charting experiences of challenging IPLOS variables and scoring levels, followed by
three World Café seminars, seemed to support the participants in obtaining an insight
into their own IPLOS competence and lack of competence, and to heighten their
motivation for mapping. The results indicate that collaborative learning and reflection
during World Café sessions may provide more insight into each participant’s
knowledge level. There seemed to be a need for more training to achieve relevant
competence and a need for more experience-based learning during daily practice.
Acknowledgments We want to thank the nurses who answered our questionnaires
and participated in the World Café seminars. We also want to thank Gunn Wolden,
Aud Moe and Bente Northug for being lectures in the World Café seminars. Finally,
thanks to Margaret Forbes for her contribution in improving the language of the
article.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. IPLOS:
          <article-title>Veileder for personell i kommunale helse- og sosialtenester [The Norwegian Directorate of Health: IPLOS guidelines for personnel in municipal health and social</article-title>
          care services] Helsedirektoratet, Oslo (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>EPJ</surname>
            <given-names>MONITOR</given-names>
          </string-name>
          :
          <article-title>Oversikt over utbredelse og bruk av IKT i helsetjenesten [EPR Monitor</article-title>
          .
          <article-title>Annual report 2008 - Overview of prevalence and use of ICT in healthcare services]</article-title>
          . NTNU,
          <string-name>
            <surname>Trondheim</surname>
          </string-name>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Hallem</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bjerkan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brataas</surname>
          </string-name>
          , H.:
          <article-title>IPLOS som sykepleiefaglig vurderingsverktøy: Behov for og nytte av kompetansehevende utviklingsarbeid [Iplos an a tool for nursing assessment: a need for and benefit of rise in competences]</article-title>
          .
          <source>HiNT-publikasjoner rapport nr 80</source>
          , (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Polit</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beck</surname>
          </string-name>
          , C.T.:
          <article-title>Essentials of nursing research: Appraising evidence for nursing practice</article-title>
          . Wolters Kluwer Health (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Tan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , J.:
          <article-title>The World Café in Singapore Creating a Learning Culture Through Dialogue</article-title>
          .
          <source>The Journal of Applied Behavioral Science</source>
          <volume>41</volume>
          ,
          <fpage>83</fpage>
          -
          <lpage>90</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Alnes</surname>
            ,
            <given-names>R.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vågen</surname>
            ,
            <given-names>S.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Midbust</surname>
            ,
            <given-names>M.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krøvel</surname>
            ,
            <given-names>B.S.:</given-names>
          </string-name>
          <article-title>Dialogkafé og refleksjonsgrupper som et virkemiddel i kontinuerlig forbedringsarbeid i hjemmetjenestene [World Café method and reflection groups as a tool for continous improvement in home care services] (</article-title>
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , J.,
          <string-name>
            <surname>Isaacs</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The world café: Shaping our futures through conversations that matter</article-title>
          . Berrett-Koehler Publishers (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Schieffer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Isaacs</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gyllenpalm</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The world café: part one</article-title>
          .
          <source>World Business Academy 18</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Beverley</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Worsley</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Learning and teaching in social work practice</article-title>
          .
          <source>Palgrave Macmillan</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Vygotsky</surname>
            ,
            <given-names>L.S.:</given-names>
          </string-name>
          <article-title>Mind in society: The development of higher psychological processes</article-title>
          . Harvard university press (
          <year>1980</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Balas</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          :
          <article-title>Information systems can prevent errors and improve quality</article-title>
          .
          <source>Journal of the American Medical Informatics Association</source>
          <volume>8</volume>
          ,
          <fpage>398</fpage>
          -
          <lpage>399</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Tichansky</surname>
            ,
            <given-names>D.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morton</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jones</surname>
            ,
            <given-names>D.B.</given-names>
          </string-name>
          :
          <article-title>The SAGES Manual of Quality, Outcomes</article-title>
          and
          <string-name>
            <given-names>Patient</given-names>
            <surname>Safety</surname>
          </string-name>
          . Springer Science &amp; Business
          <string-name>
            <surname>Media</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krathwohl</surname>
            ,
            <given-names>D.R.:</given-names>
          </string-name>
          <article-title>A taxonomy for learning, teaching, and assessing: A revision of bloom's taxonomy of educational objectives</article-title>
          .
          <source>Allyn &amp; Bacon</source>
          . Boston, MA (Pearson Education Group) (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Benner</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sutphen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leonard</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Day</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Educating nurses: A call for radical transformation</article-title>
          . John Wiley &amp; Sons (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kjelvik</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herbern</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <article-title>Helsedirektoratet: Diagnoser i IPLOS-registeret [Diagnoses in the IPLOS-index]</article-title>
          .
          <source>Helsedirektoratet</source>
          , Oslo (
          <year>2014</year>
          ) Herbern,
          <string-name>
            <given-names>S.M.</given-names>
            ,
            <surname>Grimeland</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.O.</surname>
          </string-name>
          :
          <article-title>Hvordan benytter kommunene seg av og vedlikeholder IPLOS-dataene? -En undersøkelse til norske kommuner [Exploring use- and maintenance of IPLOS-data in Norwegian municipalities]</article-title>
          . In: Helsedirektoratet (ed.), (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>