<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Activity Recommendation App - Software to Evaluate the Usefulness of Improvement Recommendations Created in a Team</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nils Faltin</string-name>
          <email>nils.faltin@im-c.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Simon Schwantzer</string-name>
          <email>simon.schwantzer@im-c.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Margret Jung</string-name>
          <email>margret.jung@im-c.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>IMC information multimedia communication AG</institution>
          ,
          <addr-line>Saarbrücken</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>77</fpage>
      <lpage>79</lpage>
      <abstract>
        <p>The Activity Recommendation App supports employees in individual and collaborative reflection by capturing discussions and solutions for problems that need to be solved. The app enables employees to record personal experiences with the solutions. Based on these experiences the usefulness of a recommendation can be re-evaluated in order to approve, update, or discard the recommendation. The application was successfully evaluated in coaching employees in learning time management techniques.</p>
      </abstract>
      <kwd-group>
        <kwd>ARA - Activity Recommendation App</kwd>
        <kwd>soft skills improvement</kwd>
        <kwd>recommendation evaluation</kwd>
        <kwd>solution</kwd>
        <kwd>experiences</kwd>
        <kwd>MIRROR Spaces Framework</kwd>
        <kwd>time management coaching</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Reflection on work experiences can lead to new insights and ideas how to handle
work situations better in the future. But the capturing of experiences during work and
the reflection on this data is only half the way for a successful improvement. The
other half is the creation of a viable reflection outcome and the validation of this
outcome when it is applied in practice (see [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]). Based on this validation, a change can be
approved, reverted, or improved and validated again.
      </p>
      <p>
        Whilst a lot of applications support users to capture data during work in order to
provide it in a subsequent reflection session, the second half of the reflection cycle is
often left unsupported. To also cover this part, the Activity Recommendation App
(ARA) was created in the MIRROR project [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. It supports the discussion of
improvement ideas in an individual or collaborative reflection session and frames the
outcome as recommendation. The app allows capturing personal experiences relating
to active recommendations and viewing other members’ experiences if a
recommendation targets a team. Finally, the ARA supports the evaluation of a
recommendations’ usefulness when applied in practice, in order to enable its improvement or
suspension. By providing these features, the Activity Recommendation App aims to
improve the application of insights gained from reflection on work.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Overview of the Main Functionalities</title>
      <p>The recommendation is created in an individual or a collaborative reflection session.
Major elements of this session are the identification of the concrete issue and a viable
solution for this issue. Texts, files, or data from other MIRROR applications can be
attached to be used as evidence to back the comprehensibility of a recommendation.
The events during the discussion are listed as a kind of minutes. Measurement criteria
can be selected to evaluate the usefulness of the recommendation. Before publishing
the recommendation, a target person/group is selected and invited to try the new
solution.</p>
      <p>
        A concrete scenario could look like this (cf. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]): A team uses ARA to find a solution
for their common problem of overtime spent for pending projects. They agree that
frequent interruptions can be one reason for this (issue). In the scenario the teams’
solution is to implement three hours of quiet working time a day and to avoid
interruptions during that period (recommended solution).
To test the recommendation in practice, personal experiences are written down to
decide about how well the recommended solution applied (see Figure 1). Users
capture their experiences by noting down a comment and by rating how well the solution
worked (1 to 5 stars). In addition they can record the effort (e.g., the minutes of
working time required) and the benefit (e.g., the number of completed tasks) of applying
the solution. These experiences are shared with the other members of the target group
to benefit from the application in a group.
      </p>
      <p>To evaluate a recommendation, the app allows users to view all experiences with an
aggregation of the ratings, efforts and benefits captured. All this can then be used to
get an overview how well the solution works in practice to be taken as a basis for the
decision if the solution should be kept, updated or discarded.
78
In the continuation of the exemplary scenario, the team discusses the
recommendation’s weak points (due to the captured experiences) during the regular team meeting
and agrees on adapting it in respect to the selected period in time. It is then
reevaluated, re-discussed, and finally marked as solved when team agrees about a
wellfunctioning final solution.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Evaluation &amp; Outlook</title>
      <p>A summative evaluation of the ARA took place at our company IMC over a period of
six weeks. Ten staff members took part in a time management coaching. The
approach combined the usage of a computer activity tracking tool and the ARA with a
weekly coaching session. In the weekly coaching sessions the coach and the coachee
reviewed the individual progress, adjusted the time management rules if not
appropriate anymore, or, when the particular goal has been achieved and the new behaviour
has been adopted, decided that no further practice regarding that goal is needed.
The Activity Recommendation App served well as a support for learning time
management by providing a data basis for the coaching sessions. It was used by coach and
coachee to set time management goals and to document and monitor the progress in
learning new time management techniques. Both benefited from the better preparation
for the coaching sessions available with the notes in ARA. Furthermore, the app
helped the coachees to focus their goals. Two things were missed concerning ARA: It
lacks an interface optimized for smartphones and currently no reminder function is
available which motivates the user to capture experiences. These shortcomings can be
addressed in future development.</p>
      <p>
        The coach and several coachees also suggested forming peer groups to train time
management techniques. They could then benefit from sharing experience data to
compare own progress with that of others and learn from each other’s experiences.
IMC has started a free online course for time management that includes usage of the
ARA [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In addition to the course, learners can book a human tele-coach for a fee.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Krogstie</surname>
            , Birgit,
            <given-names>Michael</given-names>
          </string-name>
          <string-name>
            <surname>Prilla</surname>
          </string-name>
          , and Viktoria Pammer. “
          <article-title>Understanding and Supporting Reflective Learning Processes in the Workplace: The RL@Work Model</article-title>
          .”
          <source>In Proceedings of the Eigth European Conference on Technology Enhanced Learning</source>
          (EC-℡
          <year>2013</year>
          ),
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <article-title>2. MIRROR project for reflective learning at work</article-title>
          , http://mirror-project.eu/
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3. Video:
          <article-title>Team usage scenario for the Activity Recommendation App</article-title>
          , http://vimeo.com/66798165
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. MOOC “
          <article-title>Time Management“ (Gernan) on OpenCourseWorld</article-title>
          , http://bit.ly/1ufnS0v
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>