=Paper=
{{Paper
|id=Vol-1238/paper7
|storemode=property
|title=Activity recommendation app - software to evaluate the usefulness of improvement recommendations created in a team
|pdfUrl=https://ceur-ws.org/Vol-1238/paper7.pdf
|volume=Vol-1238
|dblpUrl=https://dblp.org/rec/conf/ectel/FaltinSJ14
}}
==Activity recommendation app - software to evaluate the usefulness of improvement recommendations created in a team==
https://ceur-ws.org/Vol-1238/paper7.pdf
Activity Recommendation App – Software to Evaluate
the Usefulness of Improvement Recommendations
Created in a Team
Nils Faltin, Simon Schwantzer, Margret Jung
IMC information multimedia communication AG, Saarbrücken, Germany
{nils.faltin,simon.schwantzer,margret.jung}@im-c.de
Abstract. The Activity Recommendation App supports employees in individual
and collaborative reflection by capturing discussions and solutions for problems
that need to be solved. The app enables employees to record personal experi-
ences with the solutions. Based on these experiences the usefulness of a rec-
ommendation can be re-evaluated in order to approve, update, or discard the
recommendation. The application was successfully evaluated in coaching em-
ployees in learning time management techniques.
Keywords: ARA – Activity Recommendation App· soft skills improvement·
recommendation evaluation· solution· experiences· MIRROR Spaces Frame-
work· time management coaching
1 Introduction
Reflection on work experiences can lead to new insights and ideas how to handle
work situations better in the future. But the capturing of experiences during work and
the reflection on this data is only half the way for a successful improvement. The
other half is the creation of a viable reflection outcome and the validation of this out-
come when it is applied in practice (see [1]). Based on this validation, a change can be
approved, reverted, or improved and validated again.
Whilst a lot of applications support users to capture data during work in order to pro-
vide it in a subsequent reflection session, the second half of the reflection cycle is
often left unsupported. To also cover this part, the Activity Recommendation App
(ARA) was created in the MIRROR project [2]. It supports the discussion of im-
provement ideas in an individual or collaborative reflection session and frames the
outcome as recommendation. The app allows capturing personal experiences relating
to active recommendations and viewing other members’ experiences if a recommen-
dation targets a team. Finally, the ARA supports the evaluation of a recommenda-
tions’ usefulness when applied in practice, in order to enable its improvement or sus-
pension. By providing these features, the Activity Recommendation App aims to im-
prove the application of insights gained from reflection on work.
77
Activity recommendation app - ARTEL14
2 Overview of the Main Functionalities
The recommendation is created in an individual or a collaborative reflection session.
Major elements of this session are the identification of the concrete issue and a viable
solution for this issue. Texts, files, or data from other MIRROR applications can be
attached to be used as evidence to back the comprehensibility of a recommendation.
The events during the discussion are listed as a kind of minutes. Measurement criteria
can be selected to evaluate the usefulness of the recommendation. Before publishing
the recommendation, a target person/group is selected and invited to try the new solu-
tion.
A concrete scenario could look like this (cf. [3]): A team uses ARA to find a solution
for their common problem of overtime spent for pending projects. They agree that
frequent interruptions can be one reason for this (issue). In the scenario the teams’
solution is to implement three hours of quiet working time a day and to avoid inter-
ruptions during that period (recommended solution).
Fig. 1. A recommendation in ARA with one experience being entered
To test the recommendation in practice, personal experiences are written down to
decide about how well the recommended solution applied (see Figure 1). Users cap-
ture their experiences by noting down a comment and by rating how well the solution
worked (1 to 5 stars). In addition they can record the effort (e.g., the minutes of work-
ing time required) and the benefit (e.g., the number of completed tasks) of applying
the solution. These experiences are shared with the other members of the target group
to benefit from the application in a group.
To evaluate a recommendation, the app allows users to view all experiences with an
aggregation of the ratings, efforts and benefits captured. All this can then be used to
get an overview how well the solution works in practice to be taken as a basis for the
decision if the solution should be kept, updated or discarded.
78
Activity recommendation app - ARTEL14
In the continuation of the exemplary scenario, the team discusses the recommenda-
tion’s weak points (due to the captured experiences) during the regular team meeting
and agrees on adapting it in respect to the selected period in time. It is then re-
evaluated, re-discussed, and finally marked as solved when team agrees about a well-
functioning final solution.
3 Evaluation & Outlook
A summative evaluation of the ARA took place at our company IMC over a period of
six weeks. Ten staff members took part in a time management coaching. The ap-
proach combined the usage of a computer activity tracking tool and the ARA with a
weekly coaching session. In the weekly coaching sessions the coach and the coachee
reviewed the individual progress, adjusted the time management rules if not appropri-
ate anymore, or, when the particular goal has been achieved and the new behaviour
has been adopted, decided that no further practice regarding that goal is needed.
The Activity Recommendation App served well as a support for learning time man-
agement by providing a data basis for the coaching sessions. It was used by coach and
coachee to set time management goals and to document and monitor the progress in
learning new time management techniques. Both benefited from the better preparation
for the coaching sessions available with the notes in ARA. Furthermore, the app
helped the coachees to focus their goals. Two things were missed concerning ARA: It
lacks an interface optimized for smartphones and currently no reminder function is
available which motivates the user to capture experiences. These shortcomings can be
addressed in future development.
The coach and several coachees also suggested forming peer groups to train time
management techniques. They could then benefit from sharing experience data to
compare own progress with that of others and learn from each other’s experiences.
IMC has started a free online course for time management that includes usage of the
ARA [4]. In addition to the course, learners can book a human tele-coach for a fee.
References
1. Krogstie, Birgit, Michael Prilla, and Viktoria Pammer. “Understanding and Supporting Re-
flective Learning Processes in the Workplace: The RL@Work Model.” In Proceedings of
the Eigth European Conference on Technology Enhanced Learning (EC-℡ 2013), 2013.
2. MIRROR project for reflective learning at work, http://mirror-project.eu/
3. Video: Team usage scenario for the Activity Recommendation App,
http://vimeo.com/66798165
4. MOOC “Time Management“ (Gernan) on OpenCourseWorld, http://bit.ly/1ufnS0v
79