<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Vancouver, BC, Canada, October</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Nutrilize a Personalized Nutrition Recommender System: an enable study</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nadja Leipold∗</string-name>
          <email>nadja.leipold@in.tum.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Lurz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Markus Böhm</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mira Madenach</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nađa Terzimehić</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kurt Gedrich</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hanna Schäfer</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Georg Groh</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Helmut Krcmar</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Recommender Systems; Personalization; User Interaction; User Ex-</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Technical University of Munich</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Munich</institution>
          ,
          <addr-line>LMU</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>perience; Nutrition Behavior; enable-Cluster</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <volume>6</volume>
      <issue>2018</issue>
      <abstract>
        <p>A nutrition assistance system gives feedback on one's dietary behavior and supports behavior change through diverse persuasive elements like self-monitoring, personalization, and reflection implemented e.g. with visual cues, recommendations or tracking. While an automated recommender system for nutrition could provide great benefits compared to human nutrition advisors, it also faces a number of challenges in the area of usability like eficiency, eficacy and satisfaction. In this paper, we propose a mobile nutrition assistance system that specifically makes use of personalized persuasive features based on nutritional intake that could help users to adapt their behavior towards healthier nutrition. In a pilot study with 14 participants using the application for 3 weeks we investigate how the diferent features of the overall system are used and perceived. Based on the measurements, we examine which functions are important to the users and determine necessary improvements.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Applied computing → Health care information systems;
Health informatics;</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        In recent years, the need for personalizing dietary recommendations
became more and more apparent. Until today, dietary
recommendations are mostly aimed at the general population to decrease the
HealthRecSys’18, October 6, 2018, Vancouver, BC, Canada
© 2018 Copyright for the individual papers remains with the authors. Copying
permitted for private and academic purposes. This volume is published and copyrighted by
its editors.
overall occurrence of malnutrition. However, looking at an
individual level, people are very diferent in relation to their dietary needs.
This can be due to the phenotypic or genotypic traits of a person,
or the individual diet and lifestyle of that person [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        At the same time, mobile applications that support people in
healthier lifestyles reach increasing awareness among society and
industry as well as in research. In combination with intelligent
recommender systems and persuasive designs, they ofer a way to
face unhealthy lifestyles [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] like unhealthy diets, smoking and
lack of physical activity, that are related to an increasing number of
noncommunicable diseases (NCDs) such as cardiovascular diseases,
cancer, chronic respiratory diseases and diabetes [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
      <p>
        Smartphone applications have already been used as an
intervention tool (e.g. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]), but focus mostly on the weight loss of
participants. There are also several popular commercial weight loss
applications like MyFitnessPal, MyNetDiary and Lifesum. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
analyzed the most popular mobile applications in this context and
concludes that they generally lack personalized nutrition with
individualized feedback as well as nutrition education.
      </p>
      <p>
        In contrast to these approaches, our nutritional recommender
system Nutrilize combines personalized recipe recommendations,
visual feedback and other persuasive measures, as presented by
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], by considering the personal characteristics and the nutritional
status of 26 macro- and micronutrients.
      </p>
      <p>In this paper, we present the characteristics of the Nutrilize
system as well as a pilot study of this system. We analyze the
interaction with and perception of this system over a period of 21 days
considering data from 14 participants.
2</p>
    </sec>
    <sec id="sec-3">
      <title>BACKGROUND</title>
      <p>This section provides insights into the status of recommendations
in the food domain, in the health domain, in the nutrition science
domain and within existing applications in general.</p>
      <p>
        Even though research in the area of food recommendation for
healthier nutrition becomes more popular due to social relevance,
the number of existing systems is relatively low. [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] as well as [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]
provide state-of-the-art reviews of approaches and systems in the
area of food recommender systems. Various approaches exist to
recommend food and recipes based on diferent methods that elicit
user preferences using user ratings, scores and tags. For example,
approaches utilize recipe information and ofer recommendations
from individual scored ingredients contained within a single recipe
that got formerly rated positively [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] or negatively [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] by users.
      </p>
      <p>
        Besides user preferences in certain foods, health becomes more
important as a factor in a food recommendation system due to
the increasing problems with unhealthy eating habits and their
related diseases. Recently, eforts to incorporate health into so-called
health-aware recommender systems have been done by a number of
researchers [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] developed for example a function to derive
the balance between calories needed by the user and contained
by the recipe. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] addresses the problem of finding the balance
between users’ taste and nutritional aptitude. [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] investigated the
possibility to integrate nutritional facts into their recipe
recommendations. Nevertheless, literature on research covering the topic of
incorporating health is limited until now.
      </p>
      <p>
        There are several national and international dietary guidelines
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] that provide important standard sources for nutritional
information. However, they are based on population rather than
individual needs. Recent approaches to personalized nutrition show
promising insights into the efectiveness of personalized nutrition
recommendations. For example, [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] investigated individual aspects,
which influence the post-prandial glucose response (PPGR) of a
person to a certain food. They showed, that the PPGR for the same
meal difers greatly between individuals. Using machine-learning
techniques and creating an algorithm based on individual aspects,
such as dietary behavior, anthropometrics, blood biomarkers and
gut microbiome, they were able to accurately predict the PPGR to
certain foods. The efectiveness of personalized dietary
recommendations for multiple nutrients was also examined in a European
web-based Proof-of-Principle (PoP) study, the Food4Me study [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
The aim was to compare the efectiveness of personalized nutrition
advice (based on dietary, phenotypic and genotypic information)
with population-based advice to improve dietary behavior. In the
6-months study, personalized dietary advice proved to be more
efective than conventional dietary advice in improving nutritional
habits [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Food4Me was not solely created for overweight
participants to lose weight, but their main aim was to enhance a healthy
diet. In [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] we design a mobile system Nutrilize that ofers
personalized nutrition advice similar to Food4Me and combines it with
new approaches such as recipe recommendations. Nutrilize
supports users with recommendations based on the estimated personal
nutritional needs and combines them with principles of persuasion
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] developed MyBehavior, a mobile application that supports
users with diferent personalized feedback in terms of actionable
suggestions. These are based on algorithms from decision theory
that learn users’ physical activity and dietary behavior. They
include users’ preferences as well as behavioral change strategies to
give appropriate personalized feedback on diet and physical activity.
Besides scientific approaches, commercial food diaries and/or diet
coaches with incorporated physical activity trackers, mainly
focusing on reduction of calorie intake such as MyFitnessPal,
MyNetDiary, Lifesum, etc. ofer various forms of visual and textual feedback
(e.g. overview charts on calorie intake and expenditure, and the
macronutrients’ distribution of consumed foods). According to a
review on nutrition-related mobile applications in the UK [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], the
analyzed applications lack personalization and educative aspects.
Partially, they include individual aspects like age, gender, weight
and other phenotypes. However, the information used to generate
user feedback is primarily based on macronutrients and activity.
Intake tracking or feedback on a micronutrient level, is not considered
within the analyzed systems.
3
      </p>
    </sec>
    <sec id="sec-4">
      <title>NUTRITION RECOMMENDER SYSTEM</title>
      <p>To provide meaningful recommendations, we implemented a
knowledge-based, personalized nutrition recommender system.
This recommender system relies on four main components: An
accurate nutritional food database, a user nutrition profile, a recipe
database, and a knowledge-based utility function for each nutrient.</p>
      <p>
        We compared 3 diferent sources of food item databases: BLS,
FDDB and Fatsecret. In the end, we selected the BLS
(Bundeslebensmittelschluessel) database [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] due to its high number of accurately
represented nutrients. The BLS is used to record the user’s intake
as well as to calculate the recipes nutritional profile. During the
pilot study 26 diferent micro- and macronutrients were derived
from the BLS for both the user’s intake and the recipes profile.
      </p>
      <p>The user profile has several components. The main influence on
the recommender system is represented by the user’s intake history.
We chose a three-day-average to represent the users nutritional
profile. We decided on using an average to avoid contradicting
advices within one day (e.g. less/more calcium). At the same time,
we did not want to extend the average further than three days
to be able to react to changes in the users diet. Furthermore, the
recommender system integrates gender, age, and BMI to personalize
the recommendations.</p>
      <p>
        The recipes are obtained from KochWiki1, which is licensed
under Creative Commons Attribution - ShareAlike 3.02. We combined
the recipe database with the nutritional information for each food
item in the BLS database using an adaptation of [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Overall, 240
recipes are provided during the study.
      </p>
      <p>
        For the recommendations, each recipe is rated by comparing its
nutritional profile with the nutritional needs of the user. The user’s
needs are derived using the dietary reference intakes (DRI) from the
Institute of Medicine [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and from the D-A-CH reference values [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
The dietary reference intake [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] is divided by age and gender and
structured as shown in figure 1. For the purpose of estimating the
nutrient intake status of a person, intakes below the EAR (estimated
average requirement) are categorized as insuficient intake, intakes
above the UL (upper limit) are categorized as a likely overdose, and
intakes between EAR and RDA (recommended daily allowance) are
categorized as possibly insuficient intake, while intakes between
the RDA and UL are categorized as optimal intake. Based on these
1www.kochwiki.org
2https://creativecommons.org/licenses/by-sa/3.0/
reference functions, the user’s needs are described as a vector of
26 advice values. To derive a recipes utility (u) to improve a user’s
nutritional profile, the nutrient profile of the recipe (r) is multiplied
with the need/advice profile of the user (a), resulting in a rating
score. During this multiplication, some nutrients (pi ) are weighted
(w) higher based on certain input parameters of the participant:
rp1  wp1  ap1  ur,p1 
 ...  ◦  ...  ◦  ...  =  ...  (1)
       
rpn  wpn  apn  ur,pn 
Finally, all recipes are ranked per meal by the sum of their ratings
and shown to the user. In addition to the recipes, the users received
an explanation on which nutrient influences the ranking of this
recipe the most and which benefits this nutrient provides.
4
      </p>
    </sec>
    <sec id="sec-5">
      <title>NUTRILIZE INTERFACE DESIGN</title>
      <p>
        The developed mobile smartphone application, which is used for
this study, is based on the intervention tool presented by [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. It
consists of three main components in terms of a food diary, visual
feedback and recipe recommendations.
4.1
      </p>
    </sec>
    <sec id="sec-6">
      <title>Food Diary</title>
      <p>In order to provide personalized feedback and recommendations,
the application needs regular input of the user’s nutrition behavior.
This can be tracked via the integrated personal food diary supplied
by nutritional information from the BLS database (Figure 2, left).
We added the meal categories "Breakfast", "Lunch", "Dinner" and
"Snacks" for better structuring. The diary can be filled by clicking
the plus button at each diary section or by using the shortcut on
the home screen (Figure 2, middle). When adding food to the diary,
a search dialog is opened (Figure 2, right), where users can search
their meals in the database. After selecting a result, the user can
adjust the amount of the food item before adding it into the diary
or change the amount afterwards in the diary view. For the purpose
of a quick access of previous chosen meals and related quantitative
disclosures the user is ofered a Recent tab below the search bar.
4.2</p>
    </sec>
    <sec id="sec-7">
      <title>Visual Feedback</title>
      <p>
        Information graphics are generated for diferent visual feedback
screens. The home screen (Figure 2, middle) provides an overview
of the current nutrient status. Feedback calculations here are based
on the average of the three previous days of consumption. The
six most critical nutrients (regarding the highest aberration from
the suggested intake amount) are shown. The color coding used
in the application consists of a trafic light color scheme that
provides a high association for the users [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]: red (for warnings), yellow
(for attention) and green (for go on). In case of optimal behavior,
even the six most critical nutrients would show a green symbol.
Additionally, the arrows in the circles in the home screen
indicate recommended behavior (pointing up: increase intake; pointing
down: reduce intake). On the bottom of the home screen we added
four circular buttons for easy diary access to add new meals. When
using the sports button, the user can fill out a questionnaire to
estimate the physical activity level [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Finally, users can access their
recommendations through the white button on the home screen.
      </p>
      <p>Through clicking on a nutrient on the home screen, an
information page is shown (Figure 3, left). There, the current nutrient status
is visualized via a colored horizontal bar, showing the current value
as a blue vertical line and the areas of intake represented with the
same color coding as in the home screen. Furthermore, the intake
development over the last three days is visualized. In addition to
the visual feedback some information is given in textual form, such
as information on the nutrient, its importance for the human body
and possible adverse efects caused by over- or under-consumption.
Below the nutrient description, the main food sources for this
nutrient are listed as well as the personalized reference values for the
consumption of this nutrient.</p>
      <p>By clicking on the middle circle in the home screen, the user
can access the personal nutrition overview (Figure 3, middle). It
lists all 26 nutrients with their current status, visualized through a
horizontal bar as on the nutrient detail screen. Users can
furthermore access detailed statistics on their previous nutrition behavior
through the applications menu (Figure 3, right). This visualization
allows the user to see the progress within a week or a month.
4.3</p>
    </sec>
    <sec id="sec-8">
      <title>Recipe Recommendations</title>
      <p>The recipe recommendations ofer ranked lists of recipes (as
described in section 3) for each meal, based on their nutrient content
and the user’s nutritional history of the last three days. They are
provided in separate tabs for each of the four meal categories, as
shown in Figure 4. The trafic light color scheme is used here as well
and represents the overall "health benefit" of the recipe according to
the user’s current nutrition status. Each recommendation consists
of a recipe title, a picture and a coarse overview of the recommended
amount and relative content of macronutrients. Additionally, users
can click on the explanation button to receive insights into why
this recipe is recommended to them.</p>
      <p>All additional information on the recipe, such as a detailed list
of ingredients and the preparation instruction can be viewed when
clicking on the recipe item within the list (figure 4). The users can
view the ingredient list for one portion or with the recommended
sizes for the user (based on their caloric requirements). They can
immediately add the consumed portion of a recommended recipe
to their diary, saving the time of entering each single ingredient.</p>
    </sec>
    <sec id="sec-9">
      <title>USER STUDY</title>
      <p>This study represents an exploratory pilot study of the Nutrilize
system. We focused on study group, system interaction, system
perception and reported dietary behavior. The study protocol was
approved by the ethical committee of the Faculty of Medicine of
the Technical University of Munich in Germany (no. 477/16 S).
5.1</p>
    </sec>
    <sec id="sec-10">
      <title>Study Procedure</title>
      <p>
        Participants were recruited from the enable research participation
database 3 with approx. 120 invitations. The study consisted of
four distinct steps. First, all participants completed a screening
questionnaire that checked for medical (e.g. allergies, pregnancy,
etc.) and technical constraints (e.g. Android phone, Internet access,
etc.). Second, if participants matched study constrains and gave
their consent, they received a link to the first survey (time point
0). In this survey, we collected data on dietary habits using a food
frequency questionnaire (FFQ), on activity habits using the
Norman questionnaire [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and on their anthropometric measures. The
anthropometric measures included self-measurements of the body
height, bodyweight and waist/hip circumference. Third, one day
after the first survey all participants received the Nutrilize
application and an instruction manual. Fourth, after 3 weeks of using the
application, the participants received the final survey (time point 3)
asking for feedback on the system. They received no payment for
3http://enable-cluster.de/index.php?id=198&amp;L=1
participation. Out of 31 participants, who finished the first
screening, 20 were both suitable for participation and finished the first
survey. The final survey was concluded by 18 participants. Overall,
only 14 of the 20 participants concluded all measurements. Those
14 users are further examined in this paper.
5.2
      </p>
    </sec>
    <sec id="sec-11">
      <title>Measures</title>
      <p>
        We had three diferent types of measurements in this study. First,
we measured the nutrient intake of participants. In the beginning
and end we derived the users’ dietary intake from a food frequency
questionnaire using 150 common food items. Afterwards, we let
the participants track their nutrition within our application for 21
days. Based on their input, we were able to derive daily nutritional
information. Second, we measured the participants’ usage
behavior within the application using an open analytics and tracking
tool named Matomo 4, formerly Piwik. The tracking tool allowed
us to measure the time and number of actions within each
application session. It furthermore tracked predefined goals, such as
accepting a recommendation. Third, we measured the participants’
self-reported attitudes and perceptions. In a pre-study questionnaire
we asked them about their background, cooking habits, their health
attitude, and their technology attitude. In a post-study survey, we
assessed the overall usability using a System Usability Scale (SUS)
questionnaire [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and specific feedback for each application feature.
6
      </p>
    </sec>
    <sec id="sec-12">
      <title>STUDY RESULTS</title>
      <p>This section shows the results of our user study for the diferent
measurements. First, we look at the characteristics of the study
group. Then we analyze the system perception by the participants
and how they used it during the study. Finally, we analyze the
nutritional data retrieved from both the application’s diary and the
food frequency questionnaires. Our goal is to get an understanding
of the needs of our participants, the efects of the system and the
required changes for the system.
6.1</p>
    </sec>
    <sec id="sec-13">
      <title>Study Group</title>
      <p>average age of 45 years, the study group is significantly older than
expected. In part this leads to diferent attitudes towards technology
in general. We furthermore see a full range of BMIs. One participant
is underweight, five participants are of normal weight, four are
overweight, and three are obese. Finally, all participants have very
similar health attitudes. The majority (12 out of 14) feels unwell with
their current diet, but they believe they can keep up the changes
required of them, even if a transition would be dificult.
6.2</p>
    </sec>
    <sec id="sec-14">
      <title>System Interaction and Perception</title>
      <p>
        The first aspect of the system perception is the overall usability
of the application. The SUS [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] feedback resulted in a score of 52,
which shows that the application is not a basic prototype anymore,
but also not on an average usability level yet. Next, we tracked the
user’s interactions within the application. Most of the interactions
(on average 85%) are focused on filling in the dietary diary of the
users. Among the features the application is ofering to the users,
the patterns are less uniform. As visible in figure 5 some users
prefer the visual feedback given in retrospective (user 1,5,10), while
others focus almost entirely on the recommendations (user 2). A
few users are even putting their emphasis on the calorie overview
(user 12). During the final questionnaire, the feedback shows that
the system still needs to improve. The single nutrient visualizations
are perceived very well for all visual representations. Other features
however, such as the recommendations, were not perceived as well.
In general, feedback on the recommended recipes included missing
variety, dificulty of recipes, and missing personal adaption of the
recommendations (e.g. raw food or vegetarian). The explanations
within the recipes on the other hand were perceived as helpful
by most participants, possibly because they link back to focusing
on the single nutrients from the visualizations. Finally, the diary
function of the application was clearly (12/14) preferred over the
FFQ input method, even though it is more time consuming.
      </p>
      <p>Besides the current perception, we also inquired the wishes for
our future system. The users suggested easier entry methods for
the food diary, detailed sports tracking, greater recipe variety, more
positive feedback and better general performance and design.
6.3</p>
    </sec>
    <sec id="sec-15">
      <title>Nutrition Behavior</title>
      <p>The nutrition behavior can be analyzed on diferent levels. First,
we can look at the eating habits of the participants. Second, we can
analyze the caloric behavior during the study and third, we consider
the health measurement represented by a suficient nutrient intake
according to the reference guidelines. The eating and input tracking
habits can be viewed by looking at the diferent consumed meals.
The data shows that breakfast and dinner are very similar with an
average number of 70 tracked food items during the 21 days. Lunch
is only reaching 58 tracked items. This diference might be due to
the limited time for systematic tracking during lunch. Finally, the
snack category was used very diferently amongst the participants
ranging from 0 to 66 items.</p>
      <p>The caloric behavior during the study shows that the intake
tracked within the application is systematically lower than the one
derived from the FFQs. In figure 6 the tracked intake is shown as a
box plot for every day (blue). Additionally, the measurement with
the standardized food frequency questionnaire before and after the
study is shown. For most participants, the daily intake is about 1000
kCal lower when tracking with the application. At the same time,
the calories calculated from the FFQs stay in a similar range with a
slight tendency to less intake after the study.</p>
      <p>The healthiness of nutrition in this study is defined by the
number of adequately consumed nutrients over the past three days,
which were calculated and presented as nutrient intake per day.
The highest number of optimally ingested nutrients (22 out of 26
nutrients) is reached by one participant after 11 days of
intervention. The average number of adequately ingested nutrients is 13,
which is only half of the tracked nutrients. This might in part be
caused by the underestimation of food intake.
7</p>
    </sec>
    <sec id="sec-16">
      <title>DISCUSSION OF RESULTS</title>
      <p>One of the main challenges, that can be drawn from the results is
usability. As working with a prototype system this is not surprising.
Nevertheless, important next steps could be extracted from the
feedback, which are crucial for an improved usability and for an
application which is supposed to be used daily.</p>
      <p>The first feature that should be improved are the
recommendations. Although we included a recommendation system, which
produces highly personalized and individual recommendations,
the users are facing many constraints in real life situations that
were not modeled. These factors include the availability of certain
food (e.g. seasonal fruits), personal preferences (e.g. vegan) and
group constellations (e.g. a mother who should cook for her family).
Moreover, additional recipes seem to be necessary since the current
recommendations were often perceived as repetitive.</p>
      <p>An additional learning for the personalized recommender system
is the high dependency of some advice functions on accurate user
input. When some meals are tracked or the amount of a food item
is underestimated (which seemed to be a trend in the pilot study),
the users do not reach the recommended consumption values of
the macronutrients. This can result, for example, in suggestions to
increase the user’s intake of fat and thus providing recipe
suggestions of high fat foods. To prevent such inverse advice, we suggest
excluding total amounts of carbohydrates and fat while including
proportional advice on specific types of fat and on sugar.</p>
      <p>Besides improvements, the users also reported the missing of
some functionalities. For example, some users wished for the ability
to track their physical activity manually (instead of with a
questionnaire). This would suggest a sports diary comparable to the current
food diary with the option to integrate data from popular fitness
trackers. Furthermore, the home screen was perceived to be
discouraging. Some UI changes might easily improve this perception.
One possibility could be to show a progress on the optimization of
nutrients in the center circle on the home screen.</p>
      <p>Finally, the high amount of time spent on the intake tracking
(85%) might ofer a chance. Instead of giving only support for
retrospective or perspective actions, some visual cues might be
integrated within the action of tracking itself. Furthermore, the
subsequent implemented system addresses this issue by ofering fast
access to favorite foods for use in the longitudinal study.</p>
      <p>Overall, the system still needs some improvement, but already
43% of users stated that they would use the system frequently. Of
the 14 participants 9 used the system for more than 17 days. This
shows that the general idea and purpose of the system are relevant
to the study group. However, further adjustments might increase
the number of users willing to use the system frequently and might
consequently create an efective tool for nutrition behavior change.
8</p>
    </sec>
    <sec id="sec-17">
      <title>CONCLUSION AND FUTURE WORK</title>
      <p>Mainly, this study shows the need for improvements in several
aspects of the application, such as the recommendations, performance
and ease of intake tracking. Still, 43% of the participants would use
the application regularly and most (85%) prefer the daily dietary
tracking to a weekly food frequency questionnaire. Some major
challenges remain open, such as integrating contextual and social
information as well as the accuracy of the received input data. In
future, we will improve Nutrilize according to the given feedback
and evaluate the long term (3 months) efect of using the
application against a control group. Finally, this works provides starting
points about the integration of nutritional recommender systems
into more holistic persuasive mobile systems for daily usage.</p>
    </sec>
    <sec id="sec-18">
      <title>ACKNOWLEDGMENTS</title>
      <p>The preparation of this paper was supported by the enable
Cluster and is cataloged by the enable Steering Committee as enable
025 (http://enable-cluster.de). This work was funded by a grant
of the German Ministry for Education and Research (BMBF) FK
01EA1409A.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J.</given-names>
            <surname>Brooke</surname>
          </string-name>
          .
          <year>1986</year>
          .
          <article-title>System usability scale (SUS): a quick-and-dirty method of system evaluation user information</article-title>
          . Reading, UK: Digital Equipment Co Ltd (
          <year>1986</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>C.M.</given-names>
            <surname>Brown</surname>
          </string-name>
          .
          <year>1998</year>
          .
          <article-title>Human-computer interface design guidelines</article-title>
          .
          <source>Intellect Books.</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.C.</given-names>
            <surname>Carter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.J.</given-names>
            <surname>Burley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Nykjaer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.E.</given-names>
            <surname>Cade</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Adherence to a smartphone application for weight loss compared to website and paper diary: pilot randomized controlled trial</article-title>
          .
          <source>Journal of medical Internet research</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>C.</given-names>
            <surname>Celis-Morales</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.M.</given-names>
            <surname>Livingstone</surname>
          </string-name>
          , and
          <string-name>
            <surname>C.F.M. Marsaux</surname>
          </string-name>
          et al.
          <year>2015</year>
          .
          <article-title>Design and baseline characteristics of the Food4Me study: a web-based randomised controlled trial of personalised nutrition in seven European countries</article-title>
          .
          <source>Genes &amp; nutrition (</source>
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Celis-Morales</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.M.</given-names>
            <surname>Livingstone</surname>
          </string-name>
          , and
          <string-name>
            <surname>C.F.M. Marsaux</surname>
          </string-name>
          et al.
          <year>2016</year>
          .
          <article-title>Efect of personalized nutrition on health-related behaviour change: evidence from the Food4me European randomized controlled trial</article-title>
          .
          <source>International journal of epidemiology 46</source>
          ,
          <issue>2</issue>
          (
          <year>2016</year>
          ),
          <fpage>578</fpage>
          -
          <lpage>588</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Elsweiler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Harvey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ludwig</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Said</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Bringing the" healthy" into Food Recommenders</article-title>
          .
          <source>In DMRS.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>R.Z.</given-names>
            <surname>Franco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Fallaize</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Lovegrove</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Hwang</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Popular NutritionRelated Mobile Apps: A Feature Assessment</article-title>
          .
          <source>JMIR mHealth and uHealth</source>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Freyne</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Berkovsky</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Intelligent food planning: personalized recipe recommendation</article-title>
          .
          <source>In Proceedings of the 15th international conference on Intelligent user interfaces - IUI '10.</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>D</given-names>
            <surname>-A-CH</surname>
          </string-name>
          (
          <article-title>Deutsche Gesellschaft für Ernährung Österreichische Gesellschaft für Ernährung Schweizerische Gesellschaft für Ernährungsforschung Schweizerische Vereinigung für Ernährung)</article-title>
          .
          <year>2008</year>
          .
          <article-title>Referenzwerte für die Nährstofzufuhr</article-title>
          . Umschau Braus Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Ge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricci</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Massimo</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Health-aware Food Recommender System</article-title>
          .
          <source>In Proceedings of the 9th ACM Conference on Recommender Systems.</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>B.M.</given-names>
            <surname>Hartmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.L.</given-names>
            <surname>Vásquez-Caicedo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Götz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Erhardt</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. Brombach. 2005. Der</given-names>
            <surname>Bundeslebensmittelschlüssel</surname>
          </string-name>
          .
          <article-title>German Nutrient DataBase</article-title>
          . Karlsruhe:
          <article-title>Federal Research Centre for Nutrition and Food (BfEL) (</article-title>
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Harvey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ludwig</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Elsweiler</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>You are what you eat: Learning user tastes for rating prediction</article-title>
          . (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>M.</given-names>
            <surname>Müller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Harvey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Elsweiler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Mika</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Ingredient matching to determine the nutritional properties of internet-sourced recipes</article-title>
          .
          <source>In Pervasive Computing Technologies for Healthcare (PervasiveHealth)</source>
          ,
          <year>2012</year>
          6th International Conference on.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>A.</given-names>
            <surname>Norman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bellocco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bergström</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Wolk</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Validity and reproducibility of self-reported total physical activity-diferences by relative weight</article-title>
          .
          <source>International journal of obesity</source>
          (
          <year>2001</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <article-title>Institute of Medicine (US) Subcommittee on Interpretation and Uses of Dietary Reference Intakes; Institute of Medicine (US) Standing Committee on the Scientific Evaluation of Dietary Reference Intakes</article-title>
          .
          <year>2000</year>
          .
          <article-title>DRI Dietary Reference Intakes: Applications in Dietary Assessment</article-title>
          . Washington (DC):
          <article-title>National Academies Press (US).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>J.J.</given-names>
            <surname>Otten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.P.</given-names>
            <surname>Hellwig</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.D.</given-names>
            <surname>Meyers</surname>
          </string-name>
          et al.
          <year>2006</year>
          .
          <article-title>Dietary reference intakes: the essential guide to nutrient requirements</article-title>
          . National Academies Press.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>J.</given-names>
            <surname>Painter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-H.</given-names>
            <surname>Rah</surname>
          </string-name>
          , and L.
          <string-name>
            <surname>Yeon-Kyung</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Comparison of international food guide pictorial representations</article-title>
          .
          <source>Journal of the Academy of Nutrition and Dietetics</source>
          (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>R.</given-names>
            <surname>Poinhos</surname>
          </string-name>
          and
          <string-name>
            <surname>M.D</surname>
          </string-name>
          .V. de Almeida.
          <year>2015</year>
          .
          <article-title>Personalised nutrition: paving a way to better population health (A White Paper from the Food4Me project)</article-title>
          .
          <source>Technical Report.</source>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>M.</given-names>
            <surname>Rabbi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.H.</given-names>
            <surname>Aung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Choudhury</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones</article-title>
          .
          <source>In UbiComp.</source>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>H.</given-names>
            <surname>Schäfer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hors-Fraile</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.P.</given-names>
            <surname>Karumur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. Calero</given-names>
            <surname>Valdez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Said</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Torkamaan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Ulmer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Trattner</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Towards Health (Aware) Recommender Systems</article-title>
          .
          <source>In Proceedings of the 2017 International Conference on Digital Health - DH '17.</source>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>N.</given-names>
            <surname>Terzimehić</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Leipold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Schäfer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Madenach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Böhm</surname>
          </string-name>
          , G. Groh,
          <string-name>
            <given-names>K.</given-names>
            <surname>Gedrich</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Krcmar</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Can an Automated Personalized Nutrition Assistance System Successfully Change Nutrition Behavior? - Study Design</article-title>
          .
          <source>In Thirty Seventh International Conference on Information Systems.</source>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>T.N. Trang</given-names>
            <surname>Tran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Atas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Felfernig</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Stettinger</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>An overview of recommender systems in the healthy food domain</article-title>
          .
          <source>Journal of Intelligent Information Systems</source>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>D.</given-names>
            <surname>Trattner</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Elsweiler</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>Food Recommender Systems: Important Contributions, Challenges and Future Research Directions</article-title>
          . In Collaborative Recommendations: Algorithms, Practical Challenges and Applications, Shlomo Berkovsky, Iván Cantador, and Domonkos Tikk (Eds.).
          <source>World Scientific Publishing.</source>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24] WHO.
          <year>2014</year>
          .
          <source>Global status report on noncommunicable diseases 2014</source>
          . World Health (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>D.</given-names>
            <surname>Zeevi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Korem</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N.</given-names>
            <surname>Zmora</surname>
          </string-name>
          et al.
          <year>2015</year>
          .
          <article-title>Personalized Nutrition by Prediction of Glycemic Responses</article-title>
          .
          <source>Cell</source>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>