<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Lightweight Visual Data Analysis on Mobile Devices - Providing Self-Monitoring Feedback</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Simon Butscher</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yunlong Wang</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jens Mueller</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Katrin Ziesemer</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Karoline Villinger</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Deborah Wahl</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Laura Koenig</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gudrun Sproesser</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Britta Renner</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Harald T. Schupp</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Harald Reiterer</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Konstanz</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>28</fpage>
      <lpage>34</lpage>
      <abstract>
        <p>Self-monitoring is an important part of behavior intervention technologies. In order to increase the e ectiveness of self-monitoring, we do not only have to track data but also give feedback to the user. In the interdisciplinary project SmartAct, we aim at developing and empirically testing the e ectiveness of an open access toolbox for mobile, real-time interventions targeting healthy eating and physical activity. The SmartAct toolbox for behavior change is a set of tools for personal mobile technology which decreases the implementation barrier for mobile interventions. It consists of tools for physical activity tracking, food journaling, questionnaires, noti cations, feedback and interventions, work ow management, data storage, and client-server synchronization. The toolbox is still under development, but a rst reference implementation for a food diary application has already been tested in a pilot study. For the intervention tools an interactive visualization was designed which places special emphasis on context and imprecision aspects.</p>
      </abstract>
      <kwd-group>
        <kwd>mobile behavior intervention</kwd>
        <kwd>behaviour change</kwd>
        <kwd>toolbox</kwd>
        <kwd>interactive visualization</kwd>
        <kwd>food diary</kwd>
        <kwd>physical activity</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Self-monitoring of diet and physical activity is an important part of behavior
intervention technologies. In order to increase the e ectiveness of self-monitoring
we do not only have to track data, but also to give feedback to the users [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
In the context of behavior change technologies ongoing research focuses on food
database reliability, missing log values [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and meaningful intervention moments
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Also, novel ways of manual and automatic data collection [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and the visual
presentation of the collected information [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] are investigated. However, there is
still a lack of research on interventions in terms of feedback visualizations, and
their e ectiveness [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Most commercial applications only provide feedback in
terms of simple one-dimensional visualizations which convey that more (physical
activity) or less (food intake) is better. Whereas this can be true for low-intensity
physical activity (e.g., walking), for vigorous activities, our body needs time for
regeneration. For food intake it is even more complex, as calories alone do not
tell us much about how healthy our eating behavior is; a balanced diet seems
to be more important. Therefore, there is a need for more powerful feedback
visualizations which allow for a lightweight visual analysis of the collected data.
Based on data about the nutrients of meals, tracked activities, and additional
information like eating motives or times and locations where meals took place,
visualizations can provide a convenient way to analyze the self-monitored
behaviour on mobile devices. This allows users to better understand their behavior
and how they can change it towards a healthier lifestyle.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Project SmartAct</title>
      <p>In the interdisciplinary project SmartAct1, we aim at developing and empirically
testing the e ectiveness of a toolbox for mobile, real-time interventions targeting
healthy eating and physical activity using personal mobile technology
(smartphones, body monitoring). The SmartAct toolbox for behavior change is a set of
tools which decreases the implementation barrier for mobile interventions.
Interventions are based on what people do (behavioral pattern), why people do what
they do (psychosocial and &amp; contextual triggers of behavior), and when people
do what they do (timing of behavior and &amp; triggers). The toolbox consists of
tools to design client applications for Android devices as well as tools to store
and manage the collected data on a remote server.</p>
      <p>{ Physical activity tracking tools: The physical activity tracking tools
track the users activity level (low, moderate and vigourous). To ensure
highquality data we use a very exact mobile sensor for the acquisition of physical
activity2 which is connected to the smartphone and therefore allows for a
almost real time intervention based on the activity level.
{ Food journaling tools: The food journaling tools consist of two modules:
a picture taking module to save a visual representation of the meal and
a food item selector to classify the meal. A detailed food item database
contains additional information, like food groups (\fruits", \vegetables",
\grain", \meat", \milk", \oil &amp; sugar") and the detailed nutritional values.
{ Questionnaire tools: The questionnaire tools allows for a very exible
and quick de nition of questionnaires, e.g., collecting additional information
about users' motives or emotions. The questionnaires as well as the questions
they are build of are de ned on a server database and are automatically
transferred to the mobile applications. Di erent question types are supported
(e.g., open questions, single-choice, Likert scales, or groups of Likert scales).
{ Noti cation tools: The noti cation tools allows for sending messages to
the users at a certain time (e.g, a reminder in the morning that the users
should track their food intake) or when a timer elapsed (e.g., a user started
to track a meal but did not nish entering all necessary data within a certain
period of time).
1 https://www.uni-konstanz.de/smartact/
2 Activity Sensor Move 3 from movisens (http://www.movisens.com/)
{ Feedback and intervention tools: The feedback tools are planned to
provide rich and interactive feedback to the user. Di erent (multidimensional)
visualizations with drill down functionalities provide di erent perspectives
on the collected data. Noti cations can be send to the user in order to higher
the chance that users use the feedback functionalities.
{ Work ow tools: Work ow tools are used to tie all the previously described
tools together. With the work ow tools the sequence in which the other tools
appear can be de ned (e.g., the user rst has to answer a questionnaire, then
take a picture of the meal, then classify the meal and nally get feedback
about the healthiness of the meal). The work ow tools also allow for a de
nition of times when noti cations should be send as well as the de nition of
usage data logging.
{ Data storage tools: On the database server side, we enable secure data
storing, as well as user group management and user group dependent
bidirectional data synchronisation. This allows for group dependent feedback
(e.g., feedback about the food intake of a family).</p>
      <p>Using this toolbox we developed a food diary application which was evaluated
in a pilot study in order to test the concepts and improve the toolbox. Taking
the data collected during the pilot study as example we designed a rst draft of
an intervention in terms of an interactive visualization.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Reference Implementation: Food diary</title>
      <p>
        With the SmartAct toolbox we designed an application (See Fig. 1) to answer
two main questions: what do people eat? and why do people eat what they eat? To
track what people eat, the application contains a picture taking tool and a manual
food classi cation tool. To track why people eat what they eat, a questionnaire
about eating motives [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] has to be lled out during each meal.
      </p>
      <p>
        The application was tested in a pilot study with 35 participants who used the
application for 8 days. The aim of the pilot study was twofold. First, we evaluated
the user experience with the help of the User Experience Questionnaire [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
Second, we collected a data set with approximately 1,000 tracked meals. This
data is intended to inform the design of interventions, in terms of interactive
visualizations (e.g., it gives insights about the average number of meals a day or
the number of tracked food items per meal).
      </p>
      <p>An analysis of the user experience revealed that participants perceived the
application as being attractive (M=1.1/above average3). Furthermore the
pragmatic quality of the application was rated high (perspicuity: M=2.3/excellent ;
efciency: M=1.6/excellent ; dependability M=1.8/excellent ). Thus, the users
perceived the application as easy to learn and understand, as well as e cient and
practical to use. These aspects are very important to support long-time usage
3 Interpretation of values in comparison with benchmark provided by the User
Experience Questionnaire Data Analysis Tool (http://www.ueq-online.org/)
(a)
(b)
(c)
(d)
of the behavior intervention technology. The scores for hedonic quality
(stimulation: M=0.3/bad ; novelty: M=1.0/good ), are not as high as for the pragmatic
quality. However, this is not surprising since no feedback or intervention was
provided during the pilot study.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Intervention: Interactive Visualizations</title>
      <p>
        Based on the collected data and the users' feedback we will design interventions
on participants' food intake, targeting a balanced diet as such a \nutritious
dietary pattern is an indispensable component of a healthy lifestyle, essential
for promoting health and reducing the risk of major chronic diseases" [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. For
the design of the interventions we have to deal with two important aspects: the
context of the visualized data and the imprecision of the data.
      </p>
      <p>Context: Values are evaluated in relation to our expectations and goals. We
can distinguish between two kinds of contexts which can help to interpret the
collected data:
{ Normative context : The normative context describes general values to which
the collected values can be compared and which help to interpret the
collected values (e.g., the widespread recommendation to take 10,000 steps a
day).
{ Individual context : The individual context describes individual values which
help to set the collected values in relation to previously collected (e.g., values
collected during a baseline phase) or individually de ned goals.</p>
      <p>
        Imprecision: Imprecision in the data occurs because of two reasons:
{ Imprecision of tracked data: The sensor input and the transformation and
interpretation (e.g., steps taken or time spent in a speci c activity level)
as well as the manually entered date my be imprecise (e.g., the manually
entered amount of food).
{ Imprecision of contextual data: The context to which we compare the
values (normative or individual) is not precise. For the individual context we
have to face the problem of imprecision in the automatically collected or
manually entered data (e.g., when collecting the baseline values). For the
normative context the values to compare to are not well-de ned (e.g., how
many vegetables should we eat a day) and the consequences of deviations
from the normative context for various measures are di erent [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] (e.g., it is
more harmful to eat one more unit of the \oil &amp; sugar" food group than one
more unit of the \vegetables" food group).
      </p>
      <p>
        In the following we present a design draft of an intervention targeting a healthy
diet in terms of a balanced diet (See Fig. 2). In this example we use the normative
context for a balanced diet, as de ned by Asghari et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] Instead of using exact
values for each food group, Asghari et al. developed a guideline that de nes a
fuzzy range for the recommended intake of each food group. This avoids tasking
the users to meet very speci c goals, and allows for interventions based on rough
recommendations.
      </p>
      <p>The proposed visualization shows the types of meals (\breakfast", \lunch",
\dinner" and \snacks") on the left side. The height of the items correspond to
the percentage of calories consumed during meals of a certain type. In the center
of the visualization the six food groups (\grain", \vegetables", \fruits", \meat",
\milk", \oil &amp; sugar") are visualized. The height of the boxes roughly indicate
how the food should be spread over the six groups (e.g., that one should eat
more vegetables than milk products). The black vertical bars indicate the current
values of the tracked food intake. The goal is to reach the green area of each
food group. The color gradients represent the fuzzy range for the recommended
food intake which should be reached. For vegetables the color gradient shows
that it is totally ne to eat more vegetables (gradient is also greenish on the left
side of the box), but that one should eat at least a certain amount of vegetables
(abrupt color change to red on the left side). On the right side the individual
food items tracked by the user are listed. Each item (meal types, food groups or
individual food items) can be selected by the user which highlights the related
values in the other two dimensions. This visualization deals with the imprecision
of the normative context and allows for the simple analysis of relations between
di erent dimensions.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and Future Work</title>
      <p>In a pilot study of our reference implementation for a food diary application built
with the help of the SmartAct toolbox we received promising feedback for the
user experience of the application. In the next step, the presented intervention in
terms of a feedback visualization will be implemented and evaluated. The aim of
the evaluation is to nd out if the mobile intervention will allow users to analyse
their eating behaviour and therefore change their behaviour towards a healthier
lifestyle. Furthermore, applications for physical activity tracking and
interventions targeting physical activity will be implemented and their e ectiveness will
be evaluated. The SmartAct toolbox for behavior change aims at decreasing
the implementation barrier for mobile interventions and lowering the burden for
testing novel mobile interventions. Although mobile interventions designed with
the help of the SmartAct toolbox are planned to provide automatic feedback
to the end users, the toolbox can also be utilized for clinical interventions as
the real-time client-server synchronisation allows clinicians to provide almost
real-time expert feedback to the end users (e.g., to target dystrophy).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Consolvo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klasnja</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McDonald</surname>
            ,
            <given-names>D.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Landay</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          :
          <article-title>Designing for Healthy Lifestyles: Design Considerations for Mobile Technologies to Encourage Consumer Health and Wellness. Foundations and Trends R in Human-Computer Interaction</article-title>
          .
          <volume>6</volume>
          (
          <issue>3-4</issue>
          ), pp.
          <fpage>167</fpage>
          -
          <lpage>315</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Cordeiro</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Epstein</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thomaz</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bales</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jagannathan</surname>
            ,
            <given-names>A. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abowd</surname>
            ,
            <given-names>G. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fogarty</surname>
          </string-name>
          , J.:
          <article-title>Barriers and negative nudges: Exploring challenges in food journaling</article-title>
          .
          <source>In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems</source>
          , pp.
          <fpage>1159</fpage>
          -
          <lpage>1162</lpage>
          . ACM(
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Mohr</surname>
            ,
            <given-names>D.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schueller</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montague</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burns</surname>
            ,
            <given-names>M.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rashidi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions</article-title>
          .
          <source>Journal of Medical Internet Research</source>
          .
          <volume>16</volume>
          (
          <issue>6</issue>
          ),
          <year>e146</year>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Boushey</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harray</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kerr</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schap</surname>
            ,
            <given-names>T. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paterson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , A ague, T.,
          <string-name>
            <surname>Delp</surname>
            ,
            <given-names>E. J.:</given-names>
          </string-name>
          <article-title>How willing are adolescents to record their dietary intake? The mobile food record</article-title>
          .
          <source>JMIR mHealth and uHealth 3</source>
          (
          <issue>2</issue>
          ),
          <year>e47</year>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Caon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carrino</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prinelli</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ciociola</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adorni</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lafortuna</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mugellini</surname>
          </string-name>
          , E.:
          <article-title>Towards an Engaging Mobile Food Record for Teenagers</article-title>
          .
          <source>In New Trends in Image Analysis and Processing{ICIAP 2015 Workshops</source>
          , pp.
          <fpage>417</fpage>
          -
          <lpage>424</lpage>
          . Springer International Publishing (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Free</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galli</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Watson</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Felix</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Edwards</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haines</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>The e ectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review</article-title>
          .
          <source>PLoS Medicine</source>
          ,
          <volume>10</volume>
          (
          <issue>1</issue>
          ),
          <year>e1001362</year>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Renner</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sproesser</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Strohbach</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Schupp</surname>
          </string-name>
          , H.:
          <article-title>Why we eat what we eat: The Eating Motivation Survey (TEMS)</article-title>
          .
          <source>Appetite</source>
          ,
          <volume>59</volume>
          , pp.
          <fpage>117</fpage>
          -
          <lpage>128</lpage>
          , (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Laugwitz</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Held</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schrepp</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Construction and evaluation of a user experience questionnaire</article-title>
          . In: Holzinger,
          <string-name>
            <surname>A</surname>
          </string-name>
          . (eds.):
          <source>USAB</source>
          <year>2008</year>
          ,
          <article-title>LNCS</article-title>
          , vol.
          <volume>5298</volume>
          , pp.
          <fpage>63</fpage>
          -
          <lpage>76</lpage>
          . Springer, Heidelberg (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Asghari</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ejtahed</surname>
            ,
            <given-names>H. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sarsharzadeh</surname>
            ,
            <given-names>M. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nazeri</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mirmiran</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Designing fuzzy algorithms to develop healthy dietary pattern</article-title>
          .
          <source>International journal of endocrinology and metabolism</source>
          .
          <volume>11</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>154</fpage>
          -
          <lpage>161</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>