<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Social Comparison in Behavior Change Support Systems: Heuristic Evaluation of a System's Usability</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Markku Kekkonen</string-name>
          <email>markku.kekkonen@oulu.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Harri Oinas-Kukkonen</string-name>
          <email>harri.oinas-kukkonen@oulu.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Oulu, Faculty of Information Technology and Electrical Engineering, Oulu Advanced Research on Service and Information Systems</institution>
          ,
          <addr-line>90570 Oulu</addr-line>
          ,
          <country country="FI">Finland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>People's willingness for sharing personal data with others allows designers to consider utilizing social comparison functions into behavior change support systems. Behavior change applications, which enable social comparison, seem to be gaining popularity nowadays. Usability flaws may diminish the usage and engagement of behavior change support systems, therefore attention was paid to usability issues in this particular case. Following usability guidelines early enough in the design may save time and resources.</p>
      </abstract>
      <kwd-group>
        <kwd>Behavior change support systems</kwd>
        <kwd>Persuasive Systems Design</kwd>
        <kwd>Social comparison</kwd>
        <kwd>Usability</kwd>
        <kwd>Heuristic evaluation</kwd>
        <kwd>Recovery from work</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Systems are constantly evolving towards sharing data, even personal data, and even
though the evolution can be difficult to predict, people seem to want to share data with
groups of different people [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Mobile applications for health behavior change have
gained popularity during the past few years and for example in 2013 approximately
15% of top-ranked health behavior change applications (n=167) for physical activity
utilized social comparison as a behavior change technique [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In 2014, another study
searched for the presence/absence of behavior change techniques from top-ranked
(n=40) physical activity/dietary behavior applications and social comparison was
present in 55% of the applications [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Social comparison in fitness applications enable comparing one’s own progress and
performance with that of others, thus providing greater motivation for the user and
potentially enhancing performance [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Nevertheless, when implementing social
comparison function into a mobile application, the designers should take into account that the
usage might be dependent on the user’s personality. Personality type might affect how
the user feels about social comparison functions, from being pressured to encouraged,
or even ignoring the function altogether [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        Nevertheless, the preferences for sharing data are quite dependent on the individual
sharing [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and as there might be people that might be willing to share very personal
data about their life, there will most probably also be people that might be unwilling to
share any information that can be directly linked to them. The idea of anonymous social
comparison could be the solution for this problem, since one could for example
compare one’s performance against a group that resides in the same geographical area or
have similar health issues.
      </p>
      <p>
        In Promo@Work research project, a health behavior change support system
(HBCSS) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] was designed with the help of Persuasive Systems Design [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
methodology. Social comparison features were implemented into the HBCSS and in this study,
we intended to do a heuristic evaluation of the first social comparison feature visible
for the users: proposition of health problem domain based on group level health issues.
Therefore, the research objective for this study will be to generate a ‘lessons learned’
list of usability issues regarding the social comparison proposition interface.
2
2.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Study setting</title>
      <sec id="sec-2-1">
        <title>Background</title>
        <p>
          Goal setting plays an important part in the PSD model and design principles such as
social comparison could potentially help the user to achieve personal goals by
enhancing motivation. Enabling the sharing and comparing personal data and information in a
system for the users will potentially enhance the users’ motivation to perform the target
behavior for the goal they have set for themselves. [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
        </p>
        <p>
          The social comparison theory hypothesizes that peoples’ behavior is affected by the
behavior of other people. Social influence processes and competitive behavior can be
derived from the same socio-psychological process: self-evaluation, which is based on
comparison with other people. [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>System</title>
        <p>
          The HBCSS was developed as a native mobile application for Android-operating
system. Self-determination theory [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] was used as the theoretical background for behavior
change techniques, whereas Transtheoretical model [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] was adopted for
‘stages-ofchange’ goal setting within the application. The intended objective for the app was to
help entrepreneurs to recover from work-related strain and stress. The seven health
problem domain in the application were recovery from work, sleep, time management,
physical exercising, excessive sitting, stress and dietary habits.
        </p>
        <p>When implementing a social comparison function into the mobile application, we
had to think of a way to adapt the idea so that it would both fit the content of the
application and support the motivation of the users without arousing competition between
them. Before the users will gain access to the content matter, the application will inquire
the users about their previous health behaviors by 52 questions. The users will be
encouraged to answer the questions, but it will not be obligatory in order to proceed within
the application.</p>
        <p>After the inquiry, the mobile application will propose two different content modules
for the users, which will be based on their personal answers and the users will be able
to choose either one or skip the proposition altogether. An algorithm calculated the
propositions and the mobile app proposed either the second best (least problems within
a health domain) or the second worst (most problems within a health domain) content
modules for the user.</p>
        <p>After next login, another set of propositions will similarly be provided for the users,
but this time the propositions will be based on the answers of the whole user base, thus
on social comparison, which is informed for the user. The algorithm will calculate the
second best (least problems in health problem domain) and second worst (most
problems in health problem domain) health content domain modules from the whole user
base and propose them for the user. This paper will concentrate on the usability issues
of the aforementioned social comparison proposition.</p>
        <p>Additionally, the app also had two self-monitoring tools, which were based on social
comparison. The tool for stress statistics relied on user-perceived and inputted level of
stress, while showing the users the average level of the whole user base. The tool for
self-perceived recovery worked similarly, with the exception that a weekly reminder
was sent for the users via push notification, whereas one could give input daily in the
other tool.
2.3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Research method</title>
        <p>
          According to Nielsen [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], heuristic evaluation is used for finding usability problems
in a user interface design and consists of an examination of the interface while
comparing its compliance with heuristic usability principles. For this study, the emphasis on
the evaluation is ‘Ex Post’ [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], thus evaluating a finished product rather than one that
could be fixed in an iterative product development cycle.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Heuristic evaluation</title>
      <p>Each heuristic evaluation principle was compared to the social comparison proposition
interface of the HBCSS. The results of the evaluation analysis will be provided within
separate headlines of each principle in the current chapter, and will be discussed in the
next one.</p>
      <p>Visibility of system status. It could be said, that the users will be informed on what is
going on at the beginning, as the function will be explained for them. Nevertheless, the
social comparison proposition only appears once, while it could have been a better
solution to make another proposition later on based on the choices of the users.
Match between system and the real world. The proposition will not be presented for
the users in system-oriented terms. Therefore, the social comparison proposition for a
health problem domain should be a familiar concept for the users.</p>
      <p>User control and freedom. The users could exit the proposition with a single push of
a button within the interface. If they would choose the proposed health problem domain
by accident, they could still exit it via ‘home’ button. Unfortunately, re-doing will not
be supported by the app interface, but instead the users will have to choose the domains
themselves.</p>
      <p>Consistency and standard. The social comparison proposition could be considered
consistent with the first non-social comparison proposition. Navigation functions
similarly with both, while adhering design standards of similar interfaces.
Error prevention. Errors were inherently prevented by the design, because the social
comparison proposition would be preceded by a proposition based on the users’
personal answers on first login. Therefore, at least ideally, there should be enough answers
on a group level to calculate a proposition based on social comparison before the
proposition will be triggered.</p>
      <p>Recognition rather than recall. Unfortunately, the interface (including the social
comparison function and the app) will not support users in retrieving the proposition later
on, which was a clear flaw in the design, because the users will have to remember the
proposition, which could be easily forgotten amid the flood of information.
Flexibility and efficiency of use. The proposition interface could be said to be
efficient, as the propositions are differentiated in separate buttons, giving users quick
access to navigate forward.</p>
      <p>Aesthetic and minimalist design. The design could be said to be minimalist without
any excessive information. The information content could be absorbed with minimal
concentration, but some users might just skip the proposition without reading it, as one
could push the button of either health domain proposed or skip’ button instantly. A
suitable alternative might have been to delay the option for the buttons for a few
seconds in order to give the users extra time to decide on their stand regarding the social
comparison proposition.</p>
      <sec id="sec-3-1">
        <title>Help users recognize, diagnose, and recover from errors. Unfortunately, the inter</title>
        <p>face might express potential errors poorly, as in an error situation, the proposed health
problem domain might be shown only as zeros to the users, instead of an error message
popping out. Nevertheless, the design was planned in a way that there should be no
errors, but still an error message should have been enable just in case.
Help and documentation. Help and documentation regarding the social comparison
proposition were scarce, or non-existent. On the other hand, the information provided
on the proposition should be more or less clear for the users, therefore there would be
no need in this case to provide extra information about the function for the users.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <p>Designing functionalities into applications might at times be difficult, especially if the
user-base is wide. Iteration during development process could save designers from
many usability pitfalls. Overall, the interface design could be said to be functional and
usable, but there were two usability flaws.
The users should be allowed to re-do, in other words go back to, the social comparison
proposition. It could be assumed that when using a HBCSS with extensive content for
the first few times, it might be difficult to absorb and comprehend all the information
provided. The other flaw was that the users could not check from anywhere what the
social comparison based health problem domain proposed for them was. In case the
users will accept the proposition, and remember the problem domain themselves, they
will be able to navigate into the right domain module independently. Otherwise, the
social comparison proposition might be lost for them.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>Despite the usability flaws in the interface, it could be said that otherwise the social
comparison proposition was relatively easy to use and comprehend. Following usability
guidelines early enough in the design may save time and resources. Avoiding the
reported pitfalls described in this paper may help researchers and designers in their social
comparison feature implementations.
Acknowledgements. We wish to thank our colleagues at Promo@Work research
project, funded by the Strategic Research Council at the Academy of Finland, contract no.
303430 (Finnish Institute of Occupational Health) and contract no. 303431 (University
of Oulu, OASIS).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Morris</surname>
            ,
            <given-names>M. E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Aguilera</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Mobile, social, and wearable computing and the evolution of psychological practice</article-title>
          .
          <source>Professional Psychology: Research and Practice</source>
          ,
          <volume>43</volume>
          (
          <issue>6</issue>
          ),
          <fpage>622</fpage>
          . (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Conroy</surname>
            ,
            <given-names>D. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Maher</surname>
            ,
            <given-names>J. P.</given-names>
          </string-name>
          :
          <article-title>Behavior change techniques in top-ranked mobile apps for physical activity</article-title>
          .
          <source>American Journal of Preventive Medicine</source>
          ,
          <volume>46</volume>
          (
          <issue>6</issue>
          ),
          <fpage>649</fpage>
          -
          <lpage>652</lpage>
          . (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Direito</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dale</surname>
            ,
            <given-names>L. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shields</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dobson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whittaker</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Maddison</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health</article-title>
          ,
          <volume>14</volume>
          (
          <issue>1</issue>
          ),
          <fpage>646</fpage>
          . (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Yoganathan</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kajanan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Persuasive technology for smartphone fitness apps</article-title>
          .
          <source>PACIS proceedings</source>
          <year>2013</year>
          . (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Al</given-names>
            <surname>Ayubi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. U.</given-names>
            ,
            <surname>Parmanto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Branch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            , &amp;
            <surname>Ding</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.:</surname>
          </string-name>
          <article-title>A persuasive and social mHealth application for physical activity: A usability and feasibility study</article-title>
          .
          <source>JMIR mHealth and uHealth</source>
          ,
          <volume>2</volume>
          (
          <issue>2</issue>
          ), (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Oinas-Kukkonen</surname>
          </string-name>
          , H.:
          <article-title>A foundation for the study of behavior change support systems</article-title>
          .
          <source>Personal and Ubiquitous Computing</source>
          ,
          <volume>17</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1223</fpage>
          -
          <lpage>1235</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Oinas-Kukkonen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harjumaa</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Persuasive systems design: Key issues, process model, and system features</article-title>
          .
          <source>Communications of the Association for Information Systems</source>
          <volume>24</volume>
          (
          <issue>1</issue>
          ):
          <volume>28</volume>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Festinger</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>A theory of social comparison processes</article-title>
          .
          <source>Human Relations</source>
          ,
          <volume>7</volume>
          (
          <issue>2</issue>
          ),
          <fpage>117</fpage>
          -
          <lpage>140</lpage>
          . (
          <year>1954</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Ryan</surname>
            ,
            <given-names>R.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Deci</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          :
          <article-title>Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being</article-title>
          .
          <source>Am Psychol</source>
          <volume>55</volume>
          (
          <issue>1</issue>
          ):
          <volume>68</volume>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Prochaska</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>DiClemente</surname>
          </string-name>
          , C.C.:
          <article-title>The transtheoretical approach</article-title>
          .
          <source>Handbook of psychotherapy integration</source>
          <volume>2</volume>
          :
          <fpage>147</fpage>
          -
          <lpage>171</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Nielsen</surname>
          </string-name>
          , J.:
          <article-title>Heuristic evaluation</article-title>
          . In Nielsen, J., and
          <string-name>
            <surname>Mack</surname>
            ,
            <given-names>R.L</given-names>
          </string-name>
          . (Eds.),
          <source>Usability Inspection Methods</source>
          , John Wiley &amp; Sons, New York, NY. (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Pries-Heje</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baskerville</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Venable</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          :
          <source>Strategies for Design Science Research Evaluation. ECIS 2008 Proceedings. 87</source>
          . (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>