<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>How Can Skin Check Reminders be Personalised to Patient Conscientiousness?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Matt Dennis</string-name>
          <email>m.dennis@abdn.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kirsten A Smith</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Judith Mastho</string-name>
          <email>j.masthoff@abdn.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nava Tintarev</string-name>
          <email>n.tintarev@abdn.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computing Science, University of Aberdeen</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>dot.rural RCUK Digital Economy Hub, University of Aberdeen</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper explores the potential of personalising health reminders to melanoma patients based on their personality (high vs low conscientiousness). We describe a study where we presented participants with a scenario with a ctional patient who has not performed a skin check for recurrent melanoma. The patient was described as either very conscientious, or very unconscientious. We asked participants to rate reminders inspired by Cialdini's 6 principles of persuasion for their suitability for the patient. Participants then chose their favourite reminder and an alternative reminder to send if that one failed. We found that conscientiousness had an e ect on both the ratings of reminder types and the most preferred reminders selected by participants.</p>
      </abstract>
      <kwd-group>
        <kwd>Personalised reminders</kwd>
        <kwd>personality</kwd>
        <kwd>persuasion</kwd>
        <kwd>eHealth</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Melanoma (skin cancer) is one of the most common cancers in 15-34 year olds.
More than 1/3 of cases occur in people under 55 and, in the UK, it kills over
2,000 people every year [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The risk of malignant melanoma is between 8-15
times greater in people who have been diagnosed with a previous melanoma [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
and early detection of these recurrences is a critical goal of follow-up programmes
[
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. For this reason it has been proposed that patients treated for cutaneous
melanoma perform Total Skin Self-examinations (TSSEs) at frequent intervals
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Patients treated for cutaneous melanoma who detected their own recurrences
have up to a 63% reduction in mortality [
        <xref ref-type="bibr" rid="ref20 ref9">9, 20</xref>
        ]. However, even if patients are
taught to self-check often, it is likely that their self-checking will decrease over
time without an intervention to sustain their behaviour [
        <xref ref-type="bibr" rid="ref16 ref19">16, 19</xref>
        ]. There is
extensive evidence to suggest that mobile telephone and internet interventions can
help promote health behaviour change (e.g. [
        <xref ref-type="bibr" rid="ref13 ref30 ref34">13, 34, 30</xref>
        ]), and evidence to suggest
that apps (i.e. mobile or tablet applications) can be used to support a sustained
health self-management strategy [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ].
      </p>
      <p>With this in mind, the ASICA (Achieving Self-directed Integrated Cancer
Aftercare) Skin-Checker app was developed at the University of Aberdeen in
2013. The app is part of an intervention that aims to remove barriers between
patients treated for melanoma and specialists in dermatology by enabling remote
screening and diagnosis of skin changes. One goal was to ensure that patients
complete TSSEs regularly (at least once per month). In a six month pilot study,
patients were provided with a tablet with the skin checker app. The same
reminder was sent by a member of the team monthly to all patients. We found
that the reminders were generally e ective, but not for all 20 patients.
Accordingly, we decided to investigate how reminders could be personalised. It is likely
that personality plays a role in a patient's response to a reminder (along with
other relevant factors such as their a ective state, daily schedules, etc.), and
as personality is relatively stable in adults, it seems a relevant characteristic to
consider for the personalization of reminders.</p>
      <p>
        Personality can be measured using many methods, however, the Five-Factor
model [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] from trait theory is one of the most popular and reliably validated
constructs in use by psychologists. This model describes ve personality
dimensions: Agreeableness (I), Extraversion (II), Conscientiousness (III), Neuroticism
(IV) and Openness to Experience (V). In this paper, we focus on
Conscientiousness which describes how meticulous and hard-working an individual is, because
this might a ect their motivation to perform skin checks. We describe a study
where we asked participants to rate twelve di erent types of reminder for their
suitability, based on the conscientiousness of the patient. The results from this
study will provide an indication of how reminders could be personalised by the
ASICA skin checker app in the future.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Experts in persuasion have proposed many di erent sets of strategies (from 6 up
to over 100 persuasive strategies per set) that can be used to motivate certain
behaviours [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. In this paper we make use of Cialdini's 6 principles of persuasion
[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] (shown in Table 1), as they have been used in multiple contexts including
reminders [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Cialdini's persuasive principles [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] have been used in reminders
for clinic appointments [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ] and interaction with an activity monitor app [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ].
      </p>
      <p>
        An e ective way to persuade people to interact with a system is to
provide reminders [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Arguably, in the health domain, reminders should be even
more potent, as patients are already motivated by the possible threat to their
well-being. Health reminders have been researched for several decades. In 1991,
[
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] found that computer-generated reminders e ectively improve adherence to
preventative health services. This has been found in multiple domains - for
example, using text message reminders in HIV patients [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]; for malaria management
[
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]; attending healthcare appointments [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and using mobile noti cations to
increase well-being logging on an app [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Personalisation in reminders is however a relatively new eld. [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
identied the need for the personalisation of reminder systems, beyond adaptation
to scheduling preferences. Some research has been done on personalising
reminders, e.g. adapting to the user's location and movement when providing
medication reminders [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]; adapting a ect in hand washing reminders for
patients with Alzheimers Disease [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]; and tailoring mammography reminders to
personal risk and the patient's personal barriers to having a mammogram [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>
        There has also been research into the link between personality and the result
of reminders in the healthcare domain, e.g [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] found that conscientious people
would likely be the most successful at achieving their health objectives, and
persuasive categories with a social aspect were likely to be the most successful
for conscientious people. Patients low in conscientiousness typically have lower
adherence to treatments [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ]. Therefore, it is likely that patients who are low in
conscientiousness would require di erent types of reminders, and perhaps more
frequently, than those patients who are normally highly conscientious.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Study Design</title>
      <p>This study investigates which types of reminder are best for patients with
different levels of conscientiousness. There were two parts to the study. The rst
part asked participants to rate the reminders for their suitability for \John", a
ctional patient, who would either be described as having high or low
conscientiousness. The second part asked participants to pick the best reminder to send.
Subsequently, participants were asked how long they would wait before sending a
second reminder if the rst one failed, and then asked to pick a second reminder
to send.
3.1</p>
      <sec id="sec-3-1">
        <title>Participants</title>
        <p>
          The study was administered as an online questionnaire on Amazon's Mechanical
Turk [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ]. Mechanical Turk allows the creators of tasks (requesters ) to approve or
reject completed work before payment. As a further check, we included a Cloze
Test [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ] for English uency to ensure that workers possessed enough literacy
skills to understand the language based nature of the task. Participants had
to have an acceptance rate of 90%, be based in the United States and pass the
uency test in order to be eligible for the study. There were 68 participants (50%
female, 50% male; 24% aged 18-25, 50% aged 26-40, 35% aged 41-65, 1% over
65) with a random allocation for conscientiousness (30 low, 38 high).
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Materials</title>
        <sec id="sec-3-2-1">
          <title>John is always prepared. He gets tasks</title>
          <p>done right away, paying attention to detail.
He makes plans and sticks to them and
carries them out. He completes tasks
successfully, doing things according to a plan. He
is exacting in his work; he nishes what he
starts. John is quite a nice person, tends to
enjoy talking with people, and quite likes
exploring new ideas.</p>
          <p>low</p>
        </sec>
        <sec id="sec-3-2-2">
          <title>John procrastinates and wastes his time.</title>
          <p>He nds it di cult to get down to work.</p>
          <p>He does just enough work to get by and
often doesnt see things through, leaving
them un nished. He shirks his duties and
messes things up. He doesnt put his mind
on the task at hand and needs a push to get
started. John tends to enjoy talking with
people.</p>
          <p>
            This experiment conveys the patient's personality using short stories previously
validated for describing low or high conscientiousness [
            <xref ref-type="bibr" rid="ref10">10</xref>
            ]. Originally the stories
were adapted from the NEO-IPIP 20-item scales [
            <xref ref-type="bibr" rid="ref15">15</xref>
            ] by combining the phrases
into sentences to form a short story, with the addition of a very common male
name, John, shown in Table 2.
          </p>
          <p>
            12 persuasive reminders were developed depicting Cialdini's six persuasion
categories [
            <xref ref-type="bibr" rid="ref8">8</xref>
            ], two for each category. These were generated with a panel of experts
in eHealth in a brainstorming session, and are shown in Table 3.
3.3
          </p>
        </sec>
      </sec>
      <sec id="sec-3-3">
        <title>Experimental design</title>
        <p>The independent variables are the conscientiousness of the patient \John" (low
or high, between-subjects), and the persuasive reminder (12 reminders,
withinsubjects).</p>
        <p>
          The dependent variables are: Suitability; the most preferred (`best') reminder
to send rst; the best reminder to send second; and the length of time between
the two reminders. Suitability was based on the average rating of each reminder
of four measures: e ectiveness, helpfulness, appropriateness and sensitivity
developed by [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. These have been found to be internally consistent and to contribute
to a single factor in a Principal Component Analysis [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ].
90% of people with the Skin Checker iPad have already performed their skin
check this month. Please check your skin now.
        </p>
        <p>Thousands of people are actively checking their skin each month. Join them
please check your skin now.</p>
        <p>You have checked your skin frequently in the past. Please check your skin now.</p>
        <p>When you decided to participate, you agreed that checking your skin monthly
is a good idea. Please check your skin now.</p>
        <p>Doctors recommend that you check your skin at least once a month as health
outcomes are better if you do. Please check your skin now.</p>
        <p>According to experts, checking your skin regularly is an e ective way of
identifying recurrent skin cancer. Please check your skin now.</p>
        <p>This is your last opportunity for your monthly skin check. Do not miss out
please check your skin now.</p>
        <p>If a recurrent skin cancer gets detected quickly, health outcomes are much
better. Please check your skin now.
3.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>Procedure</title>
        <p>The study began by asking participants to complete the English uency test. If
they passed, participants were asked to select their gender and age from a range
(both elds were optional). On the next screen, the participants were shown a
short explanation of why skin checking is important, and the story about \John",
conveying high or low conscientiousness (see Figure 1). Participants were told
that John had not performed his skin check yet this month, and that the app
needed to send an automated reminder. Next, they rated each of the 12 reminders
in turn for their suitability for `John' using the 4 scales (see Figure 1).</p>
        <p>Subsequently, participants were asked to select the reminder that they felt
was best for John. The information about the importance of skin checking and
John's personality were repeated to remind the participants (shown in Figure
2). They were then asked how long they would wait before sending a second
reminder if the rst one failed to provoke John to perform his skin check (from
1-30 days, or `longer'). Finally, they were asked to pick the reminder that they
would send as the second reminder. Participants could choose to send the same
reminder again if they wished.
26/03/2015
 
Section 2
Skin checking
Meet John
Voluntary Research Questionnaire
Read the following information, then complete the tasks. Take your time ­ there are no right or wrong answers; we are interested in what you think.
It is important for people who have had skin cancer and have been successfully treated to regularly perform a skin­check, where they closely examine all of their
skin for changes. This is because recurrences can occur and if they are caught early, the chances for successful treatment are much better.
The next part of this study is about "John", who was successfully treated for skin cancer in the past.</p>
        <p>John procrastinates and wastes his time. He finds it difficult to get down to work. He does just enough work to get by and often doesn’t see things through, leaving
them unfinished. He shirks his duties and messes things up. He doesn’t put his mind on the task at hand and needs a push to get started. John tends to enjoy
talking with people.</p>
        <p>John’s Doctor has given him an iPad with an app on it which helps him to check his skin. When John has used the app to do a full skin check, a notification is sent
to his doctor automatically. John has been advised to check his skin monthly.</p>
        <p>A month has passed, and John has not checked his skin yet.</p>
        <p>Reminder number 1 of 12:
Please rate this reminder for the following qualities:
Appropriateness
Effectiveness
Helpfulness
Sensitivity</p>
        <p>Very inappropriate
Very ineffective
Very unhelpful
Very insensitive
 1
 1
 1
 1
 2
 2
 2
 2
 3
 3
 3
 3
 4
 4
 4
 4</p>
        <p>Very appropriate
 5
 5
 5
 5
Very effective
Very helpful
Very sensitive
26/03/2015
 
© 2015 AberdeenCSD
Section 3</p>
        <p>When you are ready, please preMssQ tEhe  M "nTe xAtp" pbutton to continue.</p>
        <p>Next
Voluntary Research Questionnaire</p>
        <p>Fig. 1. Screenshot of the rating part of the study
Thank you for rating all of the reminders. We will now ask you some further information about the best reminders to send.</p>
        <p>Here is a reminder of the situation:
It is important for people who have had skin cancer and have been successfully treated to regularly perform a skin­check, where they closely examine all of their
skin for changes. This is because recurrences can occur, and if caught early, the chances for successful treatment are much better.</p>
        <p>Now that you have rated all of the reminders, we would like to you to select the one that you think is best for John from the list below.</p>
        <p>We would love to receive confirmation that you have checked your skin. Please check your skin now.
90% of people with the Skin Checker iPad have already performed their skin check this month. Please check your skin now.</p>
        <p>When you decided to participate, you agreed that checking your skin monthly is a good idea. Please check your skin now.
https://homepages.abdn.ac.uk/m.dennis/pages/2015/asicapers/index.php?c=questionnaire&amp;m=section2</p>
        <p>Thousands of people are actively checking their skin each month. Join them ­ please check your skin now.</p>
        <p>This is your last opportunity for your monthly skin check. Do not miss out ­ please check your skin now.
The Skin Checker iPad was provided to you to help you check your skin. Please check your skin now.</p>
        <p>If a recurrent skin cancer gets detected quickly, health outcomes are much better. Please check your skin now.</p>
        <p>Your friends would feel better knowing that you are OK. Please check your skin now.
You have checked your skin frequently in the past. Please check your skin now.</p>
        <p>Continue</p>
        <p>Fig. 2. Screenshot of the best reminder selection part of the study
1/1
Given the exploratory nature of this study, the hypotheses are open-ended with
two-sided comparisons between levels of concientiousness.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <sec id="sec-4-1">
        <title>Analysis of Ratings</title>
        <p>5.00
H1a. Pairwise comparisons of Reminder Type revealed 3 homogeneous subsets.
Authority was the best, followed by the subset containing Scarcity, Consensus,
Likability &amp; Reciprocity. The nal subset of Reciprocity and Commitment and
Consistency. These can be seen in Table 4.</p>
        <p>To investigate the interaction e ect, pairwise comparisons (Bonferonni
corrected) were performed on Reminder Type Trait Level. There was a signi cant
e ect for Liking - this was rated signi cantly higher for the low trait level. There
were also signi cant di erences in the highest rated reminders for each trait level
(m=4.10 vs 3.74) - shown in Table 4 and Figure 4.
Fig. 4. Graph of Average Rating for each Reminder Type for High and Low
Conscientiousness
In the second part of the experiment, we asked participants to pick the best
reminder to send to John out of all twelve reminders. To analyse this, we performed
a Chi-squared test of trait level Best Reminder Type. This was signi cant at
2(5) = 13:70; p &lt; 0:05, supporting hypothesis H2. Table 5 shows the frequency
of each Reminder Type selected for each trait level. For low conscientiousness,
participants most commonly selected the AUT and LIK reminders, while for
high conscientiousness, participants selected AUT and SCA.</p>
        <p>After selecting their best reminder, participants were asked to choose a
second reminder to send if their rst reminder failed. A Chi-squared test of trait
level Second Reminder Type was not signi cant at 2(5) = 3:01; p &gt; 0:5,
meaning H3a is not supported. We explored this further by counting how many
participants chose di erent Reminder Types for their rst and second reminders
(changed reminder ). We performed a binomial test of changed reminder with
Test Proposition of 0.50. This was signi cant at p &lt; 0:01 { 56 of 68 participants
changed their reminder type, supporting H3. This shows that participants
preferred a di erent reminder type for the second reminder if the rst failed. We
did not identify a predictable pattern for the second choice, in terms of direction
or level of conscientiousness.</p>
        <p>Low Conscientiousness</p>
        <p>High Conscientiousness
Fig. 5. Frequency Histogram of Number of days to wait before issuing a second
reminder for high and low conscientiousness</p>
        <p>We also asked participants how long they would wait to send the second
reminder (1-30 days or longer). As shown in Figure 5, most participants would
wait for 1-3 days (Low trait mean = 2:30 1:56, High trait mean = 2:92 2:57),
with a maximum of 10 days in between reminders. A Mann-Whitney test showed
no di erence for conscientiousness, giving no support for H4.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In this paper, we described a study where participants were asked to rate the
suitability of di erent reminders for a ctional patient (with either high or low
conscientiousness) to check their skin. We found that the level of
conscientiousness of the described patient had a signi cant e ect on both the ratings of the
reminders, and the most preferred reminder.</p>
      <p>For low conscientiousness, reminders of the `liking' type (where the reminders
appear to come from someone they like) were the most popular, followed closely
by reminders of the `authority' type (where the reminder informs the patient of
what doctors recommend). For high conscientiousness, reminders of the
authority type were tied with reminders of the `scarcity' type (reminders that inform
the patient that they cannot leave the skin check until later) were the most
popular. We found that participants chose a reminder of a di erent type for a
second reminder, but not in a predictable way. Surprisingly, we found no e ect
of conscientiousness on the time between reminders, with most waiting 1-3 days.</p>
      <p>This leads to several interesting questions and directions for future work.
Although we found signi cant di erences, reminders of the `authority' type were
universally popular. It is possible that this would be a useful default if the
personality of the patient is not identi ed. Further, the `liking' type reminders
were only marginally more popular than `authority' for low conscientiousness,
and equally as popular as `scarcity' reminders for high conscientiousness. We
still need to establish which type would be best to send. Additionally, we have
not found a trend to establish the type of the second reminder if the rst fails.</p>
      <p>A limitation of our approach is that we only investigated what people think
the best reminder would be, and we do not know the e ects of these reminders
on real patients. If there is a di erence between the method preferred by advice
givers and which reminders are most e ective for patients, this could have a large
impact on how advice giving is adapted. We also did not investigate di erences
based on what participants perceived the application as representing (doctor,
friend, etc.). We will work with clinicians to ensure that reminders are
appropriate and safe to send to patients. After this, we can begin investigating their
e ect on patients, and incorporate them into the skin-checker app.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work was funded by the RCUK Digital Economy award to the dot.rural
Digital Economy Hub, University of Aberdeen; award reference: EP/G066051/1.
The dataset used by this paper can be acquired by emailing the rst author.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <article-title>Skin cancer key facts</article-title>
          .
          <source>Cancer Research UK Publications</source>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <article-title>Skin cancer risk factors (</article-title>
          <year>2015</year>
          ), http://www.cancerresearchuk.org/ cancer-info/cancerstats/types/skin/riskfactors/
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bentley</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tollmar</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>The power of mobile noti cations to increase wellbeing logging behavior</article-title>
          .
          <source>In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</source>
          . pp.
          <volume>1095</volume>
          {
          <fpage>1098</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Berwick</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Begg</surname>
            ,
            <given-names>C.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fine</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roush</surname>
            ,
            <given-names>G.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barnhill</surname>
            ,
            <given-names>R.L.</given-names>
          </string-name>
          :
          <article-title>Screening for cutaneous melanoma by skin self-examination</article-title>
          .
          <source>Natl Cancer Inst</source>
          .
          <volume>88</volume>
          (
          <issue>1</issue>
          ),
          <volume>17</volume>
          {
          <fpage>23</fpage>
          (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bruce</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hancock</surname>
            ,
            <given-names>L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arnett</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lynch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Treatment adherence in multiple sclerosis: association with emotional status, personality, and cognition</article-title>
          .
          <source>J. of behavioral medicine 33(3)</source>
          ,
          <volume>219</volume>
          {
          <fpage>227</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Christensen</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>T.W.</given-names>
          </string-name>
          :
          <article-title>Personality and patient adherence: correlates of the 5-factor model in renal dialysis</article-title>
          .
          <source>J. of behavioral medicine 18(3)</source>
          ,
          <volume>305</volume>
          {
          <fpage>313</fpage>
          (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Cialdini</surname>
          </string-name>
          , R.B.:
          <article-title>Harnessing the science of persuasion</article-title>
          .
          <source>Harvard Business Review</source>
          <volume>79</volume>
          (
          <issue>9</issue>
          ),
          <volume>72</volume>
          {
          <fpage>81</fpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Cialdini</surname>
          </string-name>
          , R.B.:
          <article-title>In uence: Science and practice</article-title>
          .
          <source>Pearson</source>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Dalal</surname>
            ,
            <given-names>K.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Panageas</surname>
            ,
            <given-names>K.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brady</surname>
            ,
            <given-names>M.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jaques</surname>
            ,
            <given-names>D.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coit</surname>
            ,
            <given-names>D.G.</given-names>
          </string-name>
          :
          <article-title>Methods of detection of rst recurrence in patients with stage i/ii primary cutaneous melanoma after sentinel lymph node biopsy</article-title>
          .
          <source>Ann Surg Oncol</source>
          <volume>15</volume>
          (
          <issue>8</issue>
          ),
          <volume>2206</volume>
          {
          <fpage>2214</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Dennis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mastho</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mellish</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The quest for validated personality trait stories</article-title>
          .
          <source>In: Proceedings of IUI 2012</source>
          . pp.
          <volume>273</volume>
          {
          <fpage>276</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          , New York, USA (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Dowshen</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuhns</surname>
            ,
            <given-names>L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holoyda</surname>
            ,
            <given-names>B.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garofalo</surname>
          </string-name>
          , R.:
          <article-title>Improving adherence to antiretroviral therapy for youth living with hiv/aids: a pilot study using personalized, interactive, daily text message reminders</article-title>
          .
          <source>J. of Medical Internet Research</source>
          <volume>14</volume>
          (
          <issue>2</issue>
          ) (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Elslander</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tanaka</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>A noti cation-centric mobile interaction survey and framework</article-title>
          .
          <source>In: Social Informatics</source>
          , pp.
          <volume>443</volume>
          {
          <fpage>456</fpage>
          . Springer (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Fjeldsoe</surname>
            ,
            <given-names>B.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marshall</surname>
            ,
            <given-names>A.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>Y.D.</given-names>
          </string-name>
          :
          <article-title>Behavior change interventions delivered by mobile telephone short-message service</article-title>
          .
          <source>American J. of preventive medicine 36(2)</source>
          ,
          <volume>165</volume>
          {
          <fpage>173</fpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Goldberg</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The structure of phenotypic personality traits</article-title>
          .
          <source>American Psychologist</source>
          <volume>48</volume>
          ,
          <issue>26</issue>
          {
          <fpage>34</fpage>
          (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Goldberg</surname>
            ,
            <given-names>L.R.</given-names>
          </string-name>
          , Johnson,
          <string-name>
            <given-names>J.A.</given-names>
            ,
            <surname>Eber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.W.</given-names>
            ,
            <surname>Hogan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Ashton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.C.</given-names>
            ,
            <surname>Cloninger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.R.</given-names>
            ,
            <surname>Gough</surname>
          </string-name>
          ,
          <string-name>
            <surname>H.C.</surname>
          </string-name>
          :
          <article-title>The international personality item pool and the future of public-domain personality measures</article-title>
          .
          <source>J. of Reseach in Personality 40</source>
          ,
          <issue>84</issue>
          {
          <fpage>96</fpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Grady</surname>
            ,
            <given-names>K.E.</given-names>
          </string-name>
          :
          <article-title>Cue enhancement and the long-term practice of breast selfexamination</article-title>
          .
          <source>Behav Med</source>
          <volume>7</volume>
          (
          <issue>2</issue>
          ),
          <volume>191</volume>
          {
          <fpage>204</fpage>
          (
          <year>1984</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Gurol-Urganci</surname>
            , I., de Jongh,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vodopivec-Jamsek</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Atun</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Car</surname>
          </string-name>
          , J.:
          <article-title>Mobile phone messaging reminders for attendance at healthcare appointments</article-title>
          .
          <source>The Cochrane Library</source>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Halko</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kientz</surname>
          </string-name>
          , J.:
          <article-title>Personality and persuasive technology: An exploratory study on health-promoting mobile applications</article-title>
          .
          <source>In: Persuasive Technology, LNCS</source>
          , vol.
          <volume>6137</volume>
          , pp.
          <volume>150</volume>
          {
          <fpage>161</fpage>
          . Springer Berlin Heidelberg (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Murchie</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Can we use technology to encourage self-monitoring by people treated for melanoma? a qualitative exploration of the perceptions of potential recipients</article-title>
          .
          <source>Supportive Care in Cancer</source>
          <volume>22</volume>
          (
          <issue>6</issue>
          ),
          <volume>1663</volume>
          {
          <fpage>1671</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Hull</surname>
            ,
            <given-names>P.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piemontesi</surname>
            ,
            <given-names>N.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lichtenwald</surname>
          </string-name>
          , J.:
          <article-title>Compliance with self-examination surveillance in patients with melanoma and atypical moles: an anonymous questionnaire study</article-title>
          .
          <source>Cutaneous Medicine and Surgery</source>
          <volume>15</volume>
          (
          <issue>2</issue>
          ),
          <volume>97</volume>
          {
          <fpage>102</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Jones</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bureleson</surname>
            ,
            <given-names>B.R.:</given-names>
          </string-name>
          <article-title>The impact of situational variables on helpers' perceptions of comforting messages: An attributional analysis</article-title>
          .
          <source>Communication Research</source>
          <volume>24</volume>
          (
          <issue>5</issue>
          ),
          <volume>530</volume>
          {
          <fpage>555</fpage>
          (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Kaptein</surname>
          </string-name>
          , M.,
          <string-name>
            <surname>van Halteren</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Adaptive persuasive messaging to increase service retention: using persuasion pro les to increase the e ectiveness of email reminders</article-title>
          .
          <source>Personal and Ubiquitous Computing</source>
          <volume>17</volume>
          (
          <issue>6</issue>
          ),
          <volume>1173</volume>
          {
          <fpage>1185</fpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Kaushik</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Intille</surname>
            ,
            <given-names>S.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Larson</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Observations from a case study on user adaptive reminders for medication adherence</article-title>
          .
          <source>In: Pervasive Computing Technologies for Healthcare</source>
          ,
          <year>2008</year>
          . pp.
          <volume>250</volume>
          {
          <fpage>253</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Czarnuch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malhotra</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , Schroder, T.,
          <string-name>
            <surname>Hoey</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>A ectively aligned cognitive assistance using bayesian a ect control theory</article-title>
          .
          <source>In: Ambient Assisted Living and Daily Activities</source>
          , pp.
          <volume>279</volume>
          {
          <fpage>287</fpage>
          . Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>McCaul</surname>
            ,
            <given-names>K.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wold</surname>
            ,
            <given-names>K.S.:</given-names>
          </string-name>
          <article-title>The e ects of mailed reminders and tailored messages on mammography screening</article-title>
          .
          <source>Journal of community health 27(3)</source>
          ,
          <volume>181</volume>
          {
          <fpage>190</fpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>McGee-Lennon</surname>
            ,
            <given-names>M.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolters</surname>
            ,
            <given-names>M.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brewster</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>User-centred multimodal reminders for assistive living</article-title>
          .
          <source>In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</source>
          . pp.
          <volume>2105</volume>
          {
          <fpage>2114</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27. MT:
          <article-title>Amazon mechanical turk</article-title>
          . http://www.mturk.com (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Murchie</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nicolson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hannaford</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Raja</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Campbell</surname>
          </string-name>
          , N.:
          <article-title>Patient satisfaction with gp-led melanoma follow-up: a randomised controlled trial</article-title>
          .
          <source>Brit J Cancer</source>
          <volume>102</volume>
          (
          <issue>10</issue>
          ),
          <volume>1447</volume>
          {
          <fpage>1455</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Ornstein</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garr</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jenkins</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rust</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arnon</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Computer-generated physician and patient reminders. tools to improve population adherence to selected preventive services</article-title>
          .
          <source>The Journal of family practice 32(1)</source>
          ,
          <volume>82</volume>
          {
          <fpage>90</fpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Felix</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galli</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Edwards</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>The e ectiveness of mhealth technologies for improving health and health services: a systematic review protocol</article-title>
          .
          <source>BMC research notes 3(1)</source>
          ,
          <volume>250</volume>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>K.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mastho</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tintarev</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moncur</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>The development and evaluation of an emotional support algorithm for carers</article-title>
          .
          <source>Intelligenza Arti ciale 8(2)</source>
          ,
          <volume>181</volume>
          {
          <fpage>196</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , W.L.:
          <article-title>Cloze procedure: A new tool for measuring readability</article-title>
          .
          <source>Journalism Quarterly</source>
          <volume>30</volume>
          ,
          <issue>415433</issue>
          (
          <year>1953</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Walji</surname>
            ,
            <given-names>M.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , J.:
          <article-title>Human-centered design of persuasive appointment reminders</article-title>
          .
          <source>In: Hawaii International Conference on System Sciences, Proceedings of the 41st Annual</source>
          . pp.
          <volume>236</volume>
          {
          <fpage>236</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Webb</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Joseph</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yardley</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Michie</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on e cacy</article-title>
          .
          <source>Medical Internet Research</source>
          <volume>12</volume>
          (
          <issue>1</issue>
          ),
          <year>e4</year>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Price</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hardinge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tarassenko</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Farmer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Using a mobile health application to support self-management in copd: a qualitative study</article-title>
          .
          <source>Brit J Gen Pract</source>
          <volume>64</volume>
          (
          <issue>624</issue>
          ),
          <year>e392</year>
          {
          <fpage>e400</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Zurovac</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sudoi</surname>
            ,
            <given-names>R.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akhwale</surname>
            ,
            <given-names>W.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ndiritu</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hamer</surname>
            ,
            <given-names>D.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rowe</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Snow</surname>
            ,
            <given-names>R.W.:</given-names>
          </string-name>
          <article-title>The e ect of mobile phone text-message reminders on kenyan health workers' adherence to malaria treatment guidelines: a cluster randomised trial</article-title>
          .
          <source>The Lancet</source>
          <volume>378</volume>
          (
          <issue>9793</issue>
          ),
          <volume>795</volume>
          {
          <fpage>803</fpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>