<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>How Persuasive are Serious Games, Social Media and mHealth Technologies for Vulnerable Young Adults?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sexual Health Case.</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Infectious Disease Control, National Institute for Public Health and the Environ-</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Psychology, Health &amp; Technology, University of Twente</institution>
          ,
          <addr-line>Enschede</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>ment</institution>
          ,
          <addr-line>Bilthoven</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <fpage>28</fpage>
      <lpage>42</lpage>
      <abstract>
        <p>Modern eHealth technologies, such as serious games, social media and mobile applications addressing health behavior support are evolving rapidly. High-risk young adults with low educational background and of foreign origin could especially benefit from personalized health technologies, designed for their special needs. Sexual health is a delicate subject and well-designed and tailored health technologies are needed to meet the needs of the target group and enhance uptake. The aim of this exploratory user study is to identify the persuasive features and design factors that contribute to the use and uptake of existing and new health technologies. Four focus groups were conducted with 37 young adults to gain insights into their needs and attitudes, with sexual health case used in the study. Qualitative data analysis was performed based on Persuasive Design model to identify stimulating, blocking and neutral persuasive features, specific for high-risk young adults, as well as generic design factors. Five generic design factors are formulated based on our findings: (1) anonymity, (2) interactivity, (3) portability (4) source and (5) comprehensibility. These findings aim at informing the design of health technologies for lifestyle and sexual health behavior change support of high-risk young adults, and could be applicable for young adults in general and other health topics.</p>
      </abstract>
      <kwd-group>
        <kwd>young adults</kwd>
        <kwd>eHealth</kwd>
        <kwd>Persuasive Systems Design model</kwd>
        <kwd>social</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Young adults, especially young adults who are poorly educated, are at higher risk for
leading an unhealthy lifestyle on different aspects that have an effect on health
behavior, including nutrition, physical activity and sexual health. Among other health
topics, there is growing importance of addressing the sexual and reproductive health
needs of adolescents (10-19 years) and young people (10-24 years) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The World
Health Organisation [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] defines sexual health as: ‘a state of physical, emotional,
mental and social well-being related to sexuality; not merely the absence of disease,
dysfunction or infirmity. Sexual health requires a positive and respectful approach to
sexuality and sexual relationships, as well as the possibility of having pleasurable and
safe sexual experiences, free of coercion, discrimination and violence.’ Based on
surveillance data of sexually transmitted infections (STI) and HIV collected by
STIclinics run by municipal health services, young adults of foreign origin are at
increased risk regarding undesired sexual health outcomes [
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3-5</xref>
        ]. The pattern of increased
vulnerability for undesired sexual health outcomes is also present among the largest
four immigrant groups in the Netherlands who originate from the following countries:
Turkey, Surinam, Morocco and The Netherlands Antilles [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        In the context of sexual health, ‘classic’ face-to-face consultations are poorly
known among vulnerable young adults [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Public health surveillance data also show
the underrepresentation of (male) young adults of foreign origin [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] at the free
sexuality consultations at the municipal health services. They could especially benefit from
personalized health technologies, designed for their special needs. Existing online
interventions mainly reach highly educated native women, even if they are not the
initially intended target group [
        <xref ref-type="bibr" rid="ref8 ref9">8-9</xref>
        ]. One of the reasons for the limited reach could be
the lack of participation of the target group in the development of the health
applications. It is well known in (public) health research that the amount of influence people
have on their own well-being contributes to actual health and well-being [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
Participation, therefore, is a powerful means to increase the impact and uptake of health
technology.
      </p>
      <p>
        Efforts within public health and epidemiology research directed towards reaching
young adults of foreign origin in the context of sexual health are limited to
informative websites and community-based approaches [
        <xref ref-type="bibr" rid="ref11 ref12">11-12</xref>
        ]. Current public health
activities include for instance the provision or distribution of condoms, free anonymous
counseling sessions, or specific campaigns (e.g., aimed at raising awareness of the
available public health services). Such interventions focus mainly on STI and HIV
prevention, lack of evidence on their effectiveness and often do not match the specific
needs of low-educated young adults or young adults of foreign origin [
        <xref ref-type="bibr" rid="ref13 ref14 ref15">13-15</xref>
        ].
      </p>
      <p>
        With the emerging new technologies, such as serious games, social media and
mHealth, new opportunities arise for persuasive and personalized health to support
behavior change [
        <xref ref-type="bibr" rid="ref16 ref17 ref18">16-18</xref>
        ]. Behavior Change Support System (BCSS) can be defined as:
“a socio-technical information system with psychological and behavioral outcomes
designed to form, alter or reinforce attitudes, behaviors or an act of complying using
coercion or deception” [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Persuasion is being used to improve adherence and thus
the effects of eHealth [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Persuasive System Design (PSD) model [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] offers
various persuasive techniques that are widely used in design and evaluation of persuasive
health technology [
        <xref ref-type="bibr" rid="ref22 ref23">22-23</xref>
        ]. Among the four categories of persuasive design features,
recent research shows that dialog support features play a significant role in relation to
adherence to web-based health interventions [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Persuasive features, from social
support category are important in BCSS [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. Specific user groups such as high-risk
young adults have special personal needs and preferences when it comes to design.
Therefore, it is essential to identify specific persuasive features and design factors that
influence their attitudes and/or behavior, when it comes to the use and uptake of
health technology for behavior change support. For instance, social support features
seem to play a more important role for young adults than for other age groups, since
young adults tend to be influences by their peers [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. Despite the fact that social
media are often treated as the golden standard for young adults, its suitability for
high-risk young adults for health support remains unclear [
        <xref ref-type="bibr" rid="ref26 ref27">26-27</xref>
        ].
      </p>
      <p>
        Previous research on the design of persuasive health technologies involving
highrisk young adults is lacking. Young adults of foreign origin are a hard to reach target
group. There is also little known about their needs for the design of health
applications [
        <xref ref-type="bibr" rid="ref26 ref7">7, 26</xref>
        ]. Interestingly, young adults between 12 and 21 are the most critical users
of online technologies, who are inpatient with slow unreliable applications [
        <xref ref-type="bibr" rid="ref17 ref28">17, 28</xref>
        ].
      </p>
      <p>
        In this study, we investigate how technologies for health behavior support of
vulnerable young adults should be designed to meet their needs. This paper presents the
results of the exploratory focus groups study on the specific user requirements and
conditions for the design and implementation of health technologies for behavior
change support of young adults. The primary focus in this study is on social media
[
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], serious games [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], and mobile applications [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] that are commonly used by
young adults [
        <xref ref-type="bibr" rid="ref26 ref32">26, 32</xref>
        ], with sexual health as a health topic. The ultimate goal of this
study is to gain insights into the special needs of this user group, persuasive features
and design factors influencing the use and uptake of applications for sexuality,
wellbeing and health behavior support of young adults.
2
2.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <sec id="sec-2-1">
        <title>Participants and procedure</title>
        <p>In total, four focus groups were conducted with 37 young adults (51, % male and
48,6% female) with low socio-economical status and from various ethnical
backgrounds with average age between 12 and 24 years (M=17.4, SD=3.1). The birth
country of the mother or father determined their ethnic background, where the country
of the mother was leading when both parents are from foreign decent. Participants’
ethnicity was related to a variety of geographical regions: Turkey, Surinam, Morocco,
The Netherlands Antilles, Iraq, and Afghanistan. Sixty percent of the participants
were from the first four regions, which represent the four biggest immigrant groups in
the Netherlands. Participants were recruited via the municipal health services and the
social workers at the local youth centers in three different cities and regions across the
Netherlands. All participants signed a consent form prior to the study. Additional
consent from parents was collected for participants younger than 16 years.
Participants received a cinema gift voucher of €15, goodies (ballpoints and condoms), and
refreshments as an incentive. Groups were composed of all male or all female
participants to ensure comfort discussing sexually related topics.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Study setting</title>
        <p>The focus groups were held at the local youth community centers as a follow-up of
the educational weekly activities organized by the social workers, and lasted between
70 to 75 minutes. Trained moderator and an assistant led the focus groups. The
moderators used a discussion guide, during the focus groups important points from the
guide were also presented to participants in a PowerPoint presentation. The assistant
took notes and answered questions during the subgroups activities. The final version
of the guide was developed based on a pilot test group and was used for all four focus
groups. Questions were posed in an open-ended manner followed by more specific
prompts.</p>
        <p>The focus groups discussions were divided into five components. First, moderator
gave a short introduction, explaining the purpose of the focus group and the role of
the participants. To promote confidentiality, participants were given a choice to use
either a first name or an imaginary nickname for the name boards to address each
other during the discussion. Participants were asked to fill in a questionnaire on
demographics such as age, gender, level of education, ethnical origin of parents and
how open the young adults feel about discussing health topics such as sexual health.
In the second component, the participants were split in two subgroups (4 - 6
participants per group) to explore two different application types: serious online game ‘Can
You Fix It?’ and mobile application ‘Dance4Life’ providing information on sexuality
and sexual health (see Fig. 1 and Fig. 2). After a free exploration, each subgroup was
asked to discuss the usefulness and suitability of the application for them, positive and
negative experiences and suggestions for improvement. In the third component, a
plenary discussion on opinions and experiences of young adults followed in
subgroups.</p>
        <p>
          Next, in the fourth component, the moderator showed and discussed an example of
a social media application: a Facebook (FB) page of the regional municipal health
services and a YouTube movie on how STI test is done. In the fifth part, examples of
possible new applications for health behavior support were discussed. These
concerned two concepts: a serious game via Facebook and a Virtual Coach [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] providing
anonymous free health consultation. Participants were asked to give their opinion on
these alternative concepts and to express their own ideas on technologies for health
behavior and lifestyle change support.
2.3
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Analysis</title>
        <p>
          Focus group sessions were audio recorded with a digital voice recorder with
participants’ permission. During the data analysis, audio files were transcribed verbatim,
analyzed, coded and categorized. An analysis of the influence of various persuasive
features on the response of young adults towards various types of health technology
was done (Braun 2006). Persuasive features were coded according to the Persuasive
System Design model [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. In order to validate the coding and avoid bias, a second
investigator coded a transcription of a randomly selected focus group session.
Discrepancies between coders were discussed and resolved between the investigators.
Overall, the coding was similar with minor differences. Coding scheme was then
adjusted accordingly to facilitate cross-case analysis. Prior to the focus groups,
experts analyzed all examples of applications to be presented to the participants, in order
to identify the present persuasive features and the missing ones, expected to be
missing by the users.
Persuasive features derived from the focus groups were first categorized into: (a)
stimulating, (b) blocking and (c) neutral features, based on the coding scheme used
for the data analysis. The identified features are described below with relevant quotes
from the focus groups’ participants, followed by the generic guidelines to inform the
design of public health technologies for behavior change support of young adults.
Stimulating features. Stimulating features are perceived as having positive influence
on motivating the user, perceived usefulness and/or adherence. Table 1 illustrates the
identified stimulating persuasive features, PSD category and quotes, namely:
trustworthiness, expertise, real-world feel, verifiability, liking, simulation and tunneling.
        </p>
        <p>“The information has to be reliable.” (Coach)
Real-world feel
with quotes.
motivating the user. Table 2 illustrates the identified blocking persuasive features
Neutral features. Neutral features are the ones perceived as having no effect on
motivating the user, perceived usefulness and/or adherence. Table 1 illustrates the
identified neutral persuasive features with quotes.</p>
        <p>Quote</p>
        <p>Quote
“People who don’t go outside often can play this
and learn how it is in the outside world.” (Game)
“The fact that I could win condoms would not
influence me” (FB page)
Expertise</p>
        <p>“I want it to be made by someone who has the
Five general design factors were formulated based on the analysis of the focus group
data and the identified persuasive features presented above, namely: (1) anonymity,
which has implications for the use of social networks, (2) interactivity, as it facilitates
engagement and ensures better uptake of interventions; (3) portability of the
technologies, as it ensures privacy and effortless use; (4) source of the information within
the application has to be visible and reliable to be perceived as trustworthy and (5)
comprehensibility, meaning more visually aided and easily worded information.</p>
        <p>These generic factors aim at informing the design of health technologies for
lifestyle and sexual health behavior support of young adults. Incorporating these factors
and persuasive features into the design of health technologies for young adults for
behavior change support should increase their usefulness and uptake by the target
group. Each factor is described below with relevant quotes from the participants.
Anonymity. The participants all agreed that anonymity is a crucial factor for health
support: ‘If you look it up on a computer your parents can see it on your screen.’
(Mobile app); ‘I would go to a friend to use the Internet. Otherwise your mom can
come inside or something...’ (Serious game).</p>
        <p>Besides the perceived risk of ‘being caught in the act’, online and mobile
applications sometimes also register visit, a feature that was not appreciated by young adults
of foreign origin. They are not inclined to look for information on sexual health via
social networks such as Facebook or Twitter, as their friends and family can see their
activity right away: ‘I think it is inappropriate that my family can see that I visit this
page.’ (FB page); ‘If you ‘like’ something, friends know right away what you are
doing!’ (FB page). Thus, this factor has important implications for the use of social
networks for sexual health promotion.</p>
        <p>Interactivity. Participants often mentioned interactivity as a missing feature or a
feature that is not fully available. For instance, after playing with a serious game
during the focus group discussion participants stated that they would have liked to
intervene more often during the game than it was actually possible. This is illustrated in
the following reaction expressing frustration: “I find it strange that I couldn’t click
that often, because I wanted to ‘Fix’ more often but that was not possible!” (Serious
game).</p>
        <p>It is not just the presence of interactivity that is important, but the level of the
interactivity seems to be crucial in order to facilitate better engagement. For instance, in
the serious game interactivity was incorporated, but could have been expanded
further. The mobile application, on the other hand, only allowed navigating through
various menu items at all times and yet participants missed an interactivity feature
allowing to contact a sexual health care professional: ‘I also want to be able to ask
questions myself, and get an answers.’ (Mobile app).</p>
        <p>Interactivity seems to have a positive effect on the perceived usefulness of the
health technology which could especially contribute to a richer and better user
experience.</p>
        <p>Portability. Portability of the platform on which the health technology is realized
plays a crucial role for young adults. Participants had a clear preference for a
mobilebased type of platform, as opposed to the web-based platform as it insures privacy and
effortless use for this specific target group: ‘You always have your mobile phone with
you. It is faster.’ Another participant mentioned: ‘If you just search for these things
(information on sexual health) on the internet, … you get everything (on your
desktop), with a mobile app it’s easier.’</p>
        <p>Young adults would rather use the search functions directly on their mobile phone,
without a link with social networks: ‘If you really need this (search function) you just
download it (on your mobile phone) and you know that it is not visible anywhere
else.’ (FB page). Participants also preferred to be able to use certain location features
of the mobile application offline: ‘I want to look up things online but also offline,
without WIFI for instance, like these things nearby (location of the free
consultation).’ (Mobile app). In the last quote, the participant refers to a location tracking
service on a mobile application that allows a user to find an office of a nearest free
sexual health consultation by typing a zip code.</p>
        <p>Source. The participants mentioned that the source of the information, independent of
the type of platform, is also important for them to be able to evaluate the quality of
the information. The source of information has to be explicitly stated, clearly visible
and trustworthy: ‘It looks attractive, but you want to know what (source) is behind it.’
(Serious game); ‘I want it to be made by someone who has experience with
it…’(Personal coach); ‘There should not be a name (of the public health care
provider), but a logo or something.’ (FB page).</p>
        <p>Participants indicated that they would trust the provided health information more
when it is clearly stated that the familiar public health organization, such as Municipal
Health Services is behind it: ‘…If you know it’s (information on a page) is from the
Municipal Health Services, then yes. Then the people will be willing to use it...’
(Facebook). And another participant said: ‘The Municipal Health Services are famous
(familiar), that is good.’ (Facebook).</p>
        <p>Comprehensibility. Comprehensibility of the health technologies is another
important factor, which was divided by two sub-themes specific for young adults with
foreign origin: visually aided information and availability of applications in different
languages. Overall, the participants appreciated the visual aesthetic of the
applications: ‘Mostly you would play (use) it more if it looks attractive.’ (General). Several
participants described the importance of visually aided information: ‘There are so
many pictures here, I like that.’ (FB page). Other participants mentioned that not only
the design with images was important, but also the colors of those images: ‘I would
play it if there is a nice image, with different colors’ (Serious game).</p>
        <p>Another sub-theme that emerged was the language used in the applications. One of
key characteristic of young adults of foreign origin is that they often speak different
languages with their families at home. The availability of the applications for lifestyle
and health behavior support in other languages (than Dutch) would benefit their use:
‘I also want to have an English version of the app.’ (Mobile app). To conclude,
persuasive health technology for lifestyle support and health behavior change have to be
more visually aided and easily worded, if possible in different languages and the
vocabulary of the low-educated young adults as a specific target group.</p>
        <p>Next, we discuss the findings and implications for the design and implementation
of persuasive health technologies and online interventions for behavior change
support.
4</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Discussion</title>
      <p>
        This study employed focus groups to get insights into persuasive features and design
factors that influence the use and adoption of various forms of modern health
technologies for lifestyle and behavior change support among vulnerable young adults,
such as low-educated young adults and young adults of foreign origin. Even though
this study primarily focused on the sexual health behavior, identified persuasive
features and design factors might also be applicable for other lifestyle and health topics
like physical activity support [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and interventions targeted towards broader user
groups, including young adults in general.
      </p>
      <p>
        Sexual health is a delicate and sensitive subject independent from ethnic
background, however we believe that having a certain ethnical background can increase
the sensitivity of this information, for instance due to stigma. This point is also
confirmed by the other recent studies, suggesting that stigma around sexual health could
affect the use of social media among young adults [
        <xref ref-type="bibr" rid="ref11 ref26">11, 26</xref>
        ]. In this study, we have not
compared young adults of foreign origin with native young adults. However, we
believe cultural beliefs, norms and customs, together with the well-known aspects from
the STI and HIV prevention, can stress the importance of the persuasive features and
design factors that emerged from the focus groups.
      </p>
      <p>
        Our findings show that even though persuasive health technologies offer unique
opportunities for young adults of foreign origin, designers have to take into account
the specific needs of this group. Our results indicate that anonymity is an important
factor, which has major implications for the use of online technology for enhancement
of sexual health. This is especially an issue for the social networking websites, such
as Facebook, as these media are meant to share information with peers. Despite the
expectations from other research on the important role of social support features for
young adults [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], Facebook and other social networks might be less suitable for
deploying applications for sexual health support among vulnerable young adults.
However, they are useful as a link to promote other reliable online platforms and BCSS
aimed at improving sexual health. In other words, young adults of foreign origin
should not be expected to join a group about sexual health or ‘like’ a Facebook page
of the municipal health services on this topic. Several recent studies focusing on
social networks use for sexual health promotion confirm this finding [
        <xref ref-type="bibr" rid="ref26 ref33">26, 33</xref>
        ]. The
banner advertisements, which often can be found on the periphery of Facebook pages,
could be useful to provide links to other applications for sexual health though.
      </p>
      <p>
        Additionally, the participants in our focus groups highly appreciated interactivity.
The presence of interactivity was experienced is less important. The level of the
interactivity, on the other hand, seems to be a crucial factor in order to facilitate better
engagement. Higher interactivity can be also associated with more challenging and
engaging user experience. Rich engaging interaction imbedded in the interfaces of
social media applications, mobile apps and serious games may contribute to a better
uptake of the intervention, as identified in another study with young adults [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ].
      </p>
      <p>
        Portability was another important factor, as it insures both privacy and effortless
use wherever participants are [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. Persuasive eHealth technology can easily
accommodate these needs [
        <xref ref-type="bibr" rid="ref17 ref18">17-18</xref>
        ]. Our groups of young adults of foreign origin prefer a
portable media as platforms. This conclusion coincides with findings of related
studies [
        <xref ref-type="bibr" rid="ref26 ref31">26, 31</xref>
        ]. Young adults search information mostly via (smart-)phones, and prefer
also online help with questions on sexuality [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. Portability, also called mobilization
of social media in recent studies [
        <xref ref-type="bibr" rid="ref26 ref34">26, 34</xref>
        ], stresses the need for accessibly of online
health services from anywhere and mobile applications are able to facilitate that need.
      </p>
      <p>
        Furthermore, independent of what kind of technology is offered, the source of
information has to be visible and to be perceived as trustworthy. Trust to the provided
source of information can be identified by the recognition and familiarity with the
logo of the health organization. Recent research also identifies trustworthiness of the
information as a crucial factor for the successful application of the modern technology
in sexual health care for young adults [
        <xref ref-type="bibr" rid="ref26 ref35">26, 35</xref>
        ].
      </p>
      <p>The design factors we mention above could apply to adults of foreign origin, as
well as young adults in general. The fifth factor, which is especially connected to
young adults of foreign origin, is the comprehensibility of the information offered by
persuasive health technologies. Specifically, health technologies for behavior change
support have to be more visually aided and easily worded, possibly in different
languages and the vocabulary of the low-educated target group. Although this seems an
obvious conclusion, many public health interventions have not been properly
evaluated in cooperation with the specific target groups, such as adults of foreign origin
before and after going ‘live’. Furthermore, it is essential to involve the target user
group in the design of persuasive health technologies for behavior change support.</p>
      <p>
        Additionally, one of the participants said that it would be good if the health
applications were designed separately for men and women, or at least tailored towards the
specific needs of both genders. Additionally, it seemed that men and women found
different design esthetically attractive. Gender specificity did not emerge as a factor,
but does give some insights into the reason why existing health interventions might
mostly reach women [
        <xref ref-type="bibr" rid="ref8 ref9">8-9</xref>
        ]. Possibly the design of the currently available interventions
is tailored more towards women and more attention should go into the needs of men,
specifically young men of foreign origin.
      </p>
      <p>
        In our study, we focused on identifying the persuasive features and design factors
for health behavior change support through persuasive technologies, to meet the
specific needs of vulnerable young adults. There is, however, another factor that can be
attributed to the success of applications for sexual health support, namely the reach of
these applications. The design maybe perfectly tailored towards young adults, but if
they do not find and use these applications the effort to improve them is moot. The
current practice is to create more demand by more supply. Moreover, there are many
online interventions available to promote sexual health in the hopes of reaching their
target groups. It remains a challenge to guide the users towards the ‘reliable’
applications. Trustworthiness of the source and one central platform that combines several
high quality health interventions are needed [
        <xref ref-type="bibr" rid="ref26 ref7">7, 26</xref>
        ].
      </p>
      <p>
        Our research on sexual health does not include sexual health in all it facets. We
have focused on sexual health as in the absence of infections and information about
infections. However, sexual health also entails sexual pleasure and the ability to enjoy
your sex life [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. The other side of the coin, sexual pleasure is something that is
becoming more and more stressed in sexuality research. This aspect of sexual health
might also be an important factor to investigate when designing health applications
for young adults. Online technologies, have already taken steps to improve sexual
health focusing on sexual pleasure [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. These technologies could be applied in the
future research towards enhancing positive sexual experiences of young adults of
foreign origin.
      </p>
      <p>Focus groups are an ideal method to investigate a delicate and sensitive subject as
sexual health. On the one hand, focus groups are usually kept small, to facilitate
participation and profound discussions. On the other hand, keeping the focus groups
small also induces some limitations. They can only yield qualitative data. Not all
adults of foreign origin that can be found in the Netherlands were part of the current
focus groups. However, the four largest immigrant groups were well represented in
our study. Furthermore, the various ethnic backgrounds were mixed in the focus
groups, possibly making it difficult to express some culturally specific opinions.</p>
      <p>The second limitation of our study is that foreign origin and low education are
confounded in our study. The young adults who participated also had low educational
background. Therefore, it is possible that the factors that emerged were contributable
to level of education instead of ethnic background. This is a potential bias, but also a
strength, as it gives more insight into the special needs of the vulnerable target group
who could potentially benefit from persuasive technologies for sexual health behavior
support most. Finally, one focus group had a different moderator but was assisted by
the same assistant for taking notes. Both moderators used the same instructions and
discussion guide and the audio recordings of all focus groups were transcribed and
analyzed by the same investigator using the same coding scheme, as well as
crosschecked by the second investigator to avoid bias.</p>
      <p>
        The current results can contribute to future developments of persuasive health
technologies, specifically aimed at enhancing healthy lifestyles and health behavior of
high-risk young adults. We suggest, for instance, a mobile application as a type of
platform, that would optimally assist anonymity and would be accessible from
anywhere [
        <xref ref-type="bibr" rid="ref31 ref37">31, 37</xref>
        ]. Personalized mobile application could provide a low-threshold service
to enable contact a health care specialist after the face-to-face consultation. Such
service, in combination with playful engaging tasks to raise awareness on own sexual
health behavior, could prevent high-risk young adults to fall into the same risky
sexual behavior pattern, and ultimately facilitate better continuity and self-management
in public sexual health. Of course there are could be other suitable options, such as
imbedding the serious gaming elements into a mobile application to raise awareness
on the lifestyle and health behavior [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ].
5
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In conclusion, several stimulating, blocking and neutral persuasive features specific
for high-risk young adults were identified in this exploratory study, as well as five
generic design factors. Namely, health technologies for young adults should be
anonymous, interactive, portable, from a reliable source, and easily comprehensible
for the user. These findings aim at informing the design of health technologies for
lifestyle and sexual health behavior change support of high-risk young adults, and
could be applicable for young adults in general. Incorporating these factors and
persuasive features into the design of health technologies for behavior change support,
for sexual health and also over health topics, suggest to increase their usefulness and
uptake by the target group. As part of the future work, we are currently designing the
new personalized health application for self-management support of high-risk young
adults, incorporating the identified persuasive features and design factors and
involving the potential users and sexual healthcare professionals in the holistic iterative
design approach.</p>
      <p>
        Involvement of the target group throughout the whole development process is
crucial, as well as iterative evaluation of the design with them to increase uptake and
ensure successful implementation and ultimately better sexual health. Moreover,
future research should also focus on the specific evaluation methods to measure the
effects of persuasive technologies on the health behavior and lifestyle of young adults.
This important topic is highlighted in detail in other studies [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], focusing on the
validation of the Perceived Persuasiveness Questionnaire (PPQ) [
        <xref ref-type="bibr" rid="ref38 ref39">38-39</xref>
        ] and the relation
to the PSD model [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ]. Further research is required to validate these finding,
preferably combining qualitative and quantitative approach. For instance, it would be
interesting to compare these results with the additional user evaluation using the
existing persuasiveness measures like PPQ.
      </p>
      <p>Acknowledgments. We would like to thank all participants of the study and social
workers of the youth centers. Special thanks are due to Irina Lehmann for assistance
in recruitment and data analysis. Focus group study was carried within a master
graduation project. This work was supported by the Dutch Ministry of Health,
Welfare and Sport (VWS) under grant 2012/2 and is carried out in collaboration with the
Dutch National Institute for Public Health and Environment (RIVM).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Chandra-Mouli</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Svanemyr</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Amin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fogstad</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sy</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Girard</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , and M.
          <source>Temmerman: Twenty Years After International Conference on Population and Development: Where Are We With Adolescent Sexual and Reproductive Health and Rights? Journal of Adolescent Health</source>
          <volume>56</volume>
          (
          <issue>1</issue>
          ):
          <fpage>S1</fpage>
          -
          <lpage>S6</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. (WHO), World Health Organization.
          <article-title>Sexual and reproductive health: Defining sexual health</article-title>
          .
          <source>Department of Reproductive Health and Research</source>
          . (
          <year>2014</year>
          ) .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Fenton</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Johnson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>A.</given-names>
            <surname>Nicoll</surname>
          </string-name>
          . Race, ethnicity, and
          <article-title>sexual health [Editorial Comment]</article-title>
          .
          <source>BMJ (Clinical research ed.)</source>
          <volume>314</volume>
          :
          <fpage>1703</fpage>
          -
          <lpage>1704</lpage>
          (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Easterbrook</surname>
            , P. J.,
            <given-names>D. R.</given-names>
          </string-name>
          <string-name>
            <surname>Chmiel Js Fau - Hoover</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          <string-name>
            <surname>Hoover Dr Fau - Saah</surname>
            ,
            <given-names>R. A.</given-names>
          </string-name>
          <string-name>
            <surname>Saah Aj Fau - Kaslow</surname>
            ,
            <given-names>L. A.</given-names>
          </string-name>
          <string-name>
            <surname>Kaslow Ra Fau - Kingsley</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Kingsley La Fau - Detels</surname>
            , and
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Detels</surname>
          </string-name>
          <article-title>: Racial and ethnic differences in human immunodeficiency virus type 1 (HIV-1) seroprevalence among homosexual and bisexual men</article-title>
          .
          <source>The Multicenter AIDS Cohort Study. Am J Epidemiol</source>
          .:
          <fpage>0002</fpage>
          -
          <lpage>9262</lpage>
          (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Soetens</surname>
            ,
            <given-names>L.C.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>F.D.H.</given-names>
            <surname>Koedijk</surname>
          </string-name>
          ,
          <string-name>
            I.V.F. van den Broek,
            <given-names>H.J.</given-names>
            <surname>Vriend</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.L.M.</given-names>
            <surname>Op de Coul</surname>
          </string-name>
          , F. van
          <string-name>
            <surname>Aar</surname>
            ,
            <given-names>A.I. van Sighem</given-names>
          </string-name>
          ,
          <string-name>
            <surname>I.</surname>
          </string-name>
          <article-title>Stirbu-Wagner, and</article-title>
          <string-name>
            <surname>B.H.B. van Benthem</surname>
          </string-name>
          :
          <article-title>Sexually transmitted infections, including HIV, in the Netherlands in 2011. Bilthoven: Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM); Foundation for HIV Monitoring (SHM); Netherlands Institute for Health Services Research</article-title>
          (NIVEL) (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>De Graaf</surname>
            , H., H. de Kruijer, J. van Acker, and
            <given-names>S.</given-names>
          </string-name>
          <article-title>Meijer: Sex under 25. Sexual health of young adults in the Netherlands in the year 2012</article-title>
          .
          <article-title>Rutgers Nisso Group and</article-title>
          STI AIDS Netherlands; Eburon: Delft. (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kulyk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>R. V.</given-names>
            <surname>Roskam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>David</surname>
          </string-name>
          , M. van
          <string-name>
            <surname>Veen</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <surname>J.E.W.C. van GemertPijnen</surname>
          </string-name>
          :
          <article-title>Reaching Out via Blended Care: Empowering High-Risk Adolescents via Tailored ePublic Sexual Health Services</article-title>
          .
          <source>Presented at: Medicine</source>
          <volume>2</volume>
          .0:
          <string-name>
            <surname>Social</surname>
            <given-names>Media</given-names>
          </string-name>
          , Mobile Apps, and Internet/Web 2.0 in Health,
          <source>Medicine and Biomedical Research, September 25-26</source>
          , London, UK (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Crutzen</surname>
            ,
            <given-names>R.M.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>J.M. de Nooijer</surname>
          </string-name>
          , and N.K. de Vries:
          <article-title>How to reach a target group with Internet-delivered interventions?</article-title>
          <source>The European Health Psychologist</source>
          <volume>10</volume>
          :
          <fpage>77</fpage>
          -
          <lpage>79</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Van</given-names>
            <surname>Gemert-Pijnen</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.E.W.C.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Peters</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.C.</given-names>
            <surname>Ossebaard</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Improving eHealth</article-title>
          . Den Haag, the netherlands: Eleven International Publishing; Boom.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Macaulay</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>L. E.</given-names>
            <surname>Commanda</surname>
          </string-name>
          , Freeman W. L.,
          <string-name>
            <given-names>N.</given-names>
            <surname>Gibson</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. L. McCabe</surname>
            ,
            <given-names>C. M.</given-names>
          </string-name>
          <string-name>
            <surname>Robbins</surname>
            , and
            <given-names>P. L.</given-names>
          </string-name>
          <string-name>
            <surname>Twohig</surname>
          </string-name>
          :
          <article-title>Participatory research maximises community and lay involvement</article-title>
          .
          <source>North American Primary Care Research Group. BMJ</source>
          <volume>319</volume>
          (
          <issue>7212</issue>
          ):
          <fpage>774</fpage>
          -
          <lpage>778</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>and J. Davis.</surname>
          </string-name>
          <article-title>The youth worker's role in young people's sexual health: A practice framework</article-title>
          .
          <source>Youth Studies Australia</source>
          <volume>28</volume>
          (
          <issue>4</issue>
          ):
          <fpage>19</fpage>
          -
          <lpage>28</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Carswell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Murray</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Stevenson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. V.</given-names>
            <surname>Bailey</surname>
          </string-name>
          :
          <article-title>What young people want from a sexual health website: design and development of Sexunzipped</article-title>
          .
          <source>J Med Internet Res</source>
          .
          <volume>14</volume>
          (
          <issue>5</issue>
          ):e217 (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Platt</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Grenfell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fletcher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sorhaindo</surname>
          </string-name>
          , E. Jolley,
          <string-name>
            <given-names>T.</given-names>
            <surname>Rhodes</surname>
          </string-name>
          , and
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Bonell: Systematic review examining differences in HIV, sexually transmitted infections and health-related harms between migrant and non-migrant female sex workers</article-title>
          .
          <source>Sex Transm Infect</source>
          .
          <volume>89</volume>
          (
          <issue>4</issue>
          ):
          <fpage>311</fpage>
          -
          <lpage>319</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Van Veen</surname>
            ,
            <given-names>M. G.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Schaalma</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.P. van Leeuwen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Prins</surname>
          </string-name>
          , O. de Zwart, M.J. van de Laar, and
          <string-name>
            <given-names>H.J.</given-names>
            <surname>Hospers</surname>
          </string-name>
          :
          <article-title>Concurrent partnerships and sexual risk taking among African and Caribbean migrant populations in the Netherlands</article-title>
          .
          <source>Int J STD AIDS</source>
          <volume>22</volume>
          (
          <issue>5</issue>
          ):
          <fpage>245</fpage>
          -
          <lpage>250</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Wolfers</surname>
          </string-name>
          , M. E., C. van den Hoek, J. Brug, and O. de Zwart:
          <article-title>Using Intervention Mapping to develop a programme to prevent sexually transmittable infections, including HIV, among heterosexual migrant men</article-title>
          .
          <source>BMC Public Health</source>
          <volume>7</volume>
          :
          <fpage>141</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Fanning</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mullen</surname>
            ,
            <given-names>S.P.</given-names>
          </string-name>
          , and E.
          <string-name>
            <surname>McAuley: Increasing Physical Activity With Mobile Devices: A Meta-Analysis</surname>
          </string-name>
          .
          <source>J. Med. Int. Res</source>
          .
          <volume>14</volume>
          (
          <issue>6</issue>
          ),
          <year>e161</year>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Kulyk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          , Op Den Akker,
          <string-name>
            <given-names>H.J.A.</given-names>
            ,
            <surname>Klaassen</surname>
          </string-name>
          , R.,
          <string-name>
            <surname>Van</surname>
            Gemert-Pijnen,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Let us Get Real! Integrated Approach for Virtual Coaching and Real-time Activity Monitoring in Lifestyle Change Support Systems</article-title>
          . In: Van
          <string-name>
            <surname>Gemert-Pijnen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hettinga</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Smedberg</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . (eds.) Sixth International Conference on eHealth,
          <source>Telemedicine, and Social Medicine (eTELEMED'14)</source>
          . IARIA, Barcelona, Spain. pp.
          <fpage>211</fpage>
          -
          <lpage>216</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Van Velsen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nijhof</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Kulyk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Health 2.0 Emerging Technologies</article-title>
          . In: van Gemert-Pijnen,
          <string-name>
            <given-names>J.E.W.C.</given-names>
            ,
            <surname>Petersen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            , and
            <surname>Ossebaard</surname>
          </string-name>
          , H. (eds.)
          <article-title>Improving eHealth</article-title>
          . Boom Publishers, den Haag, The Netherlands. pp.
          <fpage>111</fpage>
          -
          <lpage>126</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Oinas-Kukkonen H</surname>
          </string-name>
          .:
          <article-title>A Foundation for the Study of Behavior Change Support Systems</article-title>
          , Personal and Ubiquitous computing,
          <volume>17</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1223</fpage>
          -
          <lpage>1235</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Morrison</surname>
            ,
            <given-names>L.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yardley</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Powell</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Michie</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>What Design Features Are Used in Effective e-Health Interventions? A Review Using Techniques from Critical Interpretive Synthesis</article-title>
          . Telemedicine and E-Health,
          <volume>18</volume>
          (
          <issue>2</issue>
          ): pp.
          <fpage>137</fpage>
          -
          <lpage>144</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Oinas-Kukkonen</surname>
            , H. and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Harjumaa</surname>
          </string-name>
          ,
          <article-title>Persuasive systems design: Key issues, process model, and system features</article-title>
          .
          <source>Communications of the Association for Information Systems</source>
          ,
          <volume>24</volume>
          (
          <issue>1</issue>
          ): pp.
          <volume>28</volume>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Kelders</surname>
            ,
            <given-names>S. M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>R. N.</given-names>
            <surname>Kok</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. C.</given-names>
            <surname>Ossebaard</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. E. W. C.</given-names>
            <surname>Van</surname>
          </string-name>
          Gemert-Pijnen:
          <article-title>Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions</article-title>
          .
          <source>Journal of Medical Internet Research</source>
          ,
          <volume>14</volume>
          (
          <issue>6</issue>
          ):
          <fpage>17</fpage>
          -
          <lpage>40</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Kelders</surname>
          </string-name>
          , S.M.,
          <string-name>
            <surname>van</surname>
            Gemert-Pijnen,
            <given-names>J. E. W. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werkman</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nijland</surname>
            , N. and
            <given-names>E.R.</given-names>
          </string-name>
          <string-name>
            <surname>Seydel</surname>
          </string-name>
          <article-title>: Effectiveness of a Web-based Intervention Aimed at Healthy Dietary and Physical Activity Behavior: A Randomized Controlled Trial About Users and Usage</article-title>
          .
          <source>Journal of Medical Internet Research</source>
          ,
          <volume>13</volume>
          (
          <issue>2</issue>
          ) (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Uchino</surname>
            ,
            <given-names>B.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cacioppo</surname>
            ,
            <given-names>J.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiecolt-Glaser</surname>
            ,
            <given-names>J.K.</given-names>
          </string-name>
          :
          <article-title>The relationship between social support and physiological processes: A review with emphasis on underlying mechanisms and implications for health</article-title>
          .
          <source>Psychol Bull</source>
          ,
          <volume>119</volume>
          (
          <issue>3</issue>
          ):
          <fpage>488</fpage>
          -
          <lpage>531</lpage>
          . doi:
          <volume>10</volume>
          .1037/
          <fpage>0033</fpage>
          -
          <lpage>2909</lpage>
          .
          <year>119</year>
          .3.
          <issue>488</issue>
          (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Rubin</surname>
            ,
            <given-names>K.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bukowski</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          , and J. Parker:
          <article-title>Peer interactions, relationships, and groups</article-title>
          . In: Damon W,
          <string-name>
            <surname>Eisenberg</surname>
            <given-names>N</given-names>
          </string-name>
          . (eds.) Handbook of Child Psychology: Vol.
          <volume>3</volume>
          . Social, emotional, and
          <article-title>personality development</article-title>
          . 5th ed. New York: Wiley,
          <fpage>619</fpage>
          -
          <lpage>700</lpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Evers</surname>
            ,
            <given-names>C.W.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Albury</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Byron</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Crawford: Young People</surname>
          </string-name>
          , Social Media,
          <article-title>Social Network Sites and Sexual Health Communication in Australia: "This is Funny, You Should Watch It"</article-title>
          .
          <source>International Journal of Communication</source>
          <volume>7</volume>
          :
          <fpage>263</fpage>
          -
          <lpage>280</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Eysenbach</surname>
            , Gunther, John Powell, Marina Englesakis, Carlos Rizo, and
            <given-names>Anita</given-names>
          </string-name>
          <string-name>
            <surname>Stern</surname>
          </string-name>
          .
          <article-title>Health related virtual communities and electronic support groups: systematic review of the effects of online peer to peer interactions</article-title>
          .
          <source>BMJ</source>
          <volume>328</volume>
          (
          <issue>7449</issue>
          ):
          <volume>1166</volume>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Culén</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and van der Velden, M., and
          <string-name>
            <surname>Karpova</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Challenges in Designing Learning Apps for and with Vulnerable Children</article-title>
          .
          <source>In CHI</source>
          <year>2013</year>
          ,
          <article-title>Workshop: Designing for and with Vulnerable People</article-title>
          . Paris, France: ACM (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Kaplan</surname>
          </string-name>
          ,
          <string-name>
            <surname>Andreas</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>and Michael</given-names>
            <surname>Haenlein</surname>
          </string-name>
          .
          <article-title>Users of the world, unite! The challenges and opportunities of Social Media</article-title>
          .
          <source>Business Horizons</source>
          <volume>53</volume>
          (
          <issue>1</issue>
          ):
          <fpage>59</fpage>
          -
          <lpage>68</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Baranowski</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , and L. Frankel:
          <article-title>Let's get technical! Gaming and technology for weight control and health promotion in children</article-title>
          .
          <source>Childhood Obesity</source>
          <volume>8</volume>
          (
          <issue>1</issue>
          ):
          <fpage>34</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Dennison</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morrison</surname>
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Conway</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Yardley</surname>
          </string-name>
          .
          <source>Opportunities and Challenges for Smartphone Applications in Supporting Health Behavior Change: Qualitative Study J Med Internet Res</source>
          <volume>15</volume>
          (
          <issue>4</issue>
          ):e86 (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Roberts</surname>
            ,
            <given-names>D. F.</given-names>
          </string-name>
          , and
          <string-name>
            <given-names>U. G.</given-names>
            <surname>Foehr</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Trends in media use</article-title>
          .
          <source>Future Child</source>
          .
          <volume>18</volume>
          (
          <issue>1</issue>
          ):
          <fpage>11</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Albury</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Byron</surname>
          </string-name>
          , and C.W. Evers: 'It Would be Weird to Have That on Facebook'
          <article-title>: Young People's Use of Social Media and the Risk of Sharing Sexual Health Information</article-title>
          .
          <source>Reproductive Health Matters</source>
          ,
          <volume>21</volume>
          (
          <issue>41</issue>
          ) (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Van Velsen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>D.J.</given-names>
            <surname>Beaujean</surname>
          </string-name>
          , and
          <string-name>
            <surname>J.E.W.C. van Gemert-Pijnen</surname>
          </string-name>
          :
          <article-title>Why mobile health app overload drives us crazy, and how to restore the sanity</article-title>
          .
          <source>BMC Med</source>
          Inform Decis Mak.,
          <volume>13</volume>
          (
          <issue>23</issue>
          ) (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Selkie</surname>
            ,
            <given-names>E. M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Benson</surname>
          </string-name>
          , and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Moreno: Adolescents' Views Regarding Uses of Social Networking Websites and Text Messaging for Adolescent Sexual Health Education</article-title>
          .
          <source>Am J Health Educ</source>
          .
          <volume>42</volume>
          (
          <issue>4</issue>
          ):
          <fpage>205</fpage>
          -
          <lpage>2012</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Van</surname>
            <given-names>Lunsen</given-names>
          </string-name>
          ,
          <string-name>
            <surname>R.H.W.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brauer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Laan</surname>
          </string-name>
          . Sex, pleasure, and
          <article-title>dyspareunia in liberal northern Europe In The cultural context of sexual pleasure and problems, edited by C. A. Graham and</article-title>
          K. S. K. Hall: New York: Routledge Taylor &amp; Francis Group (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Kulyk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akker</surname>
            ,
            <given-names>H.J.A. op den</given-names>
          </string-name>
          , Klaassen,
          <string-name>
            <surname>R.</surname>
          </string-name>
          and
          <string-name>
            <surname>J.E.W.C. van Gemert-Pijnen</surname>
          </string-name>
          :
          <article-title>Personalized Virtual Coaching for Lifestyle Support: Principles for Design and Evaluation</article-title>
          .
          <source>International journal on advances in life sciences, 6</source>
          (
          <issue>3-4</issue>
          ),
          <fpage>300</fpage>
          -
          <lpage>309</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Lehto</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oinas-Kukkonen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Drozd</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Factors Affecting Perceived Persuasiveness of a Behavior Change Support System</article-title>
          .
          <source>In Thirty Third International Conference on Information Systems (ICIS2012)</source>
          . Orlando, Florida, USA,:
          <article-title>Association for Information Systems (</article-title>
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <surname>Fogg</surname>
            ,
            <given-names>B.J.:</given-names>
          </string-name>
          <article-title>Persuasive technology: using computers to change what we think and do</article-title>
          .
          <source>Ubiquity</source>
          , pp.
          <volume>5</volume>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>Beerlage-de Jong</surname>
          </string-name>
          , N.,
          <string-name>
            <surname>Kulyk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wentzel</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oinas-Kukkonen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <article-title>and</article-title>
          <string-name>
            <surname>J.E.W.C. van</surname>
          </string-name>
          Gemert-Pijnen:
          <article-title>'Sorting out' the PPQ: A mixed-methods approach to evaluate Perceived Persuasiveness Questionnaire constructs</article-title>
          .
          <article-title>Work-in-progress paper to be presented at:</article-title>
          <source>The 10th International Conference on Persuasive Technology (Persuasive</source>
          <year>2015</year>
          ), Chicago, Illinois, USA (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>