<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Contact Tracing Apps: A Comparative Analysis of Canada's COVID Alert and India's Aarogya Setu based on Persuasive System Design Model⋆</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kiemute Oyibo[</string-name>
          <email>kiemute.oyibo@uwaterloo.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sam Serdah</string-name>
          <email>omserdah@uwaterloo.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kunal Karkhanis</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Plinio P</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>grini Morit</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Waterloo</institution>
          ,
          <addr-line>Waterloo N2L 3G1</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Few months into the pandemic, contact tracing apps (CTAs) were launched by national and provincial governments worldwide to help in curbing the spread of COVID-19. However, their adoption has been slow and low. This calls for their evaluation using established design frameworks with a view to finding ways to improve their design, make them more efective and increase uptake. Given the endemic potential of COVID-19, CTAs may continue to be relevant in our lives. In this paper, we compared the CTA of a high-income, developed, less populous country (Canada - COVID Alert) with that of a middle-income, developing, populous country (India - Aarogya Setu) to uncover design lessons that designers and sponsors of both apps can learn from each other to improve future iterations. We used the Persuasive System Design (PSD) Model (a design, implementation, and evaluation framework) to assess the similarities and diferences of both apps. We found that the Indian app supports more persuasive features from the PSD model than the Canadian app. For example, while the Indian app supports persuasive strategies such as Personalization, Reminder, Social Role, Normative Influence and Social Location Monitoring, the Canadian does not. We discuss the findings and made recommendations for future CTA design.</p>
      </abstract>
      <kwd-group>
        <kwd>COVID-19</kwd>
        <kwd>contact tracing app</kwd>
        <kwd>exposure notification app</kwd>
        <kwd>COVID Alert</kwd>
        <kwd>Aarogya Setu</kwd>
        <kwd>persuasive design</kwd>
        <kwd>persuasive strategies</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        In the first quarter of 2020, the world woke up to a pandemic, which has been
raging for over two years, with no end in sight. The recent emergence of omicron
(one of the latest variants of COVID-19) has increased worries in the wider
population, especially among the middle-aged and older Canadian populations, which
have been hardly hit by the pandemic in terms of death toll [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Regardless of
an individual vaccination status, pessimism and uncertainty continue to grow in
Canada and globally. For example, 47% of Canadians are uncertain about the
future, with 28% thinking the worst is yet to come compared with 26% who think
the worst is behind them [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. So far, as of January 21, 2022, 345,737,867 cases
and 5,583,860 deaths had been reported [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. The onset of the pandemic resulted
in the launching of contact tracing apps by many national and provincial
governments around the world to curb the spread of the virus. However, the uptake of
these apps has not been very encouraging [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Factors associated with low
adoption rates include trust [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ][
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], privacy concern [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ][
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], utility, minimalist design
among others [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Despite the low uptake, most empirical studies, according to
a recent systematic review published in mid-2021, have reported favorable efects
of CTAs on reproduction rate, total number of infections, and mortality rate [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
This suggests that CTAs will continue to be useful as long as COVID-19 stays
with us. Consequently, there is a need for researchers and developers to continue
to find ways to make them more efective in slowing the spread of COVID-19
from person to person. In the current study, we compare the design of two
different national CTAs published on the Apple and Google app stores with a view
to eliciting helpful design lessons which stakeholders of both apps can learn from
each other and leverage in future iterations. The apps include Canada’s COVID
Alert and India’s Aarogya Setu. Apart from the characteristic diference between
both countries (e.g., socially, culturally, economically, and demographically) one
main reason for choosing their respective apps is that they are markedly
diferent in their design, features, and user experience. For example, while COVID
Alert is minimalist in its design (and thus provides limited features), Aarogya
Setu is robust (ofers multiple features including vaccine registration) [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. We
used the Persuasive System Design (PSD) Model to assess the similarities and
diferences of both apps [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ]. The PSD model is a commonly and widely used
design, implementation, and evaluation framework [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. It has been successfully
employed to design, and evaluate persuasive systems such as BEN’FIT (a fitness
app) [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] and Netflix (a video streaming service) [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], respectively.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>We provide an overview of the Covid Alert and Aarogya Setu apps, and the PSD
model employed in carrying out the comparative analysis.
2.1</p>
      <p>Overview of COVID Alert and Aarogya Setu</p>
      <sec id="sec-2-1">
        <title>Metric</title>
      </sec>
      <sec id="sec-2-2">
        <title>Apple</title>
      </sec>
      <sec id="sec-2-3">
        <title>Google</title>
      </sec>
      <sec id="sec-2-4">
        <title>Overall</title>
        <p>Canada India</p>
        <p>Canada</p>
        <p>India</p>
        <p>Canada</p>
        <p>
          India
1,000,000+ 100,000,000+ 6,849,624 214,000,000
# installs
Install rate*
# ratings/
reviews
Star rating
Privacy
design
Cost** [
          <xref ref-type="bibr" rid="ref36">36</xref>
          ]
        </p>
        <p>N/A
N/A
4,992
4.30
Decent</p>
        <p>N/A
N/A
4.10
Decent
&amp; Cent
295,200 9,029
3.10%+
3.20</p>
        <p>Decent
C$ 10M</p>
        <p>C$ 0</p>
        <p>
          C$ 10M
16.66%+
1,638,940
3.20
Decent
Cent
C$ 0
&amp;
21.21%
14,021
3.75
Decent
C$ 20M
35.66%
1,934,140
3.65
Decent
Cent
C$ 0
&amp;
Labrador [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. The app uses the Google/Apple Exposure Notification (GAEN)
application programming interfaces and strong privacy measures to protect the
user data it collects. It uses Bluetooth for phone-to-phone communication and,
hence, does not track the user’s location or collect personal identifiable
information such as name, contacts, address, or health information. The app comprises
four key interfaces: no-exposure status, exposure status, diagnosis report, and
self-assessment. The first three interfaces are described in detail in [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ][
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
        </p>
        <p>
          Aarogya Setu (meaning “the bridge to health” in Sanskrit) is the oficial CTA
of the Indian Government, launched on April 2, 2020 [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. It was developed by the
National Informatics Centre (NIC) under the Indian Ministry of Electronics &amp;
Information Technology (MeiTY). The app is available in a total of 12 languages
(English, Tamil, Hindi, Telugu, Kannada, Malayalam, Punjabi, Bengali, Oriya,
Gujarati, Marathi, and Assamese). This list is being expanded to include more
Indian languages in the future [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]. The app supports both iOS and Android
platforms, and can be downloaded by anyone across the 29 states of India or
even abroad. The app utilizes Bluetooth and GPS location-based information to
provide notifications to the user based on their interactions with others. The GPS
and Bluetooth sensors enable the app to track user movement, and interact with
smartphones with the same app installed to generate notifications utilizing its
databases and algorithms. There is an in-built self-assessment feature in the app
that can be used to evaluate users’ level of risk by answering a few questions
related to their health and symptoms. The data collected through the app is
only shared with the Government of India without being disclosed to any third
party [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. The app consists of four sections: “Your Status”, “COVID Updates”,
“Vaccination”, and “COWIN”, which provide information regarding the user’s
risk and vaccination status. Moreover, there is a provision for users to download
their vaccine certificates by directly accessing the COWIN vaccination portal.
        </p>
        <sec id="sec-2-4-1">
          <title>Persuasive System Design Model</title>
          <p>
            The PSD model is a framework used to design, implement and evaluate
behavior change support systems [
            <xref ref-type="bibr" rid="ref35">35</xref>
            ]. The PSD model is composed of four categories
of persuasive strategies, including primary task support, dialog support, social
support, and system credibility support. The primary task support category of
persuasive strategies help users to carry out or accomplish a target behavior
easily and efectively. The dialog support category motivates users to accomplish
the target behavior through feedback and interaction with the system. The social
support category motivates the user to accomplish the target behavior through
social influence. Finally, the system credibility support is aimed to make the
system appear credible and trustworthy to the user. Basically, each of the four
categories comprises seven persuasive strategies. However, we extended the
primary task and social support categories based on the elicited strategies from the
apps. We provided a definition of each of the strategies in each category in the
results section, in which we presented the strategies elicited from both apps.
3
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Related Work</title>
      <p>
        There is limited research on the persuasive design of CTAs [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. In this review, we
covered relevant studies based on Aarogya Setu and COVID Alert. Raman et al.
[
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] conducted a study in 2021 to assess the performance of CTAs on Google Play
Store by focusing on key metrics. They found that the ratings and reviews of
both apps were high and relatively higher than most apps from other countries.
The Canadian app had an average rating of 4.376 stars and the Indian app 3.872
stars [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]. Regarding privacy and data protection, they found that the Canadian
app was rated high, and the Indian app was rated medium. However, regarding
transparency rights, the Indian app was rated high, and the Canadian app was
rated medium. Oyibo and Morita [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] published a conceptual paper, in which
they proposed persuasive features such as Self-Monitoring, Social Learning and
Normative Influence from the PSD model to improve the efectiveness of COVID
Alert. Next, Oyibo and Morita [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] evaluated the persuasive design of COVID
Alert, compared with the control design. They found that equipping the app with
Self-Monitoring (of exposure level) and Social Learning (about how many others
are reporting their diagnosis) can increase adoption among non-adopters by over
10%. Overall, they found that the persuasive design of the app is more likely to
be adopted by non-adopters than the control design. Kodali et al. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] carried
out a thematic analysis of user reviews of Aarogya Setu on Google Play Store.
They found that over half of the users (56%) assigned 4- and 5-star ratings to the
app (signifying higher satisfaction), and about one-quarter of the users (27%)
assigned 1- and 2-star ratings to the app (signifying lower satisfaction). They
found that 80% of the reviews were on user acceptance, 72.8% on app usefulness,
and 62.2% on app features. They also found that users were concerned about
user privacy, data security, software bugs, and the reliability of self-reported
selfassessment. However, none of the reviewed studies compared two or more CTAs
in terms of persuasive design. The aim of this paper is to bridge this gap.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Method</title>
      <p>Three researchers (KO, SS, KK) were involved in the evaluation of the COVID
Alert and Aarogya Setu apps using the PSD model. COVID Alert was assigned
to SS, who was in Canada and using the app, to study and elicit the apparent
persuasive strategies using the list and definitions shown in the PSD model (see
Table 2 to Table 5). Similarly, Aarogya Setu was assigned to KK, who was
staying in India at the time and using the app to evaluate. KO, a senior and
more experienced researcher, played an oversight role in the weekly discussions
over a one-month period (between January 5, 2022 and February 6, 2022), In
the weekly meetings, which occurred on Microsoft Teams, all three researchers
discussed, critiqued, verified, and refined the strategies elicited from both apps.</p>
      <p>Moreover, to reduce the bias of the researchers and supplement their
assessment of the PSD’s credibility support strategies, we asked 21 participants
resident in India (n = 10) and Canada (n = 11) to provide their opinion on both
apps. Due to the exploratory nature of the study, we did not seek ethics approval.
We believed that having the opinions of Aarogya Setu and COVID Alert users
would help increase the reliability of our assessment of the credibility support
strategies. We focused on four credibility-related strategies (Liking,
Trustworthiness, Expertise, and Surface Credibility), which we considered subjective. All of
the four constructs were measured using Perceived Aesthetics, Perceived Trust,
Perceived Expertise, and Perceived Credibility, respectively, which were adapted
from the extant literature (see Appendix for the questionnaire).-Perceived
Aesthetics was measured using two subdimensions (Classical and Expressive), and
Perceived Credibility was measured using two subdimensions (Honesty and
Reputation) on a Likert scale ranging from “Strongly Disagree - 1” to “Strongly
Agree - 7”. The Canadian/Indian groups included 7/7 males and 4/3 females.
The mean age was 24/32 years old. Both groups comprised 8/6 younger
participants and 3/4 older participants, with the latter group defined as above 25 years
old. Both groups included 6/1 Apple users and 5/9 Android users.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Results</title>
      <p>
        We present the results of the exploratory study and the persuasive strategies
elicited from both apps. First, we conducted the reliability test for the six
measured constructs, which was based on McDonald’s coeficient omega ( ω) given
the non-normality of the data. The results showed that the reliability
requirement for each construct (ω &gt; 0.7) was met [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ]. Figure 1 shows the plots of
all six constructs on a 7-point scale. Similar to Raman et al.’s [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] guideline
for rating CTAs on the app store, we categorized the rating of the credibility
support constructs into three levels (1.00-3.99: low, 4.00–4.99: medium,
5.007.00: high). Overall, Aarogya Setu was rated higher than COVID Alert. For
the Indian group, all of the constructs, except Classical Aesthetics, have high
ratings. Moreover, for the Canadian group, all of the constructs have medium
ratings. We performed a 4-way ANOVA, which shows that there is an
interaction between age, gender and app [F (65, 1) = 5.25, p &lt; 0.05]. Within the
younger group, a further two-way ANOVA based on app and gender shows there
is a main efect of app [ F (66, 1) = 20.81, p &lt; 0.0001], with Aarogya Setu (M
= 5.35) rated higher than COVID Alert (M = 3.93). Within the older group, a
further two-way ANOVA shows there is an interaction between app and gender
[F (31, 1) = 25.48, p &lt; 0.0001]. Within older males, there is a main efect of app
[F (18, 1) = 4.63, p &lt; 0.05], with Aarogya Setu (M = 6.07) rated higher than
COVID Alert (M = 5.43). However, within older females, there is a main efect
of app [F (13, 1) = 23.67, p &lt; 0.001], with COVID Alert (M = 5.07) rated higher
than Aarogya Setu (M = 3.19). Table 2 to Table 5 show the identified
persuasive strategies for both apps and the rationale for their elicitation. Regarding
primary task support, two-third and three-quarter of its strategies were elicited
from COVID Alert and Aarogya Setu, respectively. Regarding dialog support,
three-fifth and six-seventh of its strategies were elicited from COVID Alert and
Aarogya Setu, respectively. Regarding social support, zero and half of its
strategies were elicited from COVID Alert and Aarogya Setu, respectively. Finally,
regarding credibility support, three-fifth and six-seventh of its strategies were
elicited from the COVID Alert and Aarogya Setu, respectively.
      </p>
      <p>Fig. 1. Mean rating of credibility support constructs. Vertical bar means 95%
confidence interval. Below the bottom horizontal line indicates low rating, in between both
horizontal lines indicate medium rating, and above top line indicates high rating.
Provides a self-assessment tool, which asks users
questions about their symptoms to reach a certain risk level,
and recommends useful health instructions.</p>
      <p>Keeps track of the user’s COVID-19 exposure status
through an alert.</p>
      <p>Keeps track of the user’s COVID-19 risk level through
self-assessment and exposure status through an alert.</p>
      <p>Supports English and French to allow groups speaking
either language to use the app.</p>
      <p>Supports 12 languages to accommodate diferent tribes.</p>
      <p>Provides localized information based on the area users
are currently living or residing in, e.g., number of cases
within a given region.</p>
      <p>Allows users to select province (based on where they
are) and choose between English and French.</p>
      <p>Allows users to choose from twelve language options.</p>
      <p>Provision of a self-assessment feature to assess user
safety and take measures in real life as necessary.</p>
      <p>
        Integrates diferent systems into the same app, e.g.,
exposure notification, diagnosis reporting, vaccination
appointment booking, vaccination certificate download,
vaccination status display, online consultation, etc. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <sec id="sec-5-1">
        <title>Strategy</title>
        <p>Praise: Praise the
user for performing
behavior using
textual, visual or
audio feedback.</p>
      </sec>
      <sec id="sec-5-2">
        <title>Reward: Give the</title>
        <p>user tangible and
virtual rewards for
performing behavior.</p>
      </sec>
      <sec id="sec-5-3">
        <title>Reminder: Send</title>
        <p>the user reminder to
increase the odds of
performing behavior.</p>
      </sec>
      <sec id="sec-5-4">
        <title>Suggestion:</title>
        <p>Provide the user
just-in-time
suggestions to
facilitate
performance of
behavior.</p>
      </sec>
      <sec id="sec-5-5">
        <title>Similarity: Support</title>
        <p>features and
elements that
remind the user of
themselves.</p>
      </sec>
      <sec id="sec-5-6">
        <title>Liking: Make the</title>
        <p>system aesthetically
pleasing and
appealing to increase
engagement.</p>
      </sec>
      <sec id="sec-5-7">
        <title>Social Role:</title>
        <p>Support social roles
to motivate the user
to do expected
behavior that fits
their role.</p>
        <p>
          App
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Gives the user a thumbs-up for currently not being
exposed to COVID-19. [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
        </p>
        <p>
          XXX
XXX
XXX
Provides the user with refined contact tracing
results if they share their data (e.g., location, contacts,
diagnosis, risk level) with the government [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ].
Provides reminder notifications to users to complete
their self-assessment.
        </p>
        <p>Provides suggestions to isolate, upon entering QR
code for testing positive.</p>
        <p>Provides information on the importance of following
COVID-19 safety guidelines such as social
distancing and masking. Gives the user specific suggestions,
e.g., self-isolate, after taking the self-assessment
test.</p>
        <p>Provides two languages (English and French) to
match the user’s preferred language.</p>
        <p>Provides 12 languages to match the user’s preferred
language.</p>
        <p>The app is moderately liked based on our exploratory
study (see Figure 1).</p>
        <p>The app is moderately liked based on our exploratory
study (see Figure 1).</p>
        <p>XXX
(1) Supports a self-assessment tool, which allows the
user (patient) to evaluate their COVID-19 exposure
status and/or risk level by responding to certain
predefined questions from the app (representing a
health professional). (2) Allows a parent to monitor
their child’s COVID-19 exposure and/or risk level.</p>
      </sec>
      <sec id="sec-5-8">
        <title>Strategy</title>
      </sec>
      <sec id="sec-5-9">
        <title>Social Learning:</title>
        <p>Allow the user to
observe others
perform the behavior
to motivate them to
imitate it.</p>
      </sec>
      <sec id="sec-5-10">
        <title>Social</title>
      </sec>
      <sec id="sec-5-11">
        <title>Comparison: Allow</title>
        <p>users to compare
their behaviors with
others’.</p>
      </sec>
      <sec id="sec-5-12">
        <title>Normative</title>
      </sec>
      <sec id="sec-5-13">
        <title>Influence: Employ</title>
        <p>social pressure (the
need to be liked and
accepted) to
motivate behavior.</p>
      </sec>
      <sec id="sec-5-14">
        <title>Social</title>
      </sec>
      <sec id="sec-5-15">
        <title>Facilitation: Make</title>
        <p>the user aware of the
performance of the
behavior by others
at the current time.</p>
      </sec>
      <sec id="sec-5-16">
        <title>Cooperation:</title>
        <p>Allow users to work
together to achieve a
collective goal
and/or reward.</p>
      </sec>
      <sec id="sec-5-17">
        <title>Competition:</title>
        <p>Allow users to
compete, e.g., by
displaying their
performance on a
leaderboard.</p>
      </sec>
      <sec id="sec-5-18">
        <title>Recognition:</title>
        <p>Publicly recognize
the user to motivate
future performance
of the behavior.</p>
      </sec>
      <sec id="sec-5-19">
        <title>Social Location</title>
      </sec>
      <sec id="sec-5-20">
        <title>Monitoring: Allow</title>
        <p>the user to monitor a
given location/region
to assess their risk.</p>
        <p>App
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind
Can
Ind</p>
        <p>XXX
XXX
XXX
XXX
XXX
XXX
XXX
XXX
XXX
XXX
XXX
XXX
Tells the user, within a specified radius, how many
people have completed the self-assessment in the
past 24-48 hours. Provides a link to a government
vaccine database which gives detailed information
on vaccination statistics.</p>
        <p>Allows family members to monitor their risk level,
thereby putting pressure on each family member to
follow the norms (COVID-19 safety guidelines).
Tells the user, within a specified radius, how many
people are currently registered on the app, and using
the app.
Shows how many users in a particular radius have
been assessed as high risk in the past 24-48 hours.</p>
      </sec>
      <sec id="sec-5-21">
        <title>Strategy Trustworthiness:</title>
        <p>Provides privacy policy (e.g., personal identifiable
information will not be collected) to foster trust. The source
code is made available to the public to increase
transparency. [The app is perceived as medium in
trustworthiness based on our exploratory study (see Figure 1).]
(1) Provides privacy information in the FAQ section of
the app and via links to external websites. (2) The source
code is made available to the public to increase
transparency. [The app is perceived as high in trustworthiness
based on our exploratory study (see Figure 1).]
The app is perceived as medium in expertise based on
our exploratory study (see Figure 1).</p>
        <p>Mentions in Google Play Store the app is developed by
National Informatics Centre under the Ministry of
Electronics &amp; Information Technology of the Government of
India. [The app is perceived as high in expertise based on
our exploratory study (see Figure 1).]
The app is perceived as medium in credibility (honesty
and reputation) based on our exploratory study (see
Figure 1).</p>
        <p>The app is perceived as high in credibility (honesty and
reputation) based on our exploratory study (see Figure
1).</p>
        <p>XXX
(1) The self-assessment tool mimics a real-life session
with a healthcare professional. It uses a picture of a nurse
and interactive questions to guide the user to arrive at a
particular risk level. (2) The app allows the user to show
or share their vaccination status with others via social
media channels. This allows users to present or show
their vaccination status before meeting with someone
or gaining access to premises. (3) The app contains a
media/news section, which keeps the user updated on
the COVID-19 situation and events. (4) The app also
lists helpline numbers which provide users a chance to
talk to a real person and present their concerns. (5) The
app has a QR Code scanning functionality which allows
users to easily share their risk level and see others’.</p>
      </sec>
      <sec id="sec-5-22">
        <title>Strategy</title>
      </sec>
      <sec id="sec-5-23">
        <title>Authority: Use</title>
        <p>authority-based
information to
motivate users to
adopt and use
the app.</p>
      </sec>
      <sec id="sec-5-24">
        <title>Third-Party</title>
      </sec>
      <sec id="sec-5-25">
        <title>Endorsement:</title>
        <p>Show
endorsements
from respected
sources, e.g.,
through logos.</p>
      </sec>
      <sec id="sec-5-26">
        <title>Verifiability:</title>
        <p>Authenticate
information using
third-party
sources.
6</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Discussion</title>
      <p>App
Can
Ind
Can
Ind
The homepage shows a statement from the Prime
Minister of India, highlighting the importance of the app and
urging people to download it.</p>
      <p>
        The about page on the Google Play Store mentions
Health Canada indicating it endorses the app. [Usually
users prefer health authorities, and not governments, to
take on the responsibility of digital contact tracing [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].]
Mentions the Ministry of Health &amp; Family Welfare above
the user’s vaccination status on the homepage.
      </p>
      <p>Can</p>
      <p>XXX
Ind</p>
      <p>XXX
We have presented the key performance metrics for COVID Alert and Aarogya
Setu (Table 1) and the persuasive strategies we elicited from both apps using
the PSD model (Table 2 to Table 5) to gain insight into how they difer.
6.1</p>
      <sec id="sec-6-1">
        <title>Key App Characteristics and Metrics</title>
        <p>
          There are some marked diferences between both apps in terms of features,
privacy, design, cost, and adoption rate. For example, unlike COVID Alert where
most of the features (e.g., privacy and help information) can be found in an
external website, Aarogya Setu is mostly self-contained, with most of its features
being in-built (e.g., vaccination appointment booking and downloading the
certificate). Secondly, while the Canadian app was developed through contracting
by Canadian Digital Service [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] for C$ 20 million, the Indian app was developed
by in-house IT professionals within the Indian Ministry of Electronics &amp; IT for
C$ 0. Thirdly, the Indian app uses a hybrid privacy design (centralized and
decentralized), while the Canadian app, due to the strong concerns about privacy
in Canada, uses the decentralized approach. Fourthly, while the Canadian app
has been downloaded by one-fifth of Canadian smartphone users, the Indian app
has been downloaded by one-third of Indian smartphone users. Overall, the
Indian app provides its users more utility and value than the Canadian app. This
may partly explain why Aarogya Setu has a higher adoption rate, aside from
being mandated in some situations in India [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. Another possible explanation for
the higher adoption of Aarogya Setu is that the Indian population (collectivist)
is less likely concerned about privacy and thus more likely to trust the app than
the Canadian population (individualist) [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ][
          <xref ref-type="bibr" rid="ref27">27</xref>
          ], as Figure 1 shows.
6.2
        </p>
      </sec>
      <sec id="sec-6-2">
        <title>Elicited PSD Strategies</title>
        <p>For the Aarogya Setu app, the dialog support (85.71%) and credibility
support (85.71%) turn out to be the most implemented categories of strategies
in the PSD model, and social support (50%) the least implemented. On other
hand, for the COVID Alert app, the primary task support turns out to be
the most implemented category of strategies (66.66%), and social support the
least implemented (0%). Overall, Aarogya Setu supports more persuasive
features (14/31) than COVID Alert (19/31). For example, regarding the primary
support category, Aarogya Setu supports Integration and Personalization, but
COVID Alert does not. Moreover, both apps support Self-Monitoring.
However, Self-Monitoring is only implemented partially. For example, in both apps,
users can only monitor their COVID-19 exposure status and/or risk level. With
that said, the Self-Monitoring feature can be improved upon, e.g., by
tracking/visualizing the number of user’s daily contacts (within two meters), which
are already stored on the user’s phone. Regarding dialog support category,
Aarogya Setu rewards the user for sharing their data such as location and diagnosis
by allowing them to access more refined contact tracing information – a form
of reciprocity). Although COVID Alert does not support any reward system,
it uses the Praise strategy (a green-color thumbs up to convey a no-exposure
status), while Aarogya Setu uses a green-color scheme for the home screen to
indicate the no-exposure status.</p>
        <p>
          Regarding the social support category, Aarogya Setu supports four of the
eight strategies (Social Learning, Social Facilitation, Normative Influence, and
Social Location Monitoring), but COVID Alert does not support any of the
strategies. For example, the “Status Check” feature in Aarogya Setu engenders
Normative Influence by virtue of collaborative users not wanting to be exposed to
COVID-19 (by following the safety guidelines) in order to be in the good books
of one another. A plausible explanation for the lack of social features in COVID
Alert is that Canadians, due to their relatively high privacy concerns [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], are
unwilling to share their health information with others [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. It is noteworthy that
social strategies such as Normative Influence, elicited from Aarogya Setu, can be
made more robust to realize additional social influence strategies. For instance,
the “Status Check” feature, which enables family and friends to monitor one
another, can be used to foster Social Comparison by allowing the collaborative
users to view each other’s COVID-19 exposure status, risk level, and even
individual number of daily contacts side by side on a joint dashboard [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. This has
the potential of motivating the collaborative parties to stay safe, as they would
not want to be the odd one in the group. Finally, regarding the credibility
support category, most of the constituent strategies are implemented, with Aarogya
Setu (6/7) supporting more than COVID Alert (4/7). For example, in Aarogya
Setu, we uncovered persuasive strategies such as Real-World Feel, Authority, and
Third-Party Endorsement, which could improve adoption and usage. For
example, Real-World Feel includes supporting COVID-19 symptom self-assessment,
sharing of vaccination status with others and on social media, and having access
to the latest media updates on COVID-19. Moreover, Third-Party Endorsement
is implemented by specifying that the app was developed by the NIC in the app
stores and is supported by Ministry of Health and Family Welfare in the app,
both of which are reputable IT and health bodies, respectively, in India.
        </p>
        <p>
          Finally, based on the exploratory study (Figure 1), we found that the Indian
group perceived Aarogya Setu as highly aesthetic, professional, trustworthy, and
credible (M ≥ 5), except for the expressive aesthetic subdimension rated medium
(4 &lt; M &lt; 5). However, the Canadian group perceived COVID Alert as
moderately aesthetic, professional, credible, and trustworthy (4 &lt; M &lt; 5). These
ifndings may not be far-fetched given the minimalist design of COVID Alert
[
          <xref ref-type="bibr" rid="ref17">17</xref>
          ][
          <xref ref-type="bibr" rid="ref30">30</xref>
          ] and its relatively low adoption rate (21%) compared with Aarogya Setu
(36%). The relatively lower ratings of the credibility support constructs among
the Canadian group might be due to privacy concerns [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. Specifically, the
interaction analyses showed that, within the younger group, Aarogya Setu (M =
5.35) was rated signicfiantly higher than COVID Alert (M = 3.93). Similarly,
within older males, Aarogya Setu (M = 6.07) was rated significantly higher than
COVID Alert (M = 5.43). However, within older females, COVID Alert (M =
5.07) was rated significantly higher than Aarogya Setu (M = 3.19). It is
noteworthy that these findings are preliminary and need further investigations.
6.3
        </p>
      </sec>
      <sec id="sec-6-3">
        <title>Recommendations</title>
        <p>
          Based on the results of our comparative analysis, we provide persuasive design
recommendations, in addition to the ones provided by Oyibo and Morita [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] in
their conceptual paper, to improve future CTA iterations.
        </p>
        <p>
          Technical Expertise. It is important for the app sponsors to show that the
app was developed by reputable technical experts. Although COVID Alert was,
in reality, developed by Canadian Digital Service, with BlackBerry providing
privacy and security guidance [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], this was not conveyed to the potential user in
the app or app stores. The institution that was instead displayed in the app store
was Health Canada (a non-technical expert). While CTA research shows that
people trust health institutions more than governments and technology
companies such as Google and Apple [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ][
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], from a technology design perspective, it
may be beneficial for the app sponsors to demonstrate that the app was created
by reputable technical experts in the IT space, just as the India app sponsors
did. The sponsors of Aarogya Setu did show on the Google and Apple app stores
that it was developed by National Informatics Centre under the Ministry of
Electronics &amp; IT of the Government of India, a recognized national institution that
supports the Indian Government in delivering information technology services
to the people. Canada can learn from India in this area. Better still, both health
and technical institutions can be listed as collaborators in the app design. With
that said, there is a need for future research to understand how the provider(s)
listed on the app store may influence users’ perception and adoption of CTAs.
Integration and Self-Containedness. Using multiple systems (apps,
websites, etc.) to access COVID-19 related services such as booking vaccine
appointments and displaying vaccination status could be very dificult, especially among
older people. Hence, the provision of multiple useful features (e.g., vaccination
appointment booking, vaccine certificate download, sharing of vaccination
status, display of high-risk users within a certain radius, etc.) in the Aarogya Setu
[
          <xref ref-type="bibr" rid="ref31">31</xref>
          ] might have increased its perceived persuasiveness and installation (over 200
million), as prior research shows that there is a significant relationship between
perceived usefulness and perceived persuasiveness [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. As reported by Alanzi
[
          <xref ref-type="bibr" rid="ref29">29</xref>
          ], only few CTAs such as Arogya Setu have integrated various useful features
(such as self-assessment, online consultation, support, and access to information)
in a single app in order to simplify user access to public services. Canada can
learn from this. For example, instead of having diferent apps (e.g., COVID Alert
and Arrive Can) for diferent but related COVID-19 safety goals, the apps can
be integrated. However, we recognize that due to privacy issues and the need to
make CTA usage voluntary, the Canadian Government was reluctant and may
not be willing in the future to implement or integrate certain useful features.
To address this challenge, we recommend a personalized approach rather than
a one-size-fits-all be taken. We hypothesize that some Canadian users may be
willing to use a version of the app that supports beneficial features (such as
appointment booking, online consultation, etc.) that provide utility and value.
Users can be given the opportunity to add and remove (uninstall) features as
they deem fit. However, there is a need for further research to gain insight into
what portion of the population is open to new features and what types of features
they expect their ideal app to have.
        </p>
        <p>
          Complimenting the User for Staying Safe. Praising someone verbally or
visually makes them feel good about themselves [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ], especially for accomplishing
a certain outcome. In COVID Alert, a green-colored thumbs-up icon is used to
indicate the no-exposure status of the user, which is a form of praise of the user
for remaining safe [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. The Indian app could also adopt this kind of visual dialog
support feedback (Praise) to motivate users to continue following COVID-19
protocols such as social distancing to remain safe and protect their community.
Self-Monitoring. The Canadian app only allows the user to track their
exposure status through an alert. We recommend that it allow the user to track their
risk level as well through self-assessment within the app just like the Indian app.
Social Influence. Social Influence has the potential to motivate behavior
change [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ]. Although most Canadians are individualists that like protecting
their health data [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ], some may want to work together with others in their
family and community to achieve certain health goals. Moreover, there are
immigrants, although currently resident in Canada, that still possess collectivist
tendencies. Hence, just like Aarogya Setu, it may be beneficial for COVID Alert
to have a social version as well. This will enable those who want access to social
features such as Cooperation (with family and friends), Social Location
Monitoring [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] and chat rooms for sharing and discussing beneficial health information
to have a choice. Moreover, Aarogya Setu’s social features can be enhanced [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ].
However, the efect of social influence in CTAs needs further study.
6.4
        </p>
      </sec>
      <sec id="sec-6-4">
        <title>Contributions</title>
        <p>
          We made a number of contributions to the growing body of CTA design
literature. The first contribution is that we mapped most of the functional features
ofered by existing CTAs (such as Aarogya Setu) to persuasive strategies using
the PSD model. This enables researchers studying CTA design to know when
and how a persuasive strategy has been applied. The second contribution is that
we expanded the original PSD model by introducing new persuasive strategies
that are relevant to CTA design (e.g., Integration in primary task support, and
Social Location Monitoring in social support [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]). The third contribution is that
we demonstrated how the evaluation of credibility support strategies (such as
Liking and Trustworthiness), which can be subjective, can be complemented by
user’s (or designer’s) perception to reduce authors’ bias. Prior work in this area
(e.g., [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]) often evaluated these strategies from the authors’ perspective alone.
6.5
        </p>
      </sec>
      <sec id="sec-6-5">
        <title>Limitations</title>
        <p>
          The first limitation of the study is that the elicitation of persuasive strategies
from both apps was subjective. Thus, the researchers could have failed to identify
certain persuasive strategies supported by either app or misidentified strategies
due to poor judgement. The second limitation is that the persuasive strategies
in the PSD model, employed in evaluating the persuasive design of both apps,
is not exhaustive. Future work can employ a more comprehensive framework
such as Michie et al. [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ]. The third limitation is that the results of the study
on credibility support features (Figure 1) was based on a convenience sample
(known to the researchers) and the sample size was small. Hence, the findings
have to be interpreted with caution and context given that the study was only
exploratory. Future work should aim at addressing these limitations.
7
        </p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Conclusions</title>
      <p>
        The paper presents a comparative analysis of Canada’s CTA (COVID Alert) and
India’s CTA (Aarogya Setu) using the PSD model as an analytical framework.
We found that both apps support some key persuasive strategies (e.g.,
SelfMonitoring, Similarity, and Third-Party Endorsement) from the PSD model,
with the Indian app supporting more strategies including social influence
strategies (e.g., Social Location Monitoring and Normative Influence). Despite both
apps supporting a number of PSD strategies, there is room for improving their
implementations and incorporating more persuasive strategies in future
iterations. Moreover, there is a lot the Canadian app can learn from the Indian
app, which is one of the most downloaded CTAs in the world [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ], in terms of
supporting more features (such as vaccine appointment booking and download
of vaccination certificate), which Canadians may consider useful. In our future
work, we aim to investigate how the incorporation of some of the persuasive
features ofered by Aarogya Setu, among others from the PSD model, in COVID
Alert may impact its perceived usefulness and user adoption.
      </p>
    </sec>
    <sec id="sec-8">
      <title>Appendix</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Canada</surname>
          </string-name>
          <article-title>'s COVID-19 exposure notification app now available in the Northwest Territories</article-title>
          .
          <source>Prime Minister of Canada</source>
          . (
          <year>2020</year>
          ).
          <source>Retrieved March 7</source>
          ,
          <year>2022</year>
          , from https://pm.gc.ca/en/news/news-releases/
          <year>2020</year>
          /11/26/canadas-covid-19
          <string-name>
            <surname>-</surname>
          </string-name>
          exposure
          <article-title>-notification-app-now-available-northwest</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Sharma</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharma</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jones</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kraus</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Dwivedi</surname>
            ,
            <given-names>Y. K.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Digital Health Innovation: Exploring adoption of covid-19 digital contact tracing apps</article-title>
          .
          <source>IEEE Transactions on Engineering Management</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          . https://doi.org/10.1109/tem.
          <year>2020</year>
          .3019033
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Walrave</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waeterloos</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ponnet</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Ready or not for contact tracing? investigating the adoption intention of covid-19 contact-tracing technology using an extended unified theory of acceptance and use of Technology Model</article-title>
          . Cyberpsychology, Behavior, and Social Networking,
          <volume>24</volume>
          (
          <issue>6</issue>
          ),
          <fpage>377</fpage>
          -
          <lpage>383</lpage>
          . https://doi.org/10.1089/cyber.
          <year>2020</year>
          .0483
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. Kur¨ger, N.,
          <string-name>
            <surname>Behne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beinke</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stibe</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Teuteberg</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>Exploring user acceptance determinants of covid-19-tracing apps to manage the pandemic</article-title>
          .
          <source>International Journal of Technology and Human Interaction</source>
          ,
          <volume>18</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          . https://doi.org/10.4018/ijthi.293197
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Velicia-Martin</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cabrera-Sanchez</surname>
            ,
            <given-names>J. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gil-Cordero</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Palos-Sanchez</surname>
            ,
            <given-names>P. R.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Researching COVID-19 tracing app acceptance: incorporating theory from the technological acceptance model</article-title>
          .
          <source>PeerJ. Computer science</source>
          ,
          <volume>7</volume>
          ,
          <fpage>e316</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Agarwal</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2021</year>
          , June 1).
          <article-title>Aarogya Setu to display vaccination status; will help people get quick access</article-title>
          .
          <source>The Economic Times. Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://economictimes.indiatimes.com/tech/technology/aarogya-setu
          <article-title>-to-displayvaccination-status-will-help-people-get-quick-access/articleshow/83148645</article-title>
          .cms
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Basu</surname>
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Efective Contact Tracing for COVID-19 Using Mobile Phones: An Ethical Analysis of the Mandatory Use of the Aarogya Setu Application in India. Cambridge quarterly of healthcare ethics : CQ : the international journal of healthcare ethics committees</article-title>
          ,
          <volume>30</volume>
          (
          <issue>2</issue>
          ),
          <fpage>262</fpage>
          -
          <lpage>271</lpage>
          . https://doi.org/10.1017/S0963180120000821
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Morita</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>Factors influencing the willingness to download COVID-19 contact tracing apps: The moderating efect of persuasive design and smartphone usage experience</article-title>
          .
          <source>In Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care</source>
          , New Orleans, United States.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sahu</surname>
            ,
            <given-names>K. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oetomo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morita</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          (
          <year>2022</year>
          )
          <article-title>Factors Influencing the Adoption of Contact Tracing Applications: Systematic Review and Recommendations</article-title>
          . Frontiers in Digital Health,
          <volume>54</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Timberg</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harwell</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Safarpour</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Most Americans are not willing or able to use an app tracking coronavirus infections. That's a problem for Big Tech's plan to slow the pandemic</article-title>
          .
          <source>The Washington Post. Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://www.washingtonpost.com/technology/2020/04/29/mostamericans-are
          <article-title>-not-willing-or-able-use-an-app-tracking-coronavirus-infections-thatsproblem-big-techs-plan-slow-pandemic/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Download COVID</surname>
          </string-name>
          <article-title>Alert: Canada's exposure notification app (2021, August 12)</article-title>
          .
          <source>Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://www.canada.ca/en/publichealth/services/diseases/coronavirus-disease-covid-19/covid-alert.html
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Morita</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>The efect of persuasive design on the adoption of exposure notification apps: A Proof of Concept Based on COVID Alert. JMIR Formative Research</article-title>
          . https://doi.org/https://doi.org/10.2196/preprints.34212
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Kodali</surname>
            ,
            <given-names>P. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hense</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kopparty</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalapala</surname>
            ,
            <given-names>G. R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Haloi</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>How Indians responded to the Arogya setu app?</article-title>
          <source>Indian Journal of Public Health</source>
          ,
          <volume>64</volume>
          (
          <issue>6</issue>
          ), 228. https://doi.org/10.4103/ijph.
          <source>ijph 499 20</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Roth</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plonsky</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shalev</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Erev</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>On the value of alert systems and gentle rule enforcement in addressing pandemics</article-title>
          . Frontiers in psychology,
          <volume>11</volume>
          ,
          <fpage>3252</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15. CTV News.
          <article-title>(</article-title>
          <year>2020</year>
          ).
          <article-title>Federally-backed Covid Alert app now available in Ontario</article-title>
          .
          <source>Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://ottawa.ctvnews.ca/federally-backed
          <article-title>-covidalert-app-now-available-</article-title>
          <source>in-ontario-1</source>
          .
          <fpage>5046667</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Gupta</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bedi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goyal</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wadhera</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Verma</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Analysis of COVID-19 tracking tool in India</article-title>
          .
          <source>Digital Government: Research and Practice</source>
          ,
          <volume>1</volume>
          (
          <issue>4</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          . https://doi.org/10.1145/3416088
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Morita</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Designing better exposure notification apps: The role of persuasive design</article-title>
          .
          <source>JMIR Public Health and Surveillance</source>
          ,
          <volume>7</volume>
          (
          <issue>11</issue>
          ). https://doi.org/10.2196/28956
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Morita</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>COVID Alert: Factors Influencing the Adoption of Exposure Notification Apps Among Canadian Residents</article-title>
          . Frontiers in Digital Health,
          <volume>4</volume>
          :
          <issue>842661</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          . https://doi.org/10.3389/fdgth.
          <year>2022</year>
          .842661
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Coletto</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2021</year>
          , November 30).
          <article-title>Fear of omicron triggers anxiety across Canada</article-title>
          .
          <source>Abacus Data. Retrieved January 21</source>
          ,
          <year>2022</year>
          , from https://abacusdata.ca/covid-anxiety
          <string-name>
            <surname>-</surname>
          </string-name>
          worry-omicron/
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Farronato</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Iansiti</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bartosiak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Denicolai</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ferretti</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Fontana</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>How to get people to actually use contact-tracing apps: Semantic scholar</article-title>
          .
          <source>Harvard Business Review. Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://www.semanticscholar.org/paper/How-to-
          <article-title>Get-People-to-</article-title>
          <string-name>
            <surname>Actually-UseContact-Tracing-</surname>
          </string-name>
          Farronato-Iansiti/
          <year>ce67f4a858bde4b89bd70c1c688c1d3ea8d2bbac</year>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Wiertz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Banerjee</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Acar</surname>
            ,
            <given-names>O. A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ghosh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Predicted adoption rates of contact tracing app configurations - insights from a choice-based conjoint study with a representative sample of the UK population</article-title>
          .
          <source>SSRN Electronic Journal</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          . https://doi.org/10.2139/ssrn.3589199
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22. Johns Hopkins Coronavirus Resource Center. (
          <year>2022</year>
          ). Covid-
          <volume>19</volume>
          map.
          <source>Retrieved January 31</source>
          ,
          <year>2022</year>
          , from https://coronavirus.jhu.edu/map.html
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Jenniskens</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bootsma</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Damen</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oerbekke</surname>
            ,
            <given-names>M. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vernooij</surname>
            ,
            <given-names>R. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spijker</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moons</surname>
            ,
            <given-names>K. G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kretzschmar</surname>
            ,
            <given-names>M. E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hooft</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Efectiveness of contact tracing apps for SARS-COV-2: A rapid systematic review</article-title>
          .
          <source>BMJ Open</source>
          ,
          <volume>11</volume>
          (
          <issue>7</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>EMVE-DECK: A theory-based framework for designing and tailoring persuasive technology</article-title>
          .
          <source>Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization</source>
          ,
          <volume>257</volume>
          -
          <fpage>267</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Adaji</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Vassileva</surname>
            ,
            <given-names>J</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Evaluating persuasive systems using the PSD framework</article-title>
          .
          <source>In UMAP (Extended Proceedings).</source>
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Designing culture-tailored persuasive technology to promote physical activity (Doctoral dissertation</article-title>
          , University of Saskatchewan).
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Hofstede</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Cultures and organizations: Software of the mind</article-title>
          .
          <source>Journal of International Business Studies</source>
          ,
          <volume>23</volume>
          (
          <issue>2</issue>
          ),
          <fpage>362</fpage>
          -
          <lpage>365</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28. Ministry of Electronics &amp; Information
          <string-name>
            <surname>Technology</surname>
          </string-name>
          , Government of India. (
          <year>2022</year>
          ).
          <source>Aarogya Setu. Retrieved February 5</source>
          ,
          <year>2022</year>
          , from https://www.aarogyasetu.gov.in/
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Alanzi</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>A review of mobile applications available in the app and Google Play stores used during the COVID-19 Outbreak</article-title>
          .
          <source>Journal of Multidisciplinary Healthcare</source>
          , Volume
          <volume>14</volume>
          ,
          <fpage>45</fpage>
          -
          <lpage>57</lpage>
          . https://doi.org/10.2147/jmdh.s285014
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Krehling</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Essex</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>A security and privacy scoring system for contact tracing apps</article-title>
          .
          <source>Journal of Cybersecurity and Privacy</source>
          ,
          <volume>1</volume>
          (
          <issue>4</issue>
          ),
          <fpage>597</fpage>
          -
          <lpage>614</lpage>
          . https://doi.org/10.3390/jcp1040030
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Raman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Achuthan</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vinuesa</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Nedungadi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>COVIDTAS COVID-19 tracing app scale-an evaluation framework</article-title>
          .
          <source>Sustainability</source>
          ,
          <volume>13</volume>
          (
          <issue>5</issue>
          ), 2912. https://doi.org/10.3390/su13052912
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Vassileva</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>HOMEX: Persuasive Technology Acceptance Model and the moderating efect of culture</article-title>
          .
          <source>Frontiers in Computer Science</source>
          ,
          <volume>2</volume>
          . https://doi.org/10.3389/fcomp.
          <year>2020</year>
          .00010
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Gulati</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sousa</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lamas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Design, development and evaluation of a human-computer trust scale</article-title>
          .
          <source>Behaviour &amp; Information Technology</source>
          ,
          <volume>38</volume>
          (
          <issue>10</issue>
          ),
          <fpage>1004</fpage>
          -
          <lpage>1015</lpage>
          . https://doi.org/10.1080/0144929x.
          <year>2019</year>
          .1656779
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Corritore</surname>
            ,
            <given-names>C.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marble</surname>
            ,
            <given-names>R.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiedenbeck</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kracher</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chandran</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Measuring Online Trust of Websites: Credibility, Perceived Ease of Use, and Risk</article-title>
          .
          <source>Americas Conference on Information Systems (AMCIS)</source>
          ,
          <volume>370</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Oinas-Kukkonen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Harjumaa</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Persuasive systems design: Key issues, Process Model, and system features</article-title>
          .
          <source>Communications of the Association for Information Systems</source>
          ,
          <volume>24</volume>
          . https://doi.org/10.17705/1cais.02428
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Saint-Arnaud P. CTV News</surname>
          </string-name>
          .
          <article-title>(</article-title>
          <year>2021</year>
          ).
          <article-title>Ottawa spent nearly 20 million on COVID19 tracking app - with inconclusive results</article-title>
          .
          <source>CTV News. Retrieved January 31</source>
          ,
          <year>2022</year>
          , from: https://www.ctvnews.ca/politics/ottawa-spent-nearly-20
          <string-name>
            <surname>-</surname>
          </string-name>
          millionon-covid-19
          <string-name>
            <surname>-</surname>
          </string-name>
          tracking
          <article-title>-app-with-inconclusive-results-</article-title>
          <volume>1</volume>
          .
          <fpage>5497296</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Grant</surname>
            ,
            <given-names>N. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fabrigar</surname>
            ,
            <given-names>L. R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lim</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Exploring the eficacy of compliments as a tactic for securing compliance</article-title>
          .
          <source>Basic and Applied Social Psychology</source>
          ,
          <volume>32</volume>
          (
          <issue>3</issue>
          ),
          <fpage>226</fpage>
          -
          <lpage>233</lpage>
          . https://doi.org/10.1080/01973533.
          <year>2010</year>
          .497456
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Orji</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomotey</surname>
            ,
            <given-names>R. K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Orji</surname>
            ,
            <given-names>F. A.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Sociallydriven persuasive health intervention design: Competition, social comparison, and Cooperation</article-title>
          .
          <source>Health Informatics Journal</source>
          ,
          <volume>25</volume>
          (
          <issue>4</issue>
          ),
          <fpage>1451</fpage>
          -
          <lpage>1484</lpage>
          . https://doi.org/10.1177/1460458218766570
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <surname>Oyibo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ali</surname>
            ,
            <given-names>Y. S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Vassileva</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>An empirical analysis of the perception of mobile website interfaces and the influence of culture</article-title>
          .
          <source>In PPT@ PERSUASIVE</source>
          ,
          <fpage>44</fpage>
          -
          <lpage>56</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>Michie</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Richardson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abraham</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Francis</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hardeman</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eccles</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cane</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wood</surname>
            ,
            <given-names>C. E.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>The behavior change technique taxonomy (V1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions</article-title>
          .
          <source>Annals of Behavioral Medicine</source>
          ,
          <volume>46</volume>
          (
          <issue>1</issue>
          ),
          <fpage>81</fpage>
          -
          <lpage>95</lpage>
          . https://doi.org/10.1007/s12160-013-9486-6
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>