<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Software Architecture and Software Usability: A Comparison of Data Entry Form Designing Configurable Platforms.</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Lawrence Fatsani Byson</string-name>
          <email>lbyson@cc.ac.mw</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zomba</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Malawi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zomba</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Malawi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Science Department</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Malawi</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <abstract>
        <p>-- The objective of the research was to discuss how software architecture shapes the usability of configurable software in data entry-form design. The research process was conducted in three stages. The first stage focused on usability studies for DHIS2 custom form editor from which empirical data was collected from 11 participants. The second phase centred on experimentation with Sketch2Code and Commcare. The final stage focused on solution prototyping and evaluation. The research found out that usability is enhanced in configurable platforms through the availability of interface elements for achieving desired goals with the platform without the need for writing code and meta-design. Constraining factors to usability include lack of functionality to advance the appearance of interfaces beyond the basic outlook and having predefined functions with limited room for innovation outside the predefined range. The research also found out that software architecture enables software usability by providing mechanisms for cross-platform compatibility with similar applications, provision of boundary resources for further customisation and through meta-design Software platforms provide for end-user software development, through customization of software interfaces and behaviour via interaction with graphical user interface (UI) elements and configuration files [2], [3]. Thus, with the advent of configurable software platforms, the implementation of software solutions is shifting from total reliance on software developers towards increased participation of end-users. In turn, providing for enduser development of software applications may lead to reduced software development time and costs [4], [5].</p>
      </abstract>
      <kwd-group>
        <kwd>---Usability</kwd>
        <kwd>Configurable Platform</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Architecture,
Design,</p>
    </sec>
    <sec id="sec-2">
      <title>I. INTRODUCTION</title>
      <p>
        Traditionally, software development has involved two sets
of distinct teams: software developers and end-users. Software
developers are people with a programming background,
involved in the design and implementation of software products.
In a traditional software development setup, end-users provide
software specifications and wait for software developers to
actualise the requirements into the desired software product.
Thus, end-users are consumers of the final product from the
software developers. This process of development has been
deemed costly in terms of human resources, time and money [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Good software developers are costly and limited in number.
Employing software developers also means that organizations
have to deal with an overhead of human resource management
issues. Further to this, the process of end-users giving software
specifications to software developers and then waiting for the
software developers to implement solutions is reported to take
time due to differences in priorities between the software
developers and end-users [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>To address problems inherent to traditional software
development, organizations are progressively adopting
configurable software platforms. Configurable software</p>
      <p>
        This paper discusses how software architecture shapes the
usability of configurable software in data entry-form design. To
achieve this, the paper focusses on the utilisation of configurable
software platforms in Malawi’s health sector. There is an
increased uptake of configurable platforms in the development
of patient care and National Health Management Information
System (HMIS) solutions in resource-constrained settings such
as Malawi, which face a dearth of highly skilled software
developers. Notable configurable platforms in use include
Commcare and the District Health Information System 2
(DHIS2). Commcare is a mobile data collection platform where
a user does not need to write a single line of code. It has features
for offline data collection, tracking data over time, incorporating
multimedia and multi-language support [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. DHIS2 is a
configurable web software platform developed for the
collection, validation, analysis, and presentation of aggregate
and patient-based statistical data [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. It enjoys usage in over 60
countries (Malawi inclusive), most of which are developing
countries [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        The paper uses DHIS2 a primary case, analyzing the
experiences of platform end-users in the configuration of data
collection forms. Based on noted challenges, the paper compares
the DHIS2 platform with other platforms (Commcare,
Sketc2Code) in regard to form design, in order to draw lessons
for design improvement. The choice of DHIS2 is motivated
based on the platform’s wide usage in Africa. At the same time,
literature shows that the platform can be complex to use. For
example, in Uganda, electronic forms for a health commodity
ordering system were reported to have use flexibility challenges
due to the poor design of the forms as the custom editor in
DHIS2 limited the extent to which designers could design forms
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Our interactions with colleagues from other countries also
show that countries often rely on a small set of experts for
configuring national software products, due to platform
complexity and usability issues. It is therefore hoped that lessons
drawn herein will benefit other countries beyond Malawi.
      </p>
      <sec id="sec-2-1">
        <title>A. Configurable Software Platforms</title>
        <p>
          A Software platform is defined as a software-based product
or service that serves as a foundation on which outside parties
can build complementary products [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. A software platform
provides the core functionality of what the platform is expected
to do, but it is extendable [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. To facilitate the extension of
functionality, platforms include an interface that allows third
parties to develop apps that extend the functionality of the
platform [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. Platform owners concentrate on the development
of the platform core and boundary resources, leaving the
development of the actual applications in which end-users will
interact with the third-party software developers.
        </p>
        <p>
          Configurable software platforms inherit the properties of
software platforms but use the concept of configuration. The
word configure means “to arrange how something, such as a
computer system or software, is organized, so that it can be used
for a particular task”[
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. Thus, configurable software provides
end-users with possibilities to ‘configure’ them to fit the
endusers’ needs without custom programming. Configurable
software platforms achieve this by including one or more
configuration utilities that expose the application framework,
such that end-users may re-configure the application for any
purpose. Application frameworks provide a standard structure
through which graphical user interface (GUI) elements can be
created as they define the underlying code structure of the
application in advance. The application framework takes all the
complexities of interfacing with the platform core. In
configurable platforms, the importance of making user interface
components interactive, usable and flexible cannot be
overlooked as it affects users’ innovations and design processes
through the platform [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>B. Challenges with Configurable software platforms</title>
        <p>
          Despite the increasing use of configurable software
platforms, there are several challenges. One such challenge is
platform architecture design [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. A good platform
architecture needs to have four desirable properties namely
simplicity, resilience, maintainability and evolvability. But in
balancing these properties there are always tradeoffs as some
properties are negatively correlated whereby increasing one
property decreases another property [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
        </p>
        <p>
          Another challenge with configurable software is the process
of testing [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. On top of non-configurable software testing
challenges that exist like test case generation, test case selection,
and test case prioritization, configurable software platforms add
to the list the challenge of testing all possible configurations of
the system [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. Another challenge is the actual development of
the software platform to satisfy more than one stakeholder
requirement at the same time and uncovering the potential
configuration for the software platform to satisfy requirements
[
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. Literature has also outlined software quality as another
challenge. Software developers cannot always conduct all
quality assurance to each possible configuration that users might
come up with [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
        </p>
        <p>
          Another key challenge associated with configurable
software platforms is that they can be complex and users may
experience various usability challenges which may affect their
productivity [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. In turn, the complexity and interface
design issues in configurable software platforms may also
negatively impact user experiences for those working with such
platforms [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ], [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. To enhance designers’ experiences in
working with configurable software platforms researchers must
continue to investigate and correct usability challenges
associated with various configurable software platforms [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ].
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>C. Software architecture and software usability</title>
        <p>
          ISO/IEC 9126-1 defines usability as the capability of a
software product to be understood, learned, used and be
attractive to the user, when used under specified conditions.
Usability is a core aspect of the system development process to
improve and enhance system facilities and to satisfy users' needs
and necessities. Usability confirms if a software product has
good utility, is efficient, effective, safe, easy to learn, easy to
remember, easy to use and to evaluate and provides job
satisfaction to the users. Adopting these aspects in the system
development process, including the sustainable design will
measure and accomplish users' goals and tasks by using a
specific technology [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ].
        </p>
        <p>
          Software architecture is defined as a conceptual blueprint
that describes how the ecosystem is partitioned into a relatively
stable platform and a complementary set of modules that are
encouraged to vary, and the design rules binding on both [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
Until the late ’90s, software usability and architecture were
taken as separate entities. As such, software usability only
focused on the presentation of interfaces elements and
functionality which resulted in architecture designers giving it a
blind eye when designing software architecture [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. As more
research was conducted on software usability, it was found out
that many usability concerns reach deeply into the systems
architectural design [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ].
        </p>
        <p>
          Since the architecture is the blueprint for the software which
is to be developed, a lack of usability considerations at design
time may require extensive and costly re-architecting of
software systems, should usability issues be discovered during
use[
          <xref ref-type="bibr" rid="ref24">24</xref>
          ], [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. When this happens, projects often cannot afford
the additional cost and ship products that are not as usable as
they could be [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. Examples of usability requirements that are
affected by the architecture include the availability of shortcuts,
form field validation and recovery from failure.
        </p>
        <p>II.</p>
        <p>METHODOLOGY</p>
        <p>The research was conceptualised into three stages. The first
stage was usability studies for DHIS2 followed by
experimentation with Sketch2Code and Commcare. The final
stage was prototyping and evaluation.</p>
      </sec>
      <sec id="sec-2-4">
        <title>A. Process 1 - Usability Evaluation</title>
        <p>The research process involved usability studies with 11 users
from five organisations who actively use DHIS2. The study
participants were required to design a custom data entry form
for an HIV Testing and Counselling Combined Quarterly
Report. This task was to be accomplished using the DHIS2
custom form editor as shown in Figure II-1.</p>
        <p>Study participants were split into two groups (first-time
users and experienced users) based on their proficiency in using
the DHIS2 custom form editor. The group of first-time users
comprised DHIS2 developers or implementers who had not used
DHIS2 custom form editor before. Those who had used the
editor before were grouped as “experienced users”. From the 11
respondents, 6 were experienced users while the remaining 5
were first-time users. Each group was assigned similar tasks to
accomplish (see TABLE I).</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Create Table with</title>
      <p>rows for input
fields and labels
Add the
corresponding data
element in each cell
Styling form</p>
    </sec>
    <sec id="sec-4">
      <title>Create a table on each</title>
      <p>section to hold the data
elements and input fields
Add form labels for data
elements
5 Attach the data elements
to each form label
6 Format the cell field to
have the same width and
height</p>
      <p>Data were collected using video recordings, observations
and interviews. 11 videos were recorded from which data on
usability metrics were extracted. The following data were
collected: time taken to complete a specified task by a specific
designer (in seconds), the number of errors committed during
the process, the number of tasks completed by each designer,
most used functionalities through the different icons which were
used frequently. Structured interviews were also conducted
based on Nielsen’s 10 heuristics. Notes were taken while
observing how the study participants were designing the forms</p>
      <sec id="sec-4-1">
        <title>B. Process 2 - experimentation with Sketch2Code and</title>
      </sec>
      <sec id="sec-4-2">
        <title>Commcare</title>
        <p>This step was carried out to explore other form editing
applications. Two applications were chosen: Microsoft
Sketch2Code, and CommCare.</p>
        <p>
          Microsoft Sketch2Code is a solution from Microsoft which
uses (AI) to transform hand-drawn user interfaces sketches to
valid HTML mark-up code. Sketch2Code brought a new
dimension into the research as it involved the use of artificial
intelligence which is one of the fields in Computer Science
whose applications cannot be overlooked as it has revolutionised
the way things are done [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ]. Regarding Sketch2Code, the first
author conducted experiments with three participants, who were
required to design part of the HIV Testing and Counselling
Combined Report. On top of the three software developers,
software and user manuals (Documentation) were used to get
insights into the software. These included Sketch2Code Lab
(Online Learning resource on how to use Azure Custom Vision
for Sketch2Code.
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>1) Sketch2Code Sketching process</title>
        <p>Before testing with the users, the first author did a sample
test of Sketch2Code with the form fields that are on the HIV
Testing and Counselling Combined Quarterly Site Report. The
first trial started with scanning the form in use to picture format.
The scanned copy lost some quality as compared to the original
copy. After searching on the internet for a tool that could convert
a PDF to an image (.jpg), SmallPDF was found which is an
online tool used to convert files into different formats without
losing quality. When the generated form was run on the
Sketch2Code, the result was weird as the model could not
recognise most of the form features from the copy created due
to a couple of factors including conformity with the structure of
the copy with Sketch2Code.</p>
        <p>To experiment with the users, the following procedure was
followed. The first step was to enquire from users on how they
design their data collection forms for different applications. The
next step was to explain how they could use Sketch2Code to
come up with digital prototypes from paper sketches. This
involved outlining how they could design the paper sketches to
conform to the structure of Sketch2Code.</p>
      </sec>
      <sec id="sec-4-4">
        <title>2) CommCare Evaluation Process</title>
        <p>CommCare consists of two components namely CommCare
Mobile and CommCare HQ. CommCare Mobile is a
mobilebased portion of CommCare used for data collection and service
delivery. CommCare Mobile can be used on a phone or tablet
and, in rare instances, through a computer. Through CommCare
Mobile, a user can access a mobile application. While
CommCare HQ is a website that is used for application
management and reporting. Through the CommCare HQ
website, users can design applications, access data, and manage
mobile users. CommCare HQ receives the data submitted by
frontline workers using CommCare Mobile.</p>
        <p>The evaluation of CommCare was done by designing a
similar form to which was designed in DHIS2.</p>
      </sec>
      <sec id="sec-4-5">
        <title>C. Process 3 – Prototyping and Evaluation</title>
        <p>For the third stage of the study, three designers were
involved of which two were from one organisation. The three
prototyped the following: Resizing table rows columns and
input fields; and grouping icons on the menu. First, the study
participants were asked to design their solutions using paper
(Sketches). From their designs, questions were asked on the
rationale for their proposed design. From the discussions that
ensued, challenges were noted and similar implementations in
other applications were researched to deepen our understanding
of how we could address noted challenges. For example, on
table designing an example of inserting tables in Google Docs
was used.</p>
      </sec>
      <sec id="sec-4-6">
        <title>D. Additional Data collection</title>
        <p>For all the platforms, the study also reviewed documentation
and feedback from user communities for the three platforms.
The focus in the documentation was on how the software is
designed, its architecture, software licence as well as user
manuals.</p>
        <p>III.</p>
        <p>RESULTS</p>
        <p>The research findings are presented in three sections based
on the three research process phase which were followed: Part 1
- Usability evaluation, Part 2 - experimentation with
Sketch2Code and Commcare and Part 3 – Prototyping and
Evaluation</p>
      </sec>
      <sec id="sec-4-7">
        <title>A. Part 1 - Usability evaluation</title>
      </sec>
      <sec id="sec-4-8">
        <title>1) Formatting Forms in DHIS2 CKEditor</title>
        <p>It was found that the editor did not completely support form
styling, at times requiring designers to manually edit the actual
source code of forms they had designed. This was done by
clicking the ‘source’ option on the CKEditor menu. From the
source code, designers could edit wherever they wanted to and
the changes would then reflect on the forms designed. It should
be noted that editing source code requires someone to have a
computer programming background which is against the core
principle of configurability, where the goal is that designers
should create their solutions on using a configurable platform
without the need for programming skills.</p>
      </sec>
      <sec id="sec-4-9">
        <title>2) Challenges with Table Dimensions</title>
        <p>It was found out that tables had an auto fixed width by
default, which could be changed by specifying the size in pixels
after right-clicking a table. When one wanted to add a data
element to a specific cell in a row, other cells in the row shrunk
in size, which made it difficult for designers to select shrunk
cells. Based on experience working with other editors, designers
tried to increase the width and height by clicking and dragging
the cell borders, but to their surprise, nothing happened.</p>
      </sec>
      <sec id="sec-4-10">
        <title>3) Formatting forms</title>
        <p>To circumvent form editing limitations such as
abovementioned, some designers reported that they use Microsoft
Excel or LibreOffice Calc spreadsheet applications to design
forms, after which they copy and paste the designs in DHIS2’s
CKEditor. The rationale for choosing these applications was that
they offer the flexibility to merge cells, hide columns, resize cell
width and height.</p>
      </sec>
      <sec id="sec-4-11">
        <title>B. Part 2 – Comparisons between different configurable platforms that aid inform design</title>
        <p>This section presents findings on how the three selected
configurable platforms compare in aiding form designing. These
three tools include DHIS2, Sketch2Code and CommCare. A
comparison was done in terms of design flexibility, software
licensing, available functionality and complexity of
technologies in use.</p>
      </sec>
      <sec id="sec-4-12">
        <title>1) Findings on Sketch2Code</title>
        <p>Most of the time when software developers want to design
data entry forms, the first steps involve designing the form on
paper as it helps them to discuss and gather requirements as well
as agree on the design before they start the actual development.
Then they write HTML (for structure) and CSS (styling)) code
as a way of translating the agreed paper sketches into first digital
prototypes of the form. When transforming paper sketches with
the AI different results were produced. Going through each
generated output, it had a well-defined HTML structure
(elements, attributes) and bootstrap 4, a CSS framework was
added as well to the file. Figure III-1 shows a paper sketch and
an HTML form generated by Sketch2Code. During the
designing and testing process three constraints were noted:

</p>
        <p>The image quality of sketches affected the result of
sketches generated by Sketch2Code.</p>
        <p>The environment in which pictures of sketches were
taken affected the quality of sketches (lighting, shadows,
etc.).</p>
        <p>Sketch2Code has its defined structure of icons and
options which it can recognise, implying when designing
sketches, designers had to conform to that standard
syntax. It was noted that if the sketches did not conform
to the standards one would get undesired results</p>
        <sec id="sec-4-12-1">
          <title>Paper Sketch</title>
        </sec>
      </sec>
      <sec id="sec-4-13">
        <title>Sketch2Code</title>
        <sec id="sec-4-13-1">
          <title>HTML Form</title>
          <p>A notable positive aspect with Sketch2Code was that HTML
source code generated by the platform could be imported into
the DHIS2 CKEditor, created largely well-structured forms.</p>
        </sec>
      </sec>
      <sec id="sec-4-14">
        <title>2) Form Designing Process in CommCare</title>
        <p>As has been outlined in the section above, to design the form
for data collection one uses the CommCare HQ app. One needs
to register first before they can create their application. To create
a form, one has to specify an application name and whether they
want to collect data as a survey (Collect data once) or as a Case
list (Track items over time). After selecting one’s preference,
one can add questions to their survey or case list.</p>
        <p>When adding a question one needs to specify the datatype of
the values that will be collected on a specific data element and
those options are presented when ones click on the Add
Question button. After selecting a preferred data type, one is
required to fill in details for the Display Text/Label, Question
ID and indicate whether the question is mandatory or not. To the
right of the designing window, is a phone simulator where
designers can log in and test the look and feel of the form being
designed.</p>
      </sec>
      <sec id="sec-4-15">
        <title>3) CommCare vs DHIS2</title>
        <p>Much as both platforms are used for creating and designing
data entry forms, there are differences in terms of how they
handle some activities. The differences are on how one can
design a form on both platforms, the target devices for the
designed forms and preview function.</p>
        <p>
          When creating a data entry form in DHIS2 one has to go
through the maintenance app, to create a data element and then
create a data set, after which they can proceed with designing a
form. Thus to get to the point of designing a form, one has to go
through three app interfaces. In Commcare, everything is done
within the same window. Literature shows that presenting data
and information on one page increases systems efficiency [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ].
        </p>
        <p>The target device for the final usage of the form for
CommCare is a mobile phone which has limited screen size for
while DHIS2 custom forms are rendered only on a computer and
not on a mobile application which renders only default forms.
As such the focus when designing in CommCare is the order in
which the variables will appear and the logic behind. For
DHIS2, the designer often designs custom forms with the
thought that the forms will be used on a computer with a large
screen and it has to be presented on a single window.</p>
        <p>Further to the above, in CommCare one can easily preview
the form being designed using the phone simulator and test the
logic and the interaction before you publish it (see Figure III-2).
DHIS2 has the preview option but it does not give the look and
feel of the final product and you cannot add data to it. The only
way to see what you have done if they work is to save it and go
to the Data Entry app to see the changes.</p>
      </sec>
      <sec id="sec-4-16">
        <title>C. Part 3 - Prototyping and Evaluation</title>
        <p>After looking at the different tools for designing data entry
forms, the first author came up with prototypes to discuss with
designers as a way of designing with users. The focus was on
the following tasks: resizing rows, columns and input fields,
dragging and dropping data elements and grouping of icons on
the menu were prototyped. Both paper and software prototypes
were created on this stage.</p>
      </sec>
      <sec id="sec-4-17">
        <title>1) Paper Prototypes</title>
        <p>Resizing rows, columns and input fields and grouping icons
on the menu were paper prototyped.</p>
      </sec>
      <sec id="sec-4-18">
        <title>a) Resizing rows, columns and input fields</title>
        <p>Most of the challenges which are faced with the DHIS
CKEditor editor are to do with form formatting. For example, to
reduce or increase cell width, designers have to go to the source
code and add styling to the code. When asked on how this can
be implemented, two solutions were brought forward, the first
one was to allow users to edit both the height and width of a cell.
While the other was of the view to resize the width only as there
are rare cases in which they edit the height of rows, columns or
input fields.</p>
        <p>b)</p>
      </sec>
      <sec id="sec-4-19">
        <title>Group icons on the menu</title>
        <p>On this part, different options on how to present the grouping
of our menu icons were presented as categories. Presentation of
menu options as icons was preferred by everyone with a
suggestion to display tooltips on the icons when one hovers over
an icon.</p>
      </sec>
      <sec id="sec-4-20">
        <title>2) Software Prototype</title>
        <p>After the above experiments, a software prototype was
developed. On the menu, most of the icons were removed to only
remain with those that are applicable to form designing to
maintain a minimalist design and not to clutter the screen with
unused components.</p>
        <p>As a way of removing confusion in the handling of rows and
columns, the insertion of tables was implemented similar to
most word processors like Google Docs, Microsoft word where
there is a visual representation when inserting a table. Instead of
entering the number of rows and columns, the designer hovers
over graphics which symbolise a table with rows and columns.</p>
        <p>Another element that was developed was the drag and drop
functionality. In this solution, the designer does not have to type
the form field name as it was witnessed during the usability
studies. This solution automatically picks the data element name
which was defined in DHIS2 as the default name and provides
the possibility of editing it. This reduces the time spent in
entering the form labels when creating the custom forms.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>DISCUSSION</title>
      <sec id="sec-5-1">
        <title>A. Enabling factors of usability</title>
        <p>
          Usability is defined as the degree of a product's (in this case
a software application) potential to accomplish the goals of the
user [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ]. It is also defined as the ease of use and learnability of
application software for the end-user [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. Relating these two
definitions to how designers designed the forms in DHIS2, the
available interface design elements made the editor usable as all
the designers were able to achieve the goal of designing the
form. The built-in capabilities of the editor enabled designers to
customise the forms which agree with [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ] and [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ] findings on
the extent to which DHIS2 allows customisation flexibility as an
enabling factor.
        </p>
        <p>In the software platforms that were investigated, HTML +
CSS code generated in Sketch2Code when used in DHIS2 editor
was able to create a structured form similar to the one generated
in Sketch2Code. Also, experienced designers reported using
other software to design forms like Microsoft Excel, Google
sheets to design form and only to paste the designed forms into
DHIS2. These different workarounds attest to Li's (2018)
findings that the existence of a workaround happens when the
technical design fails to meet established work routine and
contextual conditions as DHIS2 custom form editor has design
flaws.</p>
      </sec>
      <sec id="sec-5-2">
        <title>B. Constraining factors of usability</title>
        <p>
          The usability of the DHIS2 custom form editor application
was negatively affected through limited functionality that
different the editor provided. In a configurable platform, the goal
is to equip the designer with all tools which will enable them to
create a solution without the need for a software developer [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ].
DHIS2 custom form editor was not able to provide all the
required functionality on the user interface like changing cell
width as such designers were forced to change by specifying
pixels which was challenging to designers who do not have a
programming background. This agrees with the findings of [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ]
where he pointed out that the DHIS2 custom form editor
provides a minimum fit between the system interface and the
desired forms due to the limited functionality of the editor. In
configurable platforms, users are supposed to create applications
from the resources that are available on the user interface
without having to twerk the source code to get desired results.
This usability challenge could be argued to stem from the
constraints of software architecture design
        </p>
        <p>
          Still on architecture, Sketch2Code and DHIS2 custom form
editor provide a set of predefined functions or constructs which
the designer chooses when designing. Thus, if the structure of
the form field does not conform to the predefined design the
designer will have to redesign the form which frustrates the user
and affects productivity [
          <xref ref-type="bibr" rid="ref36">36</xref>
          ]. Available functionality in the form
design editors centres on the assumption that the designer has a
programming background as witnessed in DHIS2 where
technical terms are used as well as the need for writing code to
tweak form User Interface. In Sketch2Code also, the whole
process assumes that the one doing the design has a
programming background.
        </p>
      </sec>
      <sec id="sec-5-3">
        <title>C. Software architecture design in shaping usability</title>
        <p>
          Software Architecture specifies how a software system
should be organized and the overall structure of that system. It
identifies the main structural components in a system and the
relationships between them [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
      </sec>
      <sec id="sec-5-4">
        <title>1) Cross-platform compatibility</title>
        <p>Cross-platform compatibility focuses on developing an
application/system which can work seamlessly across other
platforms. The capability of cross-platform compatibility is
dictated in software architecture as it provides the constraints
and enablers for compatibility. DHIS2 allowed elements defined
in other platforms to run inside it due to the flexibility of the
architecture in providing cross-platform compatibility. This
enhances productivity among designers as they can still achieve
their goal of designing a form in DHIS2 for data collection even
though they have to use different platforms and integrate the
results.</p>
      </sec>
      <sec id="sec-5-5">
        <title>2) Predefining elements</title>
        <p>Meta-design is focused on objectives, techniques, and
processes that allow users to act as designers. As such the
software architecture should provide constructs on which
designers can design their innovative solutions. CommCare
provides a predefined list of elements as input fields. While in
DHIS2, one does not specify the type of input field that one
wants when creating a form, it is picked automatically based on
how the data element was defined.</p>
      </sec>
      <sec id="sec-5-6">
        <title>3) Boundary resources</title>
        <p>
          Boundary resources provide mechanisms on how software
application developers can extend functionality and
improvements on existing applications. DHIS2 has an API that
gives access to resources within the platform core. The
architecture provides flexibility for customisation which further
echoes what literature says on how the platform architecture
shapes usability through provision on room for customisation
[
          <xref ref-type="bibr" rid="ref35">35</xref>
          ], [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ]. This enabling factor enabled the research to come up
with a prototype. The created prototype used the API to get data
elements from DHIS2. The data element name was
automatically added to the form as a label when a specified data
element was selected in the designed editor. This improved the
time taken to design the forms as with the built-in CKEditor
designers have to rewrite names of data elements or form fields
on form designs, instead of picking the default name which was
given to the data element as it was created.
        </p>
        <p>Software architecture affects the usability of the software.
Cross-platform compatibility provides users with the flexibility
of achieving their goals regardless of the platform they are
working on provided that what they will design will also run on
other platforms. Also, the availability of boundary resources
encourages development and innovation beyond a configurable
platform’s core developers. As such different software
developers can create workarounds on how they can improve
usability through apps and functionalities which can be used by
designers thereby enhancing the usability of the platform.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S. W.</given-names>
            <surname>Zhang</surname>
          </string-name>
          and
          <string-name>
            <given-names>Z. H.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <article-title>'A Configurable Platform of Application System and its End-User-Oriented Configuration-Developing Pattern'</article-title>
          ,
          <source>AMR</source>
          , vol.
          <volume>219</volume>
          -
          <issue>220</issue>
          , pp.
          <fpage>1415</fpage>
          -
          <lpage>1418</lpage>
          , Mar.
          <year>2011</year>
          , doi: 10.4028/www.scientific.net/AMR.219-
          <fpage>220</fpage>
          .
          <fpage>1415</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Toman</surname>
          </string-name>
          , '
          <article-title>Learning to Adapt: Analyses for Configurable Software'</article-title>
          , University of Washington,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Misaka</surname>
          </string-name>
          , '
          <article-title>Requirement analysis technique for configurable platform : case study'</article-title>
          ,
          <source>Master of Applied Science</source>
          , Carleton University, Ottawa, Ontario,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Carr</surname>
          </string-name>
          , '
          <article-title>Configurable software solutions- Change is good</article-title>
          , right?',
          <string-name>
            <surname>Locus</surname>
            <given-names>Technologies</given-names>
          </string-name>
          , Aug.
          <volume>25</volume>
          ,
          <year>2016</year>
          . https://locustec.com/blog/configurablesoftware-solutions
          <article-title>-change-good-right/ (accessed Apr</article-title>
          .
          <volume>22</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>L. P.</given-names>
            <surname>Herman</surname>
          </string-name>
          , '
          <article-title>Usability and use documentation in a health information system: The case of District Health Information System 2 in Malawi'</article-title>
          , University of Oslo,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>L.</given-names>
            <surname>Battle</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.</given-names>
            <surname>Chessman</surname>
          </string-name>
          , 'Designing Configurable and Customisable Application', presented at the UPA Conference, Jun.
          <volume>06</volume>
          ,
          <year>2012</year>
          , Accessed: Aug.
          <volume>27</volume>
          ,
          <year>2019</year>
          . [Online]. Available: https://www.designforcontext.com/insights/designing
          <article-title>-configurable-andcustomizable-applications.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fischer</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.</given-names>
            <surname>Scharff</surname>
          </string-name>
          , '
          <article-title>Meta-design: design for designers'</article-title>
          ,
          <source>in Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS '00</source>
          , New York City, New York, United States,
          <year>2000</year>
          , pp.
          <fpage>396</fpage>
          -
          <lpage>405</lpage>
          , doi: 10.1145/347642.347798.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tiwana</surname>
          </string-name>
          , Platform Ecosystems Aligning Architecture, Governance, and
          <string-name>
            <surname>Strategy</surname>
          </string-name>
          . Elsevier,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J.</given-names>
            <surname>Morrison</surname>
          </string-name>
          , 'Interface Design &amp; Usability', netzstrategen,
          <source>Nov. 22</source>
          ,
          <year>2018</year>
          . https://netzstrategen.com
          <article-title>/koennen/user-experience/interface-designusability (accessed Apr</article-title>
          .
          <volume>07</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>B.</given-names>
            <surname>Birch</surname>
          </string-name>
          , '
          <article-title>10 principles that form my user interface design strategy', Together Incredible | Improve the digital experience</article-title>
          ,
          <source>Jan. 03</source>
          ,
          <year>2019</year>
          . https://togetherincredible.com/10-principles
          <article-title>-that-form-my-user-interfacedesign-strategy/ (accessed Apr</article-title>
          .
          <volume>22</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Dimagi</surname>
          </string-name>
          , '
          <article-title>CommCare by Dimagi | Data Collection App'</article-title>
          ,
          <year>2019</year>
          . https://www.dimagi.com/commcare/ (accessed Jun.
          <volume>23</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <fpage>dhis2</fpage>
          , 'Overview',
          <source>Jan. 01</source>
          ,
          <year>2018</year>
          . https://www.dhis2.org/overview (accessed
          <source>May 20</source>
          ,
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>DHIS2</given-names>
            <surname>Documentation Team</surname>
          </string-name>
          , 'DHIS2 Implementer guide',
          <source>Aug. 23</source>
          ,
          <year>2018</year>
          . https://docs.dhis2.
          <source>org/2</source>
          .30/en/implementer/html/dhis2_implementation_ guide_full.
          <source>html#d0e2872 (accessed Aug</source>
          .
          <volume>23</volume>
          ,
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Li</surname>
          </string-name>
          , '
          <article-title>Utilising the Space for User Participation'</article-title>
          , University of Oslo,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Ghazawneh</surname>
          </string-name>
          and
          <string-name>
            <given-names>O.</given-names>
            <surname>Henfridsson</surname>
          </string-name>
          , '
          <article-title>Balancing platform control and external contribution in third-party development: the boundary resources model: Control and contribution in third-party development'</article-title>
          ,
          <source>Information Systems Journal</source>
          , vol.
          <volume>23</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>173</fpage>
          -
          <lpage>192</lpage>
          , Mar.
          <year>2013</year>
          , doi: 10.1111/j.1365-
          <fpage>2575</fpage>
          .
          <year>2012</year>
          .
          <volume>00406</volume>
          .x.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16] 'CONFIGURE | meaning in the Cambridge English Dictionary'. https://dictionary.cambridge.org/dictionary/english/configure (accessed
          <year>Apr</year>
          .
          <volume>22</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tiwana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Konsynski</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Bush</surname>
          </string-name>
          , 'Coevolution of Platform Architecture, Governance, and Environmental Dynamics',
          <source>Information Systems Research</source>
          , vol.
          <volume>21</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>675</fpage>
          -
          <lpage>687</lpage>
          , Dec.
          <year>2010</year>
          , doi: 10.1287/isre.1100.0323.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tiwana</surname>
          </string-name>
          , '
          <article-title>Platform Architecture - an overview | ScienceDirect Topics'</article-title>
          ,
          <year>2014</year>
          . https://www.sciencedirect.com/topics/computer-science/platformarchitecture (accessed Oct.
          <volume>30</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>X.</given-names>
            <surname>Qu</surname>
          </string-name>
          , '
          <article-title>Testing of Configurable Systems'</article-title>
          , in Advances in Computers, vol.
          <volume>89</volume>
          ,
          <string-name>
            <surname>Elsevier</surname>
          </string-name>
          ,
          <year>2013</year>
          , pp.
          <fpage>141</fpage>
          -
          <lpage>162</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>M.</given-names>
            <surname>Große-Rhode</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Hilbrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mann</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Weißleder</surname>
          </string-name>
          , '
          <article-title>Achieving Quality in Customer-Configurable Products'</article-title>
          ,
          <source>in Relating System Quality and Software Architecture</source>
          , Elsevier,
          <year>2014</year>
          , pp.
          <fpage>233</fpage>
          -
          <lpage>261</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fischer</surname>
          </string-name>
          , '
          <article-title>Symmetry of ignorance, social creativity, and meta-design'</article-title>
          , Elsevier Science
          <string-name>
            <surname>B.V.</surname>
          </string-name>
          , vol.
          <volume>13</volume>
          , no.
          <issue>7-8</issue>
          , p.
          <fpage>5</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>M. de Reuver</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Sørensen</surname>
          </string-name>
          , and R. C. Basole, '
          <article-title>The Digital Platform: A Research Agenda'</article-title>
          ,
          <source>Journal of Information Technology</source>
          , vol.
          <volume>33</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>124</fpage>
          -
          <lpage>135</lpage>
          ,
          <year>2017</year>
          , doi: 10.1057/s41265-016-0033-3.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>H. M. K. Abdoasslam</surname>
          </string-name>
          , '
          <article-title>Measuring Usability For Application Software Using The Quality In Use Integration Measurement Model'</article-title>
          ,
          <source>Universiti Tun Hussein Onn, Malaysia</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>B. E. John and L.</given-names>
            <surname>Bass</surname>
          </string-name>
          , '
          <article-title>Usability and software architecture'</article-title>
          ,
          <source>Behaviour &amp; Information Technology</source>
          , vol.
          <volume>20</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>329</fpage>
          -
          <lpage>338</lpage>
          , Jan.
          <year>2001</year>
          , doi: 10.1080/01449290110081686.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>I. Sommerville</surname>
          </string-name>
          , Software Engineering, 10th ed.
          <source>England: Pearson Education Limited</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            B. E. John,
            <given-names>N.</given-names>
            <surname>Juristo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Bass</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Sanchez-Segura</surname>
          </string-name>
          , 'Avoiding “
          <article-title>We can't change THAT!”: Software Architecture</article-title>
          &amp; Usability', p.
          <fpage>104</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>R.</given-names>
            <surname>Khanna</surname>
          </string-name>
          , '
          <article-title>How is Artificial Intelligence changing the Manufacturing Industry in</article-title>
          <year>2018</year>
          ?', Ishir, Jul.
          <volume>05</volume>
          ,
          <year>2017</year>
          . https://www.ishir.com/blog/4654/artificial-intelligence
          <string-name>
            <surname>-</surname>
          </string-name>
          inmanufacturing-industry.
          <source>htm (accessed Apr</source>
          .
          <volume>19</volume>
          ,
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Microsoft</surname>
          </string-name>
          , 'Microsoft AI lab',
          <source>Aug. 23</source>
          ,
          <year>2018</year>
          . https://www.ailab.microsoft.com/ (accessed Nov.
          <volume>20</volume>
          ,
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>B.</given-names>
            <surname>Hellard</surname>
          </string-name>
          , '
          <article-title>Microsoft's AI-powered Sketch2Code builds websites and apps from drawings'</article-title>
          , Alphr, Aug.
          <volume>30</volume>
          ,
          <year>2018</year>
          . https://www.alphr.com/go/1009840 (accessed Nov.
          <volume>20</volume>
          ,
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>J.</given-names>
            <surname>Melin</surname>
          </string-name>
          , '
          <article-title>Making data useful to health workers by increasing usefulness and usability of their tools An experiment to increase health workers ability to detect symptoms of health issues with the District Health Information System (DHIS2) Tracker Capture Android app</article-title>
          ', University of Oslo, Norway,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>S.</given-names>
            <surname>Krug</surname>
          </string-name>
          ,
          <string-name>
            <surname>Don't Make</surname>
          </string-name>
          Me Think.
          <source>United States of America: New Riders</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <surname>Kirakowski</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>McNamara</surname>
            ,
            <given-names>N</given-names>
          </string-name>
          , '
          <article-title>Functionality, Usability, and User Experience: Three areas of Concern</article-title>
          .', Interactions, vol.
          <volume>13</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>26</fpage>
          -
          <lpage>28</lpage>
          , Nov.
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Ismanov</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Ni</surname>
          </string-name>
          , '
          <article-title>Patient information system for specialized newborn care units in Malawi Mobile implementation of DHIS2 Tracker in neonatal hospital wards'</article-title>
          , University of Oslo, Norway,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>N.</given-names>
            <surname>Hansson</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Vidhall</surname>
          </string-name>
          ,
          <article-title>Effects on performance and usability for crossplatform application development using React Native</article-title>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>M.</given-names>
            <surname>Wäljas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Segerståhl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Väänänen-Vainio-Mattila</surname>
          </string-name>
          , and H. OinasKukkonen, '
          <article-title>Cross-platform service user experience: a field study and an initial framework'</article-title>
          , p.
          <fpage>10</fpage>
          ,
          <string-name>
            <surname>Jul</surname>
          </string-name>
          .
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Gizaw</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Bygstad</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Nielsen</surname>
          </string-name>
          , 'Open generification',
          <source>Information Systems Journal</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>619</fpage>
          -
          <lpage>642</lpage>
          ,
          <year>2017</year>
          , doi: 10.1111/isj.12112.
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Majid</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. L. M.</given-names>
            <surname>Noor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. A. W.</given-names>
            <surname>Adnan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Mansor</surname>
          </string-name>
          , '
          <article-title>Users' Frustration and HCI in the Software Development Life Cycle'</article-title>
          ,
          <source>IJIPM</source>
          , vol.
          <volume>2</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>43</fpage>
          -
          <lpage>48</lpage>
          , Jan.
          <year>2011</year>
          , doi: 10.4156/ijipm.vol2.
          <year>issue1</year>
          .5.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>L. K.</given-names>
            <surname>Roland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. A.</given-names>
            <surname>Sanner</surname>
          </string-name>
          , and E. Monteiro, '
          <article-title>Architectures of large-scale participatory design'</article-title>
          ,
          <source>Scandinavian Journal of Information Systems</source>
          , vol.
          <volume>29</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>33</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>