<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>methods for external cognitive load assessment in graphical user interfaces</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Paula Andrea Cesarino Vargas</string-name>
          <email>paulacesarino@hotmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Luis Eduardo Bautista Rojas</string-name>
          <email>luis.bautista@correo.uis.edu.co</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>María Fernanda Maradei García</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Industrial University of Santander</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Summary.Within the framework of the master's degree project in innovation and design, a research proposal is proposed that presents the integration of objective techniques to evaluate the cognitive load generated by the graphical user interface in an augmented reality environment, based on an experimental design unifactorial, cross-sectional, retrospective, at an explanatory level. This proposal is relevant as it will provide empirical evidence for the graphical user interface design process. It is expected, at the end of this project, to have a procedure manual for the evaluation of graphical user interfaces based on the level of external cognitive load.</p>
      </abstract>
      <kwd-group>
        <kwd>GUI</kwd>
        <kwd>Graphical user interface</kwd>
        <kwd>External cognitive load</kwd>
        <kwd>EEG</kwd>
        <kwd>eye tracking</kwd>
        <kwd>Augmente reality</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        With the fourth industrial revolution, technologies such as augmented reality (AR) have been
making headway in areas such as learning and skills training, given their ability to merge real and
virtual objects in practice environments and the ability to provide information in time. real to
apprentice (Akçayır &amp; Akçayır, 2017). Several studies have shown that cognitive overload can be
an important aspect of usability
        <xref ref-type="bibr" rid="ref1">(Adams, 2007)</xref>
        and augmented environments are likely to be
particularly sensitive to its effects.
      </p>
      <p>
        When a person is making use of an augmented environment, a series of cognitive processes are
triggered directly linked to that activity. The level of cognitive load is an indicator that could be used
to evaluate increased user-environment interaction. In the nineties, Sweller
        <xref ref-type="bibr" rid="ref9">(Sweller, 1994)</xref>
        proposed
the cognitive load theory (CLT), an instructional theory based on the knowledge of human cognitive
architecture and focused directly on the limitations of working memory and the automation of
longterm memory schemas. However, despite the fact that CLT is widely known from its scientific
theory, its measurement for instructional materials (especially in multimedia teaching) is mainly
based on indirect, subjective or both methods.
        <xref ref-type="bibr" rid="ref6">(Brunken et al., 2010)</xref>
        .
      </p>
      <p>This proposal focuses on the process of designing graphical user interfaces for augmented reality
environments, specifically in the evaluation phase of design alternatives. Focused on defining a
framework that allows the designer to objectively evaluate his interface from the level of extrinsic
cognitive load generated by the visual stimulus. The foregoing, through a cross-technique approach
of electroencephalography (EEG) and eye tracking, providing the designer with pertinent
information for the redefinition of the interfaces.</p>
      <sec id="sec-1-1">
        <title>1.1 Formulation of the problem</title>
        <p>
          The Cognitive Load (CC) can be defined as the total amount of mental activity processed,
consciously, at the moment in which the subject completes a task
          <xref ref-type="bibr" rid="ref8">(Paas et al., 2003)</xref>
          . However, not
all CC is the same type; There are three classes: a) intrinsic, b) extrinsic, and c) Germanic. Intrinsic
QC is related to the complexity of the task itself, depending on the conceptual difficulty of the
material and the skill of the learner to develop it; the extrinsic CC is responsible for contaminating
or saturating the information that is presented, thus affecting working memory; generally it relates
to multimedia materials or interfaces. Finally, Germanic CC is directly related to learning and the
processes of abstraction and information processing towards long-term memory.
          <xref ref-type="bibr" rid="ref9">(Sweller, 1994)</xref>
          .
        </p>
        <p>
          The measurement of external cognitive load continues to be a challenge, since this construct
cannot be measured directly, but rather requires the evaluation of dimensions related to it, which
are: mental load, mental effort and performance
          <xref ref-type="bibr" rid="ref4">(Andrade-Lotero, 2012)</xref>
          . Many augmented reality
applications involve tasks that require the use of a large amount of cognitive resources and since
users have limited them, if an evaluation is not carried out to verify that the graphical interface
design does not impose an external cognitive load on the user high, technology could add more
complexity and influence the learning process. However, conducting this assessment during
augmented reality experiences is especially complex, since learners are exposed to a large amount
of interaction.(Akçayir et al., 2016). An essential question in this study is whether there are valid,
reliable and practical methods that can measure external cognitive load in augmented reality
environments.
        </p>
        <p>In the literature, two different approaches are generally found for such evaluation: a) requesting
users to subjectively rate their perceived cognitive load or b) using objective measures, commonly
physiological measures. In this proposal, an objective magnitude that is robust, continuously
measurable and sensitive enough to solve the bad signal-to-noise ratio is sought.</p>
      </sec>
      <sec id="sec-1-2">
        <title>1.2 Justification</title>
        <p>
          As human-computer interaction (HCI) systems are becoming ubiquitous and used to perform critical
tasks in different domains, the need to measure the cognitive load caused by a purpose-designed
HCI system is becoming increasingly common. increasingly important in stages prior to
implementation
          <xref ref-type="bibr" rid="ref7">(Neville et al., 2005)</xref>
          . Although HCI evaluation methods have also advanced with
the evolution of systems and techniques, such as verbal reports, observations of task fulfillment,
concurrent verbalization, questionnaires, etc., they are being used to evaluate interactive systems for
their effectiveness and efficiency, however, there is still a shortage of methods that can directly
measure the cognitive load caused by the system.
        </p>
        <p>Current tools have allowed us to measure cognitive load from a weighted analysis; An interesting
observation is that although researchers are continually trying to find or develop secondary task and
physiological measures, the internal consistency of these measures requires further study. Especially
to determine the extrinsic cognitive load, referring to when the learner is interacting with a material
or interface whose design or execution has irrelevant elements that hinder the processes of both
construction and automation of schemes, which will allow the learning of complex concepts.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2 Methodological framework</title>
      <p>
        To carry out the development of the project, a methodology based on the methodological approach
of
        <xref ref-type="bibr" rid="ref5">(Blessing &amp; Chakrabarti, 2009)</xref>
        one of the popular models for design research; This method
belongs to the field of research in design engineering and consists of 4 stages: definition of criteria,
descriptive study I, prescriptive study and descriptive study II. Each of the objectives of the Design
Throught Research (DTR) phase
      </p>
      <p>It is expected, at the end of the development of this research work, to have a procedure manual
that describes the activities related to the evaluation of external cognitive load of graphical user
interfaces applying crossed techniques; This manual will have a chronological narrative that
systematically requires data capture, a guide for the treatment of electroencephalographic signals
and a list of metrics that differentiate the levels of external cognitive load resulting from its interface,
in this way, the designer will be able to evaluate objectively its design alternatives for augmented
reality environments and obtain the necessary information for its redefinition, if required.</p>
      <p>The above, based on the case study for the evaluation of external cognitive load of a prototype
for learning and training activities in an augmented environment, which allows to demonstrate the
significant improvement of the evaluation of cognitive load of each of the techniques separately.
compared to the application of integrated techniques.</p>
      <sec id="sec-2-1">
        <title>2.1 Research design</title>
        <p>This work is framed as an investigation through design, experimental, retrospective and
crosssectional at an explanatory level. The hypothesis proposed by the researcher affirms that multimodal
approaches that combine data from different sensors improve the specific evaluation of external
cognitive load caused by the stimulus in graphical user interfaces.</p>
        <p>To confirm the previous hypothesis, the development of an experiment with a unifactorial design
is proposed, in order to verify the values for the estimation of cognitive load from the frequency,
voltage and amplitude of the waves. This information will be acquired with the EMOTIV EPOC +
device, which allows us to recognize the report of performance metrics of stress, commitment and
concentration. On the other hand, for the analysis of the percentage of pupil dilation, the SMI eye
tracking device (SMI Eye Tracking Glasses SMI ETG) will be used; with the aim of verifying the
information obtained in the literature and determining the level of reliability of the evaluation
methods with respect to a subjective scale.</p>
        <p>The test will be carried out in person in a closed room with controlled lighting. The protocol
begins with the explanation of the experiment, and the signing of the informed consent. The user is
directed to a hair washing area in order to meet biosafety parameters and at the same time to control
the humidity of the scalp that will facilitate subsequent data collection. Once the washing is done,
the subject is positioned in front of the guide marks to start with the calibration of the SMI glasses,
the user must follow the marks presented; Afterwards, the EPOC + electroencephalograph will be
positioned and through the EMOTIV APP application, a quality of contact of the electrodes will be
established not lower than 95%, to finalize the assembly of equipment, the Hololens augmented
reality glasses will be positioned.</p>
        <p>For the analysis of results, the ordinal categorical variables will comply with a statistical analysis
based on contingency tables and frequency diagrams. Likewise, a comparison of samples will be
carried out to determine the significant differences between them, using the Chi-square test statistic
with a p-value &lt;0.05 to reject the null hypothesis of equality.</p>
        <p>In the case of continuous data, once the data has been obtained and filtered, it will be analyzed
descriptively through the SPSS statistical software where the internal behavior of the data is
analyzed from measures of central tendency and position, such as box plots and whiskers to establish
consistency in the data.</p>
        <p>Finally, the inferential analysis will be carried out, in this case, if the data are parametric, a mean
comparison study will be carried out using ANOVA as a test statistic and it will be considered that
there are significant differences for p-value &lt;0.05. For non-parametric data: The Kruskal-Wallis test
would be used initially to determine if there are differences between the groups and later a Wilcoxon
signed rank test to compare the two related samples.</p>
        <p>With the analysis of the data, it is expected to accept the established hypothesis that it supposes
an improvement in the specific evaluation of external cognitive load caused by the stimulus in
graphical user interfaces from the use of multimodal approaches.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Decision and stress: cognition and e-accessibility in the information workplace</article-title>
          .
          <source>Univ Access Inf Soc</source>
          ,
          <volume>5</volume>
          ,
          <fpage>363</fpage>
          -
          <lpage>379</lpage>
          . https://doi.org/10.1007/s10209-006-0061-9
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Akçayir</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akçayir</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , Pektaş,
          <string-name>
            <given-names>HM</given-names>
            , &amp;
            <surname>Ocak</surname>
          </string-name>
          , MA (
          <year>2016</year>
          ).
          <article-title>Augmented reality in science laboratories: The effects of augmented reality on university students' laboratory skills and attitudes toward science laboratories</article-title>
          .
          <source>Computers in Human Behavior</source>
          ,
          <volume>57</volume>
          ,
          <fpage>334</fpage>
          -
          <lpage>342</lpage>
          . https://doi.org/10.1016/j.chb.
          <year>2015</year>
          .
          <volume>12</volume>
          .054
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Akçayır</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Akçayır</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Advantages and challenges associated with augmented reality for education: A systematic review of the literature</article-title>
          .
          <source>Educational Research Review</source>
          ,
          <volume>20</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          . https://doi.org/10.1016/j.edurev.
          <year>2016</year>
          .
          <volume>11</volume>
          .002
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Andrade-Lotero</surname>
            ,
            <given-names>LA</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Cognitive load theory, design and multimedia learning: A state of the art</article-title>
          .
          <source>Magis: International Journal of Research in Education</source>
          ,
          <volume>5</volume>
          (
          <issue>10</issue>
          ),
          <fpage>75</fpage>
          -
          <lpage>92</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Blessing</surname>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chakrabarti</surname>
          </string-name>
          . (
          <year>2009</year>
          ).
          <article-title>DRM: A Design Research Methodology</article-title>
          .
          <source>In DRM, a Design Research Methodology</source>
          (pp.
          <fpage>11</fpage>
          -
          <lpage>42</lpage>
          ). Springer US. https://doi.org/https://doi.org/10.1007/978-1-
          <fpage>84882</fpage>
          -587-
          <issue>1</issue>
          _
          <fpage>2</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Brunken</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Plass,
          <string-name>
            <surname>JL</surname>
          </string-name>
          , Leutner,
          <string-name>
            <given-names>D.</given-names>
            , &amp;
            <surname>Brünken</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Direct Measurement of Cognitive Load in Multimedia Learning Direct Measurement of Cognitive Load in Multimedia Learning</article-title>
          .
          <source>Educational Psychologist</source>
          ,
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <fpage>53</fpage>
          -
          <lpage>61</lpage>
          . https://doi.org/https://doi.org/10.1207/S15326985EP3801_
          <fpage>7</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Neville</surname>
            ,
            <given-names>AS</given-names>
          </string-name>
          , Salmon,
          <string-name>
            <surname>PM</surname>
          </string-name>
          , Walker,
          <string-name>
            <surname>GH</surname>
          </string-name>
          , Baber,
          <string-name>
            <given-names>C.</given-names>
            , &amp;
            <surname>Jenkins</surname>
          </string-name>
          ,
          <string-name>
            <surname>DP</surname>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Human Factors Methods: A Practical Guide for Engineering</article-title>
          . In Ashgate Publishing (Ed.),
          <source>Angewandte Chemie International Edition (First Edit</source>
          , Vol.
          <volume>6</volume>
          ,
          <string-name>
            <surname>Issue</surname>
            <given-names>11</given-names>
          </string-name>
          , pp.
          <fpage>77</fpage>
          -
          <lpage>115</lpage>
          ). Taylor &amp; Francis.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Paas</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tuovinen</surname>
            ,
            <given-names>JE</given-names>
          </string-name>
          , Tabbers,
          <string-name>
            <surname>H.</surname>
          </string-name>
          , &amp; Van Gerven,
          <string-name>
            <surname>PWM</surname>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Cognitive load measurement as a means to advance cognitive load theory</article-title>
          .
          <source>Educational Psychologist</source>
          ,
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <fpage>63</fpage>
          -
          <lpage>71</lpage>
          . https://doi.org/10.1207/S15326985EP3801_
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Sweller</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>Cognitive load theory, learning difficulty, and instructional design</article-title>
          .
          <source>Learning and Instruction</source>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <fpage>295</fpage>
          -
          <lpage>312</lpage>
          . https://doi.org/10.1016/
          <fpage>0959</fpage>
          -
          <lpage>4752</lpage>
          (
          <issue>94</issue>
          )
          <fpage>90003</fpage>
          -
          <lpage>5</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>