<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Relevance of the cultural dimensions in affective- cognitive behavior during interaction with an intelligent tutoring system</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>N. Sofia Huerta-Pacheco</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Genaro Rebolledo-Mendez</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Victor Aguirre</string-name>
          <email>aguirre@itam.mx</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergio Hernandez-Gonzalez</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Erica Maria Lara-Muñoz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Statistics and Informatics, Universidad Veracruzana</institution>
          ,
          <country country="MX">Mexico</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Instituto Tecnológico de Alvarado</institution>
          ,
          <country country="MX">Mexico</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Statistics Department</institution>
          ,
          <addr-line>ITAM</addr-line>
          ,
          <country country="MX">Mexico</country>
        </aff>
      </contrib-group>
      <fpage>33</fpage>
      <lpage>40</lpage>
      <abstract>
        <p>Cultural Dimensions, as stipulated by different theoretical perspectives such as Hofstede's, are normally not considered to define student models. These cultural dimensions consist of traits that can be attributed to students and include both cognitive and affective characteristics. Some dimensions indicate students' ability to represent an effect in the affect which may be useful to predetermine affective models. This research project hypothesizes that students' cultural dimension may indicate affect tendency during the use of Intelligent Tutoring Systems (ITS). The methodology consisted of determining students' cultural dimensions, cognitive achievement, and analyzing affective responses (selfreported) when the student used the ITS on an individual way. The results suggested that there are affective behaviors associated to a Hofstede cultural dimension (Power distance index). The implications of these results are that some cultural characteristics may predict students' affective behaviors employing an ITS for mathematics. Additionally, affect models could be used to predefine affective-cognitive scaffolding.</p>
      </abstract>
      <kwd-group>
        <kwd>affective-cognitive states</kwd>
        <kwd>cultural dimensions</kwd>
        <kwd>intelligent tutoring systems</kwd>
        <kwd>secondary education</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1.1</p>
    </sec>
    <sec id="sec-2">
      <title>Introduction</title>
      <p>The technological tools are current elements that contribute to the teaching- learning
process of students at different educational levels, which are shown with contents of
topics specialized in some areas.</p>
      <p>These tools are designed so that users (students) have innovative elements,
however, when referring to the adaptation of the tools to the user, there are several problems
in the interaction, since they are not fully developed to adapt to the particular needs or
characteristics of each user [1].</p>
      <p>However, these reasons have not precluded several researches to identify some
relevant characteristics that impact on learning with technology such as collaboration [2],
cultural dimensions [3], learning styles [4], motivation [5, 6], affect [7–9] and
among others. The aim of this study is to analyze whether students’ cultural
dimensions are related to both affect and knowledge during interaction with the intelligent
tutoring system.</p>
      <p>In this research, we focus on individual student factors used in all the interaction
with an Intelligent Tutoring System (ITS) for mathematics when they acquire
knowledge about variables (numerical and categorical) and the way they represent them.
To do this, there are characteristics that are affected by the environment where the
student works in a learning process, such is the case of cultural dimensions. Since
students’ cultural dimensions traits lies in that teaching instructed in the classrooms
and the learning environment.</p>
      <p>In the association of affection and cognition, particularly, there are several studies
applied with technology [10–13], that allude that the affection presents predominant
tendencies in the learning process (negative, neutral and positive) [8], which can be
regulated for the student to acquire either greater or better knowledge.</p>
      <p>On the other hand, the importance of culture in education shows contrasts that impact
the cognitive process [14, 15]. Cultural dimensions are divided into five dimensions
described by Hofstede, these dimensions alone represent influential factors in society
as the Power distance, Uncertainty avoidance, Individuality, Masculinity and Long
term orientation [3, 16].</p>
      <p>In Mexico’s basic education system, it is considered that an environment
conducive to learning must indispensably contemplate the recognition of influential
physical, affective and social factors in cognitive achievements in an individual and group
manner [17], making relevant the study of the characteristics of the students, as well
as their behaviors in the classroom.</p>
      <p>Considering the above is done the following research question: What cultural
dimensions are present and how these influences the acquisition of knowledge and the affect
of students during the use of a ITS?
The research focuses on identifying associated cultural behaviors that give indication
to be able to define the students’ profiles, and thus provide elements considering their
cultural and affective characteristics during the interaction with an intelligent tutoring
system.
2</p>
    </sec>
    <sec id="sec-3">
      <title>Methodology</title>
      <p>This work was performed at the secondary school “Federal N. 2 Julio Zárate” in
Xalapa, Veracruz, Mexico for four days. It was considered to be a simple random
sampling (n=50 students) of five groups (N=110 students) in the first year on 2017 of
secondary school with 62% of female and 38% of male with an age range of 12 to 14
years old.</p>
      <p>The materials used consist of the intelligent tutoring system “Scooter tutor” [18, 19]
in the non-reactive version (without Scooter agent), the two isomorphic tests of
learning employed on similar experiments [18], the standardized questionnaires of cultural
dimensions [16], the self-report of the affective states, and props. The evaluation was
guided under the standards of the Belmont report [20].
Standardized learning tests are isomorphic measuring instruments designed to
evaluate students' knowledge of the development of scatter plots before and after
interaction with the intelligent tutoring system. To calculate the level of knowledge (test scores)
of students, points are obtained in percentage by standard terms of evaluation defined
by the system creator [18] and these tests measure the cognitive achievement in such
a way as to identify the increase obtained by the students. Achievement is calculated
with the following equation:</p>
      <p>Cognitive Achievement=Score of Post_test - Score of Pre_test
The registration of affective self-reports is given through a booklet, which presents
the five most relevant states in a learning situation with technology [8]. This is through
the issuance of student judgments about their affective status at intervals of every 8
minutes during the two sessions of interaction with the ITS. The records of affective
trials are composed of images with random faces (emoticons) referring to the states
of boredom, frustration, confusion, concentration and the absence of affec- tion of the
neutral state. The affective measure reported is given in terms of proportions of cases
through interaction, and they are distributed in negative (boredom and frustration),
neutral (absence of affection) and positive (confusion and concentration) tendencies.
Cultural dimensions test stated by Hofstede [3] employed in this research is obtained
through an adaptation of the instrument of the 1994 version [16], this consists of 20
items with five to six categories of ordinal scale type Likert. In addition, each item is
weighted in an equation per dimension providing a representative score of the level,
either low (Index&lt;=33 points), normal (33 points&gt;Index&lt;66 points), or high
(Index&gt;=66 points). These dimensions present different representations such as Power
distance that is defined as the extent to which the less powerful members of
community within a society expect and accept the power other person or Uncertainty
avoidance is as the extent to which members of community within a society feel threatened
by uncertain, unknown, ambiguous or unstructured situations. On the other hand, in
Individualism a person is expected to take care of himself and his immediate family,
just as Masculinity represents a society in which social roles of gender are clearly
different and Long-term orientation represents a society that encourages future re-
wardsoriented virtues, particularly adaptation, perseverance and savings.</p>
      <p>It is important to mention that this test does not present an adequate validation and
reliability [21], however, it is necessary to observe the internal structure by dimension
and the biases in the answers.</p>
      <p>The experimentation included the application of the tests and the interaction with the
ITS. There were four experimentation stages during the mathematics class.
1. Initial test: This stage consisted of an explanation of the topic “Scatter plots” (10
minutes), the first learning test (20 minutes) and other questionnaires (20 minutes)
in the classroom.
2. Interaction I: In this phase, the student first performed the interaction with the
intelligent tutoring system for 40 minutes in the media classroom and self-reported
affective states in interruptions during the lapse of 8 minutes.
3. Interaction II: In the same way that in the stage Interaction I, the student worked
with the intelligent tutoring system for 40 minutes in the media classroom and
selfreported affective states in interruptions during the lapse of 8 minutes.
4. Final test: The student was given the Post-test on a 20-minute period in the media
classroom, as well as the cultural dimensions test (15 minutes) and participants
were thanked for their participation in the research (5 minutes).
3</p>
    </sec>
    <sec id="sec-4">
      <title>Result</title>
      <p>The preliminary findings in the interaction with the intelligent tutoring system present
relevant characteristics to influence the affective-cognitive student behavior. It is
significant to mention that the analyzed information did not assume the assumption of
normality, the test score (pre-test and post-test) was measured in percentage points
and worked with affective tendencies (negative, neutral and positive) and the results
were assessed with nonparametric statistical techniques in R [22] and just considering
the cases of positive achievement (Cognitive Achievement &gt; 0).</p>
      <p>The comparisons (pre-test) between the five groups, showed no significant differences
(K−W chi−squared=3.64, p-value=0.45). However, all groups showed a high
proportion (more than 60%) of neutral affective states during the initial time of interaction
with the intelligent tutoring system. In addition, it was observed that all groups in the
performance showed 42.75 average proportion score of the positive affective state and
25.75 average score of the negative states and differences by group in the proportion
of affective tendencies.</p>
      <p>On the other hand, it was observed that only one dimension showed the existence
of significant difference (p-value&lt;0.05) between the groups of the Power distance (PDI),
showing that group 1 manifests a normal level (mean=34.0, sd=40.30) to differences of
the other groups (see Figure 1-A) and a general average lower (mean=2.9, sd=49.48)
than the all groups and much variation with respect to their average value. In addition,
high levels (Index&gt;=66 points) on average identified of Uncertainty avoidance (UAI),
Individualism (IDV) and Masculinity (MAS) and nor- mal average index in Long-term
orientation (LTO). (see Table 1)</p>
      <p>In the same way that significant differences were identified (p-value&lt;0.02) be- tween
the pre-test and post-test and not in the post-test by group (K−W chi−squared= 5.94,
pvalue=0.20). Moreover, the post-test had a significant association (rs=0.323,
pvalue=0.02) with the positive affective states, moreover the positive affect with Cultural
dimension of the Power distance index (rs=0.326, p-value=0.02).</p>
      <p>Nevertheless, it showed a significant difference per group related to the proportion of
positive affective states (K−W chi−squared=10.74, p-value=0.02), negative states
(K−W chi−squared=18.19, p-value=0.001), neutral affective states (K−W
chi−squared=11.75, p-value=0.01) and the Power distance index (K−W
chi−squared=9.07, p-value=0.04), the results also presented that the some groups
with the lowest index (Index&lt;=33 points) for Power distances showed less
representation in the positive trend of affective states and only the group 2 high proportion of
negative trends. (see Figure 1)
A) Power distance index
B) Positive affective state
C) Neutral affective state
D) Negative affective state</p>
      <p>Figure 2 shows the Principal Component Analysis [23] represent 61.01% varia- tions
of the behavior of the affective states association with the Cultural dimension and
Learnings scores (pre and post-test), this identifies and confirms that the positive
affective trends (AE-Positive) are oriented to Power distance (PDI) and the post-test
presents a high association with the pre-test as well as with the Power distance index
and positive states. Finally, the negative tendencies (AE-Negative) do not present any
significant association with the learning scores when only considering students with a
cognitive achievement.</p>
    </sec>
    <sec id="sec-5">
      <title>Discussion</title>
      <p>This research project presents results suggesting different patterns of individual student’
behavior, which were observed during the use of educational technology (ITS) for
mathematics at the secondary level in Mexico. The exploration of independ- ent
characteristics (cultural dimensions, affect and cognitive achievement) is relevant
because it allows understanding the student profile in a preliminary way during the
learning process mediated with technology, contributing with information about the
cultural criteria of the student who is likely to affect the academic environment of
Mexican students.</p>
      <p>The results suggest that there are significant associations between the cultural
dimensions (Power distance index) and cognitive-affective states. This can be explained
as the positive affective behavior of students may be closely associated to power
distance in normal level to obtain higher score in the post-test.</p>
      <p>In particular, considering this dimension will allow Mexican students to
demonstrate positive states conducive to learning math issues by setting aside levels of
traditional academic hierarchy.</p>
      <p>However, it is important to mention that the affective measurement of students
during the use of technology can be considered as an exploratory measure of the
affection that the student presents according to his/her judgement, however, this requires
specialized metrics [19] or to measure awareness and regulation [10] of the same over
their states.</p>
      <p>As a future work, it is proposed to evaluate other characteristics that affect the
cognitive process in order to elicit a model of the user who is able to react to factors
that are not conducive to learning. This model will allow creating a motor of inference
that provides before the interaction of the students a profile to identify if these
requires the use of a common intelligent tutor system or one with affective elements of
regulation for to increase cognitive achievement and improve the interaction.
Acknowledgments. The first author acknowledges the financial support from the
Mexican Council of Science and Technology (CONACYT, Scholarship 421460) and
the third author gratefully acknowledges financial support from the Asociación
Mexicana de la Cultura, A. C. Mexico.
17.
18.
19.
20.
21.
22.
23.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>Learn Instr</source>
          <volume>29</volume>
          :
          <fpage>153</fpage>
          -170
          <string-name>
            <surname>Grawemeyer</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wollenschlaeger</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gutierrez</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holmes</surname>
            <given-names>W</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mavrikis</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poulovassilis</surname>
            <given-names>A</given-names>
          </string-name>
          (
          <year>2017</year>
          )
          <article-title>Using graph-based modelling to explore changes in students' affective states during exploratory learning tasks.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Eagle</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corbett</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stamper</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McLaren</surname>
            <given-names>BM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baker</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wagner</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>MacLaren</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mitchell</surname>
            <given-names>A</given-names>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>Predicting Individual Differences for Learner Modeling in Intelligent Tutors from Previous Learner Activities</article-title>
          .
          <source>In: Proc. 2016 Conf. User Model. Adapt. Pers</source>
          . pp
          <fpage>55</fpage>
          -
          <lpage>63</lpage>
          Hofstede G (
          <year>1986</year>
          )
          <article-title>Cultural differences in teaching and learning</article-title>
          .
          <source>Int J Intercult relations</source>
          <volume>10</volume>
          :
          <fpage>301</fpage>
          - 320
          <string-name>
            <surname>Eldridge</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cranston</surname>
            <given-names>N</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>Managing transnational education: does national culture really matter</article-title>
          ?
          <source>J High Educ Policy Manag</source>
          <volume>31</volume>
          :
          <fpage>67</fpage>
          -79 Hofstede G (
          <year>1998</year>
          )
          <article-title>Attitudes, values and organizational culture: Disentangling the concepts</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <source>Organ Stud</source>
          <volume>19</volume>
          :
          <fpage>477</fpage>
          -
          <lpage>493</lpage>
          SEP (
          <year>2017</year>
          )
          <article-title>Modelo educativo para la educación obligatoria</article-title>
          .
          <source>México Baker RS</source>
          (
          <year>2005</year>
          )
          <article-title>Designing intelligent tutors that adapt to when students game the system</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          Carnegie Mellon University Pittsburgh Rodrigo MMT,
          <string-name>
            <surname>Baker</surname>
            <given-names>RSj</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agapito</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nabos</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Repalam</surname>
            <given-names>MC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reyes</surname>
            <given-names>SS</given-names>
          </string-name>
          , San Pedro MOCZ (
          <year>2012</year>
          )
          <article-title>The effects of an interactive software agent on student affective dynamics while using; an intelligent tutoring system</article-title>
          .
          <source>IEEE Trans Affect Comput</source>
          <volume>3</volume>
          :
          <fpage>224</fpage>
          -
          <lpage>236</lpage>
          Department of Health E and W (
          <year>2014</year>
          )
          <article-title>The Belmont Report</article-title>
          .
          <article-title>Ethical principles and guidelines for the protection of human subjects of research</article-title>
          .
          <source>J Am Coll Dent</source>
          <volume>81</volume>
          :4 Kruger
          <string-name>
            <given-names>T</given-names>
            ,
            <surname>Roodt</surname>
          </string-name>
          <string-name>
            <surname>G</surname>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>Hofstede's VSM-94 revisited: Is it reliable and valid?</article-title>
          <source>SA J Ind Psychol</source>
          <volume>29</volume>
          :
          <fpage>75</fpage>
          -82
          <string-name>
            <given-names>R</given-names>
            <surname>Development Core Team R (2011) R: A Language</surname>
          </string-name>
          and
          <article-title>Environment for Statistical Computing</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <source>R Found Stat Comput</source>
          <volume>1</volume>
          :409 Jolliffe
          <string-name>
            <surname>IT</surname>
          </string-name>
          (
          <year>1986</year>
          )
          <article-title>Principal component analysis and factor analysis</article-title>
          .
          <source>In: Princ. Compon. Anal.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          Springer, pp
          <fpage>115</fpage>
          -
          <lpage>128</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>