<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Monitoring the impact of teacher's intervention in inquiry-based mathematics learning with the use of dynamic geometry</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Takeo Noda</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Takahiro Nakahara</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Masataka Kaneko</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Sangensha LLC.</institution>
          ,
          <addr-line>Chitose</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Toho University</institution>
          ,
          <addr-line>2-11-1 Miyama, Funabashi, 2748510</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this study, we analyze computer-aided inquiry-based mathematics learning. A Moodle plug-in associated with the dynamic geometry software CindyJS which can record finegrained log data of learners' manipulations on the web was used. Our previous study indicates that teacher intervention can make student's inquiry systematic and exhaustive by helping them build a semantic circuit across language, symbolism, and visual images which are relevant to the targeted concept. In this study, we try to validate the impact of this kind of teacher intervention by monitoring the log data of manipulations.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;dynamic geometry</kwd>
        <kwd>log of manipulation</kwd>
        <kwd>productive failure</kwd>
        <kwd>learning analytics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        For students to develop flexible scientific thinking, they should engage in solving problems
which are complex and ill-structured. During problem solving, computer-based tools are often
used to make students reflect on the data they have collected and speculate about the underlying
mechanism [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. While those tools enable students to decompose complex tasks and access key
disciplinary content, they may prevent students from fully exploring the solution spaces and
suficiently evaluating alternative interpretations [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In fact, it has been shown that having
students solve ill-structured problems without providing external support structure might endow
their learning process in the longer term with hidden eficacy, even though the process is less
eficient in the shorter term [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Therefore, close attention should be paid to the learning process
so that students can make a full exploration of the concept they are studying while engaged in
inquiry-based learning with computers. However, it is not easy to monitor learners’ activities
on computer because their thinking processes in inquiry tend to become highly complex. In
fact, while several large-scale meta-analysis studies have shown that educational technology
brought about significant improvements in mathematics achievement (for instance [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]), Cheung
and Slavin [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] stated that the lack of information about the relationship between the process of
technology use and the achievement measure might cause a discrepancy among similar studies
in meta-analysis. Regarding the spread of mobile devices and high-speed internet connection,
web-based systems should be preferred in inquiry-based mathematics learning. Moreover,
highresolution temporal data is needed in order to precisely analyze the temporal and sequential
organization of the complex learning process [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Therefore, we have implemented a Moodle
plug-in associated with the dynamic geometry software CindyJS (https://cindyjs.org) which is
used to manipulate mathematical content dynamically. Using this plug-in, we can obtain the
log data of learners’ manipulations of CindyJS content on the web. In this study, we analyze
the process of students’ dynamically manipulating mathematics content to demonstrate that
the teacher’s preliminary intervention might guide their subsequent inquiry in a favorable
direction.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Backgrounds and Research Questions</title>
      <p>The topic analyzed in this research is the learning of polynomial approximation which is a
typical theme in university level mathematics education. From the authors’ experiences, it
seems not to be so hard for the majority of students to apply the formula of Maclaurin’s series
 () ≈  (0) +  ′(0) +  ′′(0) 2 + · · · +  ()(0)  + · · ·</p>
      <p>2 !
to specific functions. However, it is not so easy for them to accurately appreciate the associated
concepts including the radius of convergence and the evaluation of the error terms. In fact,
while the evaluation of the -th error term
 =  () −
{︃
 (0) +  ′(0) +  ′′(0) 2 + · · · +
2
 ()(0) 
!
}︃
expressed in the equation
→0  = 0
lim
can be verified by combining the fundamental theorem of calculus and mathematical induction,
the possibility that  () cannot be approximated by any polynomial function globally can hardly
be recognized by ordinary students only through paper-and-pencil-based learning. To observe
those seemingly contradictory cases, inquiry-based learning with the use of computer-based
tools is needed. For instance, the fact that  () cannot be approximated by any polynomial
unless || is smaller than the radius of convergence can be observed when students use computer
graphics tools and manipulate the graph of functions. Students are expected to fail fitting those
graphs globally and find that fitting them is possible only in the neighbourhood of  = 0. The
key point to be observed is that lower order terms are dominant in the neighbourhood of  = 0
while higher order terms are dominant in the region where || is large. In order to ensure that
students observe this point, it is necessary to monitor the activity of students and check whether
their explorations are exhaustive or not.</p>
      <p>
        In general, interpreting and scafolding learners’ mathematical thinking during their inquiry
are not so easy because mathematics is a multi-semiotic activity whose resources are composed
of many artifacts including gestures as a conceptual metaphor, written modes, spoken discourse,
and visualization on digital media [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ][
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Moreover, mathematical concepts are constructed
through the semantic circuit created by an interlocking network among the systems including
language, symbolism, and visual images [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. In the case of this research, the mathematical
expressions
      </p>
      <p>→0  = 0
lim</p>
      <p>
        →∞  = ∞
lim
( &gt; )
which show that the extent of convergence and divergence of monomial functions is determined
by their orders should be understood while comparing the graphs of those functions. The result
of our previous study indicates that the extent to which learners can build the above mentioned
semantic circuit associated with the targeted concept might greatly influence the pattern of
their manipulations relevant to the dynamic content [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Therefore, we can pose the following
two research questions.
      </p>
      <p>1. Is there any criterion derived from the log data of students’ manipulating dynamic content
to judge whether their explorations are suficient or not?
2. Using this criterion, can we validate the efect of teachers’ educational interventions to
help students to extend the range of their explorations?</p>
    </sec>
    <sec id="sec-3">
      <title>3. Methods</title>
      <p>Due to the risk of COVID-19 infections, all classrooms were conducted fully online during
the period of this research. For that reason, the authors implemented CindyJS content on the
Moodle server and asked students to access that server and manipulate the dynamic content
on the web. Figure 1 shows the Moodle page in which CindyJS content for this research was
implemented.</p>
      <p>Using this content, students were asked to find the best approximation near  = 0
√1 +  ≈  +  + 2 + 3
of the target function  = √1 +  with cubic polynomial function by manipulating four sliders
in the content. When the coeficients , , ,  are changed by moving the red points, the
resulting graph of the cubic polynomial function is modified correspondingly. Thus, the task is
to find the coeficients with which this graph (red curve) fits well to the graph of the function
 = √1 +  (blue curve) near the point (0, 1). The log data of students’ manipulations are
stored on the Moodle server and are formatted into a csv file as in Figure 2.</p>
      <p>On the one hand, Figure 3 shows the locally optimal approximation derived from the formula
of Maclaurin’s series. Unless  =  +  is set to be the tangent line at (0, 1), any choice of
higher degree coeficients does not provide a suitable local approximation since 2 and 3
are the infinitesimals of higher order compared to the first order terms  + .</p>
      <p>
        On the other hand, Figure 4 shows the globally optimal approximation with respect to the
2 norm on the whole interval [
        <xref ref-type="bibr" rid="ref2">− 1, 2</xref>
        ]. Setting the first order part to be the equation of the
tangent line causes dificulty in finding a suitable global approximation. Through observing
this trade-of relation, learners are expected to appreciate intuitively the concept of the degree
of the infinitesimal and the radius of convergence.
      </p>
      <p>As seen in these figures, it is not easy to estimate the range in which the target function can
be locally approximated by using a cubic polynomial function. In this sense, this task is complex
and ill-structured. While the use of dynamic geometry is expected to play a crucial role, there is
some risk that students will search the approximation without considering the power balance
between monomials. To avoid this risk, teachers should turn students’ close attention to the
order of monomials with which their power balance and convergence range are correlated.
Figure 5 is a screenshot of a supplementary video prepared for this educational intervention.
In this video, it is explained that the graph of cubic function is plotted by superposing each
monomial functions and that the monomial function  of higher degree  is a major factor in
the region || ≫ 0 whereas it is a minor factor in the region  ∼ 0. These points were explained
by showing both the symbolic representation of reduction with lower order monomial and
visual images of superposing monomial functions.</p>
      <p>Subjects in this study were first grade students in a Japanese university. Prior to the lesson
used for this research, they had been given some elementary lectures concerning polynomial
approximation and Macraulin’s series of functions. While the evaluation of error terms
together with the formula to calculate the approximation had been taught by using mathematical
expressions, no graphical explanations had been given. Students were randomly assigned to
experimental group E (15 males and 36 females) and control group C (19 males and 34 females).
Before they began manipulating the content, the video in Figure 5 was shown to group E and
another video including brief instruction of the usage of the content was shown to group C.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Results</title>
      <p>Since the region where learners try to fit one graph to another can be monitored by
watching the maximal gap between two graphs on the relevant regions, we used the log
data derived from the Moodle plug-in to compute the maximal gaps on the three regions
[− 1, − 0.5], [− 0.5, 0.5], [0.5, 2] and graphed their temporal transition in black, red, and blue
respectively. A sample graph is shown in Figure 6 where the horizontal axis represents the
passage of time and the vertical one represents the maximal gap. The former has marks for
1
every 50 seconds and the latter has marks for every .
6</p>
      <p>Since the lower order terms are dominant in the region  ∼ 0, the low value of maximal gap
on [− 0.5, 0.5] (red curve) shows that the first order part is set to be near to the equation of
tangential line. This means that the learner attached some importance to the local approximation
in the region  ∼ 0 at that moment. On the contrary, in the case when the value of maximal gap
on [− 0.5, 0.5] is high, that on [− 1, − 0.5] (black curve) or that on [0.5, 2] (blue curve) often falls.
This means that the learner aimed at the approximation in the region apart from  = 0 at that
moment. If we emphasize the efectiveness of manipulation, the case shown in Figure 7 is ideal.
In fact, the red curve falls quickly and the final result (  = 1,  = 0.5,  = − 0.10,  = 0.04)
is very near to that obtained by using the formula of Maclaurin’s series. However, the main
purpose of this trial is to let learners observe as many cases as possible and the short duration of
the manipulation process indicates that it is uncertain whether the learner explored exhaustive
cases to recognize the trade-of relation mentioned above.</p>
      <p>In the case when learners could recognize the necessity of setting the first order part to
be the equation of the tangential line by manipulating higher order coeficients with various
values of lower order coeficients, one further trial is needed in which they minimize the gap on
[− 1, − 0.5] while keeping the gap on [− 0.5, 0.5] small. Figure 8 shows a sample case of those
trials. Because of the singularity of the derivative function of  = √1 +  at the point (− 1, 0),
learners are expected to encounter the dificulty in fitting two graphs near that point.</p>
      <p>
        Contrarily, the fitting on the region [
        <xref ref-type="bibr" rid="ref2">0, 2</xref>
        ] is not so dificult as shown in Figure 9. These
observations should lead to the understanding of the radius of convergence.
      </p>
      <p>In that sense, the inquiry shown in Figure 7 is insuficient. In fact, though the black curve
falls once, the red curve rose at that time. This indicates the possibility that the learner did not
recognize the power balance between monomial functions and his/her manipulation strategy
depended on contingency. Surface observation of graphs for all participants suggested that
learners in group E observed the situation as in Figure 8 more often than those in group C.</p>
      <p>Based on this consideration, we adopted the criteria which is given by simultaneously using
the maximal gaps on [− 1, − 0.5] and [− 0.5, 0.5]. Specifically, we counted the number of students
whose manipulation process included the situation in which the maximal gap on [− 1, − 0.5]
attained the value smaller than the prescribed thresholds 0.20, 0.25, 0.30, 0.35, 0.40 while the
maximal gap on [− 0.5, 0.5] was smaller than 0.01. Here, the threshold 0.01 for the maximal gap
on [− 0.5, 0.5] was chosen since the maximal gap between the target function √1 +  and its
second order approximation 1 + 2  − 1 2 on [− 0.5, 0.5] is very near to it. Figure 10 shows the
1</p>
      <p>8
ratio of these students among each group for each of the above thresholds of the maximal gap
on [− 1, − 0.5]. Here the results of group E and C are represented in red and blue respectively.</p>
      <p>
        Whereas no significant diferences in the ratio are identified for the thresholds other than 0.30,
the ratio for group E (42/51) is significantly higher than that for group C (34/53) in case of the
threshold 0.30 as shown by the arrow in Figure 10. In fact, the p-value generated from“prop.test”
function of R applied to this data is 0.01822. Regarding the fact that no advice about the
manipulation strategy was given in the video, this result strongly suggests that the teachers’
intervention through supplementary video induced learners’ additional exploration in which
they can observe the dificulty in making compatible choice of the approximation on [− 1, − 0.5]
and that on [
        <xref ref-type="bibr" rid="ref2">0, 2</xref>
        ].
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion and Future Work</title>
      <p>It can be seen that the above mentioned diference in the pattern of manipulation process
between group E and C was caused by the following mechanism.</p>
      <p>
        1. The learners in group C should have understood the graph shape of cubic function globally
through the usual drawing procedure using derivative sign chart. Therefore, some of
them might observe that the maximal gap on the region [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ] became fairly large when
they increased the value of  on the way to the situation in Figure 8 and stopped further
manipulation in that direction.
2. Since the learners in group E watched the supplementary video, they should have
recognized that the third order term 3 does not have a major influence on the graph shape
of cubic function in the region  ∼ 0. Therefore, many of them may have recognized the
possibility that the increase of the value of  can reduce the maximal gap on the region
[− 1, 0] and therefore tried the case in Figure 8.
      </p>
      <p>In summary, teacher’s intervention using a supplementary video can be seen to have helped
students build the interlocking network among the systems including language, symbolism, and
visual images which made their inquiry more systematic and more exhaustive. In this sense,
the result of this research indicates that the temporal transition of learners’ thinking during
their inquiry with the use of dynamic content is reflected in their manipulation process and is
preceded by the activities based on these resources. Therefore, the mathematical user interface
equipped with the system to store the log data of learners’ manipulating dynamic content is
indispensable for monitoring learners’ inquiry and giving appropriate advice to them.</p>
      <p>While the “productive failure” which the subjects experienced through their “extra” trial as
mentioned above helped them appreciate correctly the target concept, that failure can make
their manipulation process complex and divergent. This is because learners change perspectives
over the course of extended experiences for solving ill-structured problems. The complexity
and divergence of the learners’ manipulation process make it very hard for ordinary teachers to
make sense of and give support to learners’ thinking. The result of this study strongly indicates
that monitoring the appropriate signals derived from the log data of learners’ manipulation
process might enable ordinary teachers to infer learners’ thinking and find appropriate ways of
intervening.</p>
      <p>In this study, there are many points to be improved. Though in this study we could diagnose
the process of learners’ mathematical inquiry by using the criteria based on the information
derived from several moments in the whole process, it is necessary to make full use of the
information relating to time and order in general. Moreover, teacher’s intervention is usually
carried out during the learners’ inquiry and while monitoring their activities, whereas in this
study it was carried out by using a video which learners watched before their inquiry. Thus, in
order to make the workflow of this study applicable to a more realistic situation, it is necessary
to develop a more advanced system to analyze the log data and visualize the result of that
analysis in the instant of learners’ inquiry.</p>
      <p>Moreover, some CSCL (Computer-Supported Collaborative Learning) research investigating
the causal relationship between discourse, manipulation, and gesture is needed to make the
interpretation of log data (or the plausible choice of signal) grounded in the light of educational
purpose. In our pilot study, a CSCL environment was prepared as seen in Figure 11. The result
of this pilot study indicated that discourse and gesture are strongly correlated to the strategy of
manipulating dynamic content and they can give some evidence for the interpretation of log
data. While several methodologies for analyzing mathematical cognition are proposed, those
based on the data derived from learners’ linguistic activities and body movements seem to be
most reliable at this stage.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work was supported by JSPS Kakenhi 18K02872 and 19K03175.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Qing</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Xin</given-names>
            <surname>Ma</surname>
          </string-name>
          ,
          <article-title>A meta-analysis of the efects of computer technology on school students' mathematics learning</article-title>
          ,
          <source>Educational Psychology Review 22</source>
          , pp.
          <fpage>215</fpage>
          -
          <lpage>243</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Alan</surname>
            <given-names>C.K.</given-names>
          </string-name>
          <string-name>
            <surname>Cheung</surname>
            ,
            <given-names>Robert E. Slavin,</given-names>
          </string-name>
          <article-title>The efectiveness of educational technology applications for enhancing mathematics achievement in K-12 classrooms: A meta-analysis</article-title>
          ,
          <source>Educational Research Review</source>
          <volume>9</volume>
          , pp.
          <fpage>88</fpage>
          -
          <lpage>113</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Cindy</surname>
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Hmelo-Silver</surname>
          </string-name>
          ,
          <article-title>Problem-Based Learning: What and how do students learn?</article-title>
          ,
          <source>Educational Psychology Review 16</source>
          , pp.
          <fpage>235</fpage>
          -
          <lpage>266</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Brian</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Reiser</surname>
          </string-name>
          ,
          <article-title>Scafolding Complex Learning: The mechanisms of structuring and problematizing student work</article-title>
          ,
          <source>The Journal of Learning Sciences</source>
          <volume>13</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>273</fpage>
          -
          <lpage>304</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Manu</given-names>
            <surname>Kapur</surname>
          </string-name>
          , Productive Failure,
          <source>Cognition and Instruction</source>
          <volume>26</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>379</fpage>
          -
          <lpage>424</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Simon</given-names>
            <surname>Knight</surname>
          </string-name>
          , Alyssa F. Wise, BodongChen, Time for Change:
          <article-title>Why learning analytics needs temporal analysis</article-title>
          ,
          <source>Journal of Learning Analytics</source>
          <volume>4</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>7</fpage>
          -
          <lpage>17</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>George</surname>
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Lakof</surname>
          </string-name>
          , Rafael E. Nuñez,
          <source>Where Mathematics Comes From, Basic Books</source>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Kris</surname>
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Gutierrez</surname>
          </string-name>
          , Tesha Sengupta-Irving,
          <article-title>Jack Dieckmann, Developing a mathematical vision: Mathematics as a discursive and embodied practice</article-title>
          ,
          <source>In Language and Mathematics Education</source>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>71</lpage>
          , Information Age Publishing,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Kay L. O'Halloran</surname>
          </string-name>
          , Mathematical discourse: Language, Symbolism and Visual images,
          <source>Continuum</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Masataka</surname>
            <given-names>Kaneko</given-names>
          </string-name>
          , Takahiro Nakahara,
          <string-name>
            <given-names>Takeo</given-names>
            <surname>Noda</surname>
          </string-name>
          ,
          <article-title>Temporal analytics of log data derived from students' manipulating mathematical objects</article-title>
          ,
          <source>Companion Proceedings of LAK2020</source>
          , pp.
          <fpage>86</fpage>
          -
          <lpage>88</lpage>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Gerry</surname>
            <given-names>Stahl</given-names>
          </string-name>
          , Timothy Koschmann, Dan Suthers,
          <article-title>Computer-supported collaborative learning: An historical perspective</article-title>
          , In Cambridge handbook of learning sciences, pp.
          <fpage>409</fpage>
          -
          <lpage>426</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>