<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Integrating Machine Learning for the Continuing Education of Science Teachers</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jhon Alé</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Chile</institution>
          ,
          <addr-line>Capitán Ignacio Carrera Pinto 1045, Santiago</addr-line>
          ,
          <country country="CL">Chile</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>4</volume>
      <issue>2</issue>
      <fpage>04</fpage>
      <lpage>06</lpage>
      <abstract>
        <p>This study investigates the perception of 42 science teachers in Chile after participating in a two-week workshop focused on the curricular integration of Machine Learning technology to enrich their teaching strategies in the Science course. Using KPSI-type Likert surveys, a pre and posttest was administered to assess changes in perception, followed by statistical analysis. The results highlight significant improvements in teachers' perception in key areas, such as digital citizenship knowledge, digital resource selection to support their teaching, and more positive attitudes towards the integration of Machine Learning in the classroom. However, significant challenges were identified related to the conceptualization and application of Machine Learning in the educational environment. This study underscores the need to provide additional support and specific training to overcome barriers to the successful adoption of these technologies in science education. These findings are relevant for the development of effective teacher training strategies and the promotion of successful integration of Machine Learning in educational settings.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Continuing Education</kwd>
        <kwd>ICT into the Curriculum</kwd>
        <kwd>Machine Learning</kwd>
        <kwd>Science Education</kwd>
        <kwd>STEM</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The potential of technology to strengthen educational systems and advance towards the
achievement of the Sustainable Development Goals is internationally recognized [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. These
technologies are positioned as strategic factors that contribute to equitable growth and address
the challenges of the 21st century [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Pedagogical practice is increasingly influenced by emerging
technologies, such as Artificial Intelligence (AI), Machine Learning (ML), or Extended Realities
(virtual, augmented, or mixed), which pose ethical challenges [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and essential questions about
how to interact with these technologies, select them, and harness their potential to support
students' teaching and learning, as well as prepare them for the future [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Despite the widely accepted importance of teacher knowledge [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ] as the cornerstone to
address students' digital competence [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ], the reality shows that technology is barely integrated
into classrooms, and when it is, it often follows traditional teaching methods [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. This situation is
attributed, in part, to the lack of an educational focus in technology research [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], the absence of
new theories, models, and methods for integration into pedagogical practice [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], and the lack of
evidence, especially in the Latin America and the Caribbean region [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>In this context, the present study focuses on contributing to this purpose and presents the
results of the implementation of a remote workshop for science teachers throughout Chile. The
aim of the workshop is to assess teachers' perceptions of the use of Machine Learning tools in
their science classes.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Method</title>
      <p>
        The work is oriented towards research in educational design [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Workshops and educational
resources are constructed, considering distance work and progressive activities that allow the
curricular integration of Machine Learning technological resources to support the curricular
learning of science.
      </p>
      <p>The teachers participating in the workshop are 22 women and 20 men (n = 42). Moreover, the
majority of them are teachers with more than 5 years of teaching experience in different cities in
Chile.</p>
      <p>
        A 4-point Likert self-assessment survey was used (see Table 1), following the model of the
Knowledge and Prior Study Inventory (KPSI) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>Questions
Q1. ¿Puedo explicar el concepto de Machine Learning?
Q2. ¿Conozco formas de incorporar el Machine Learning en mi
ejercicio docente?
Q3. ¿Puedo establecer criterios para identificar y seleccionar
recursos de Machine Learning apropiados para mi ejercicio
docente?
Q4. ¿Soy consciente de los procesos necesarios para integrar
curricularmente recursos de Machine Learning?
Q5. ¿Sé cómo diseñar actividades que integren tecnología de
Machine Learning y sean coherentes con los objetivos de
aprendizaje de ciencias?
Where 1 = Completely Agree, 2 = Agree, 3 = Disagree, 4 = Completely Disagree.
1
2
3
4</p>
      <p>The survey was conducted using a pre-post test to assess changes in the perception of the 42
science teachers. A descriptive statistical analysis was performed to compare significant changes
in the average scores of the teachers' perceptions by comparing the initial results with the final
ones. The responses were coded according to their tendency, with 1 = " Completely Agree or
Agree" and 0 = "Disagree or Completely Disagree”. Non-parametric chi-squared tests and the
McNemar Test for paired samples were utilized in the analysis [15].</p>
      <p>2.1. Science Workshop with Machine Learning
The objective of the workshop is to explore and evaluate some applications of Machine Learning
for Science Education, through the creation of various classifiers and decision trees that support
the development of school scientific research and the understanding of the basic processes
underlying Artificial Intelligence. The workshop is primarily aimed at in-service or pre-service
Natural Science teachers in primary or secondary education (Physics, Chemistry, or Biology),
without excluding educators from lower levels. At the end of the workshop, teachers and
educators create simple classifiers (with text, image, audio, or video) using Google's "teachable
machine" software. Teachers use decision trees to test scientific research hypotheses in various
areas and to support the resolution of socio-scientific problems.</p>
      <p>At the beginning of the workshop, teachers were given explanations of fundamental concepts
of artificial intelligence and machine learning, accompanied by examples illustrating their
application in the execution of projects in the field of natural sciences. This introductory phase
aimed to establish a common understanding and familiarize participants with the essential
concepts of these technologies in the context of their discipline. This pedagogical strategy helped
ensure that teachers had a solid initial understanding of artificial intelligence and machine
learning, setting the stage for the workshop with a shared knowledge foundation.</p>
      <p>During the workshop, an activity involving the construction of decision trees took place. In this
phase, science teachers explored 'training' situations, similar to the machine learning training
process. In these situations, teachers worked with images and undertook the task of
distinguishing between poisonous and non-poisonous animals based on their physical
characteristics, as exemplified in Figure 1. This activity aims for teachers to train and build their
own machine learning model based on a dataset with pre-defined categories, specifically using a
supervised learning model.</p>
      <p>During this activity, teachers played an active role in creating decision rules, establishing
criteria and guidelines for making these distinctions. Subsequently, they compared these rules in
'model tests' to evaluate their effectiveness, and they also propose scientific research hypotheses
based on the characteristics described in their decision tree models. This hands-on experience
not only allowed teachers to understand the principles underlying machine learning but also to
apply them concretely and interactively in the classification of animals, enriching their
understanding and skills in the subject.</p>
      <p>At the end of the experience, teachers share ideas for school scientific projects that integrate
Machine Learning and Artificial Intelligence into the curriculum to support teaching, as shown in
Figure 2.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Results</title>
      <p>The results from Table 2 indicate changes across all average scores of science teachers' responses.
Trends show favorable shifts, notably leaning towards "Agree" or "Strongly Agree" options on the
Likert Scale. The most significant change was observed in question 1 (Q1) concerning perceptions
regarding the ability to explain the concept of Machine Learning.</p>
      <p>In the context of this research, it is essential to highlight that the self-assessment of the ability
to 'explain the concept of Machine Learning' did not reveal significant changes in science teachers'
perceptions after completing the workshop. This suggests that, despite having formative
explanations on the topic during the workshops, teachers' ability to communicate and
understand this specific concept requires more focused work to enhance their comprehension.
This finding has important implications for teacher training in the context of science education.
Despite the growing relevance of artificial intelligence and Machine Learning in education, it
seems that teachers do not feel equipped to discuss the subject or explain basic concepts of how
it works.</p>
      <p>Similarly, the self-assessment of the ability to design activities that integrate Machine Learning
technology coherently with the curricular objectives of natural sciences did not show significant
differences in teachers' perceptions. This indicates that, although they were given the
opportunity to explore the integration of Machine Learning into their teaching, teachers' ability
to align these activities with the specific objectives of the natural sciences curriculum did not
experience noticeable improvements. These results also suggest the need for more specific
attention in teacher training regarding understanding and the ability to use Machine Learning
technology effectively, as well as the integration of this technology into the natural sciences
curriculum.</p>
      <p>In general, it can be inferred that the two-week workshop might not be sufficient to achieve
substantial changes in these areas of teaching competence, as they require more in-depth
attention. These findings emphasize the importance of having more training activities in the
future to develop learning that allows teachers to delve into the understanding and application
of Machine Learning to support education.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>This research focused on evaluating the perception of 42 science teachers in Chile after
participating in a workshop designed to explore and assess the application of Machine Learning
tools in their science classes. Despite international recognition of the potential of technology in
education, there has been a lack of effective integration of these tools in the classroom. The
research results indicate that, although the workshop provided teachers with an initial
understanding of Machine Learning applications in science, no significant changes were observed
in teachers' ability to explain the concept of Machine Learning or their ability to design activities
that integrate this technology coherently with the curricular objectives of natural sciences. These
findings underscore the need for more comprehensive and long-term training in the field of
emerging technologies in science education.</p>
      <p>The workshop proved to be a valuable experience for teachers by allowing them to apply
Machine Learning concepts in practical situations, such as the construction of decision trees.
However, the complexity of understanding and conveying these concepts, as well as effective
integration into the curriculum, requires a deeper and ongoing approach.</p>
      <p>Ultimately, this research highlights the importance of continuing to develop training
opportunities for teachers to gain a more solid understanding of artificial intelligence and
Machine Learning, allowing them to fully leverage its potential in science education. Future work
should focus on addressing these shortcomings and enriching teacher training in this critical field
for 21st-century education. To achieve this goal, teachers require more focused and detailed
initial training on the concept of Machine Learning through specific pedagogical strategies. It is
crucial to advance the effective integration of Machine Learning into the curriculum, enabling
teachers to design activities that align with subjects and connect with real-world situations such
as disease diagnosis prediction or machine diagnostics using Machine Learning [16, 17]. This
involves developing didactic resources and teaching strategies that link technology with
curriculum content. Furthermore, for the future, it is proposed to implement and evaluate
extended training courses for teachers, focusing on the use and integration of Artificial
Intelligence in scientific education, tailored to their specific needs and contexts.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>This work has been developed with the support of the University of Chile.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Fengchun</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Wayne</surname>
          </string-name>
          ,
          <article-title>Guidance for generative AI in education and research</article-title>
          , UNESCO (
          <year>2023</year>
          ). https://unesdoc.unesco.org/ark:/48223/pf0000386693
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <article-title>[2] UNESCO, The International Science and Evidence based Education (ISEE) Assessment: 2.6 Education Technology</article-title>
          ,
          <string-name>
            <surname>UNESCO</surname>
          </string-name>
          (
          <year>2023</year>
          ). https://mgiep.unesco.org/iseeareport
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>S.</given-names>
            <surname>Giannini</surname>
          </string-name>
          ,
          <article-title>Generative AI and the future of education, UNESCO (</article-title>
          <year>2023</year>
          ). https://unesdoc.unesco.org/ark:/48223/pf0000385877
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>K.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , A. Begum Aslan,
          <article-title>AI technologies for education: Recent research &amp; future directions</article-title>
          ,
          <source>Computers and Education: Artificial Intelligence</source>
          <volume>2</volume>
          , (
          <year>2021</year>
          ). https://doi.org/10.1016/j.caeai.
          <year>2021</year>
          .100025
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Mishra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.J.</given-names>
            <surname>Koehler</surname>
          </string-name>
          ,
          <article-title>Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge</article-title>
          . Teachers College Record (
          <year>2006</year>
          ),
          <fpage>1017</fpage>
          -
          <lpage>1054</lpage>
          . https://doi.org/10.1111/j.1467-
          <fpage>9620</fpage>
          .
          <year>2006</year>
          .
          <volume>00684</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <article-title>[6] UNESCO, UNESCO ICT Competency Framework for Teachers, UNESCO (</article-title>
          <year>2018</year>
          ), https://unesdoc.unesco.org/ark:/48223/pf0000265721
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>L.</given-names>
            <surname>Cuban</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Kirkpatrick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Peck</surname>
          </string-name>
          , High Access and
          <article-title>Low Use of Technologies in High School Classrooms: Explaining an Apparent Paradox</article-title>
          . American Educational Research Journal, (
          <year>2001</year>
          ),
          <fpage>813</fpage>
          -
          <lpage>834</lpage>
          . https://doi.org/10.3102/0002831203800481
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <article-title>[8] OECD, OECD FUTURE OF EDUCATION AND SKILLS 2030 OECD Learning Compass 2030 A SERIES OF CONCEPT NOTES</article-title>
          , OECD (
          <year>2020</year>
          ). https://www.oecd.org/education/2030- project/teaching-and
          <article-title>-learning/learning/learning-compass2030/</article-title>
          <string-name>
            <surname>OECD</surname>
          </string-name>
          _Learning_Compass_2030_Concept_Note_Series.pdf
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>L.</given-names>
            <surname>Ilomäki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Lakkala</surname>
          </string-name>
          ,
          <article-title>Digital technology and practices for school improvement: innovative digital school model</article-title>
          .
          <source>RPTEL 13</source>
          ,
          <issue>25</issue>
          (
          <year>2018</year>
          ). https://doi.org/10.1186/s41039-018-0094-8
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>X.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Xie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.J.</given-names>
            <surname>Hwang</surname>
          </string-name>
          <article-title>Application and theory gaps during the rise of artificial intelligence in education Computers</article-title>
          and
          <source>Education: Artificial Intelligence</source>
          ,
          <volume>1</volume>
          (
          <year>2020</year>
          ), p.
          <fpage>100002</fpage>
          . https://doi.org/10.1016/j.caeai.
          <year>2020</year>
          .100002
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>K.Y.</given-names>
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.Y.</given-names>
            <surname>Chang</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.J. Hwang</surname>
          </string-name>
          <article-title>Trends in artificial intelligence-supported e-learning: A systematic review and co-citation network analysis (1998-2019) Interactive learning environments (</article-title>
          <year>2021</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          . https://doi.org/10.1080/10494820.
          <year>2021</year>
          .1875001
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <source>[12] UNESCO, Global education monitoring report</source>
          ,
          <year>2023</year>
          <article-title>: technology in education: a tool on whose terms?, UNESCO</article-title>
          . https://doi.org/10.54676/UZQV8501
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>T.</given-names>
            <surname>Plomp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Nieveen</surname>
          </string-name>
          ,
          <article-title>An Introduction to Educational Design Research</article-title>
          .
          <source>Proceedings of the seminar conducted at the East China</source>
          Normal University, (
          <year>2007</year>
          ). https://ris.utwente.nl/ws/portalfiles/portal/14472302/Introduction_20to_
          <article-title>20education_2 0design_20research</article-title>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D.</given-names>
            <surname>Young</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Tamir</surname>
          </string-name>
          ,
          <article-title>Finding out what Students know</article-title>
          .
          <source>The Science Teacher</source>
          ,
          <volume>44</volume>
          ,
          <fpage>27</fpage>
          -
          <lpage>28</lpage>
          (
          <year>1977</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>