<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Model of Professional Retraining of Teachers Based on the Development of STEM Competencies</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>associate professor of the department of informatics and methods of its teaching, Volodymyr Hnatiuk Ternopil National Pedagogical University</institution>
          ,
          <addr-line>Ternopil</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>The article describes a methodology for organizing lifelong learning, professional retraining of teachers in STEM field and their lifelong learning in Volodymyr Hnatiuk Ternopil National Pedagogical University (Ukraine). It analyzes foreign and domestic approaches and concepts for the implementation of STEM in educational institutions. A model of retraining teachers in the prospect of developing their STEM competencies and a model of STEM competencies were created. The developed model of STEM competencies for professional teacher training and lifelong learning includes four components (Problem solving, Working with people, Work with technology, Work with organizational system), which are divided into three domains of STEM competencies: Skills, Knowledge, Work activities. In order to implement and adapt the model of STEM competencies to the practice of the educational process, an experimental study was conducted. The article describes the content of the scientific research and the circle of respondents and analyzes the results of the research.</p>
      </abstract>
      <kwd-group>
        <kwd>model</kwd>
        <kwd>professional retraining of teachers</kwd>
        <kwd>lifelong learning</kwd>
        <kwd>STEM competency</kwd>
        <kwd>STEM learning</kwd>
        <kwd>STEM competency research</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The reorganization of the Ukrainian secondary school is a consolidated goal of
Ukrainian society as a whole. The conceptual foundations for reforming secondary
school determine the nine components of the "New Ukrainian School" [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], among
which the new content, which is defined in the "Standard of general secondary
education" [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and focuses on the formation of key competencies for life, takes pride of
place. These standards are based on the Recommendations of the European
Parliament and of the Council of the European Union on Key Competences for Lifelong
Learning [20].
      </p>
      <p>Today, in Ukraine, the first steps are taken to introduce STEM learning, which will
promote:
─ modernization of the practical training of future teachers of natural and
mathematical subjects and improvement of professional skills of teaching staff.
─ lifelong learning, training and retraining of teachers of natural and mathematical
subjects for ICT-supported STEM education and professional careers.
─ refocusing from traditional subject learning to a competent approach.</p>
      <p>
        STEM education is one of the most trending directions of the 21st century
educational reform. The author [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] believes that any educational reform should take into
account the readiness of teachers, especially in terms of their skills and competencies.
      </p>
      <p>
        The authors [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] note the global need to improve education policy in the field of
STEM. In the United States, during the last two decades, the educational reform of
STEM has taken place. However, in practice, STEM teachers lack cohesive
understanding of STEM education. The process of integrating science, technology,
engineering, and mathematics into the authentic context is the basic concept of STEM
education and requires a new generation of STEM experts. The researchers emphasize
that the key to STEM teacher training lies in substantiating their conceptual
understanding of the integrated STEM education system by teaching key educational
theories, pedagogical approaches, and raising the level of STEM competencies.
      </p>
      <p>
        Other authors [27; 17] believe that teachers are constantly faced with new learning
strategies and methods needed to successfully implement STEM education. They
encourage the development of STEM concepts that will help students understand how
the four disciplines merge together to solve practical issues and real life problems [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>The author [18] in her study emphasizes that STEM is a skill that contributes to a
students’ crucial representation of how STEM ideas, standards and practices relate to
everyday life experiences.</p>
      <p>Vasquez, J., Sneider, C., Comer, M. [26] described four different approaches to
STEM. The first approach is realized through a disciplinary form of integration, when
the concepts and skills of STEM subjects are taught separately when studying each
discipline. The second approach is realized through multidisciplinary integration,
when the concepts and skills of STEM disciplines are taught separately. The third
approach is realized through interdisciplinary co-ordination, where related ideas and
positions are manifested in at least two elements of management in order to improve
students' knowledge and their informative ability. Finally, the last approach is realized
through transdisciplinary integration, where the knowledge and skills gained by
means of at least two components of the interdisciplinary integration are related to
real problems and projects.</p>
      <p>
        Ejiwale J. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] in his own study, identifies the barriers for STEM as an
interdisciplinary study in K-12:
1. poor preparation and lack of qualified teachers;
2. lack of investment in PD teacher;
3. poor preparation and inspiration of students,
4. lack of communication with the individual
5. lack of support from the school system;
6. lack of STEM collaborative research;
7. poor preparation of the content;
8. poor delivery of content and evaluation methods;
9. bad terms and conditions;
10. lack of practical training of students.
      </p>
      <p>
        Scientists [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] identified the critical components of STEM schools and received the
theoretical basis of the eight main elements characterizing STEM higher education
institutions: personalization of training; problem-based learning; strict training; school
community and affiliation; external community; personnel funds; technology and life
skills; career.
      </p>
      <p>
        The STEM Connector's Innovation Task Force (SITF, USA) has developed new
career paths in STEM-STEM 2.0. The work of [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] identified STEM competencies in
the STEM 2.0 industry: professional skills 2.0, innovative, digital, and
subjectspecific (specific discipline) or so-called "solid" skills.
      </p>
      <p>Problems of formation of STEM competencies in the synthetic learning
environment are explored by Olga Pinchuk, Svitlana Lytvynova, Oleksandr Burov. The
authors consider the main directions of development of such environments: 1) computer
generation of virtual environments; 2) designing of remotely controlled robots; 3)
improvement of the interface man-machine; study of the relevant aspects of human
behavior [19].</p>
      <p>By studying the conceptual apparatus of STEM education, authors [25] conclude
that the simulation of the STEM-oriented learning environment is relevant. The
methodological foundations of the organization of cloud-based learning environment for
teaching mathematical disciplines and computer sciences have been developed by
Mariya Shyshkina, Ulyana Kohut, Maya Popel. [23]. In the process of developing our
model of professional training and retraining of teachers, we used the classification
and system of ICT competencies by O.M. Spirin [24].</p>
      <p>
        Jang, H. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] explores the gap between education in science, technology,
engineering and mathematics (STEM) and the necessary skills in the workplace in industry,
academia, and government institutions. He assesses the impact of STEM concepts on
curriculum modifications and the relevance of today's qualification frameworks used
in education through a standardized working database that is operated and maintained
by the US Department of Labor.
      </p>
      <p>Therefore, the question arises about the professional training of teachers before the
introduction of STEM into the learning process. As noted by [2; 4; 21; 22], teachers
have repeatedly expressed the need to see examples from other teachers who
implement integrated STEM lessons. Studying the best practices of STEM practice should
be the basis for improving the skills of practicing teachers and their professional
development. A number of modern studies [7; 9; 10; 11] has confirmed the effectiveness
of this approach.</p>
      <p>We can state that many scientific studies are devoted to the development of STEM
education. In our research, we will focus on the professional retraining of teachers and
the development of their STEM competencies.</p>
      <p>Therefore, the purpose of the article is to create a model for professional retraining
of teachers in order to develop their STEM competencies.
2</p>
    </sec>
    <sec id="sec-2">
      <title>The Presentation of Main Results</title>
      <p>Creation of a teacher training and retraining system based on the development of
STEM competencies at the Volodymyr Hnatiuk Ternopil National Pedagogical
University based on the Department of Computer Science and Teaching Techniques at
the Faculty of Physics and Mathematics took place at the following stages: designing,
constructive, analytical and corrective.</p>
      <p>The designing stage involved strategic, conceptual and functional analysis.
Strategic analysis considered the definition of general objectives for professional retraining
of teachers based on the development of their STEM competencies and the
construction of a model of STEM competencies. At the level of conceptual analysis, the
structural components of lifelong learning, professional training and retraining of teachers
in the field of STEM were developed and the theoretical foundations of STEM
disciplines were determined. Functional analysis enabled to determine the content of
STEM-oriented tasks and to identify practical projects.</p>
      <p>The constructive stage involved the development of a model for lifelong learning,
professional training and retraining of teachers based on the development of STEM
competencies (Fig.1).
STEM competency is considered as a dynamic system of knowledge and skills,
modes of thought, values and personal qualities that determine the ability to
innovative activities: readiness for solving complex problems, critical thinking, creativity,
organizational ability, cognitive flexibility, teamwork, emotional intelligence,
assessment and decision-making, ability to interact effectively and negotiate.</p>
      <p>The basic components of STEM competencies marked by many scientists [12; 23;
3] are:
─ the ability to define a problem;
─ the ability to formulate a research task and identify ways to solve it;
─ the ability to apply knowledge in different situations, to understand the possibility
of other points of view in solving problems;
─ the ability to solve the problem unconventionally;
─ the ability to apply higher order thinking skills.</p>
      <p>The model of lifelong learning, professional training and retraining of teachers in
terms of the development of STEM competencies at the university is based on the
elaboration of educational disciplines and individual didactic elements on a
multidisciplinary basis (integrated training according to certain topics, not individual
disciplines) and project training.</p>
      <p>The proposed model involves a combination of formal (learning sessions with
STEM elements provided by the curriculum), non-formal (events taking place at
STEM-center of Volodymyr Hnatiuk Ternopil National Pedagogical University) and
informal education (self-education, scientific contacts regarding STEM education).</p>
      <p>The formal component is implemented at three levels: (Table 1)
─ To distinguish the notions of STEM education,</p>
      <p>STEM literacy, scientific literacy, STEM specialty,
innovation, start-up, STEM project and to use them
to search for information materials, for project
development, STEM startup planning;
─ To develop information materials on STEM projects
that are implemented in the world or country and are
suitable for adaptation in their community;
─ To search for ICT tools for STEM education support</p>
      <p>that are related with their professional orientation
─ To use ICT tools to support cross-disciplinary
research and STEM training: virtual labs, virtual
worlds, simulators, emulators;
─ To apply innovative means to support research:
ro</p>
      <p>botics, research tools, 3D modeling and printing,
Third</p>
      <p>Teachers
(retraining and
lifelong learning)
programming of complex biological and ecosystems,
social behavior, etc.;
─ To develop guidelines for the use of ICT for STEM</p>
      <p>education
─ To search for ICT tools for STEM education support</p>
      <p>that are related with their professional orientation
─ To develop guidelines for the use of ICT for STEM</p>
      <p>education
─ To apply innovative means to support research
─ To evaluate and predict the needs of the community</p>
      <p>that can be realized by means of STEM;
─ To develop inter-subject projects in the field of</p>
      <p>STEM-education;
─ To teach using case study technology and project</p>
      <p>method in STEM education</p>
      <p>The non-formal component is implemented in the form of mixed learning based on
the STEM-center, created at the Department of Computer Science of the Volodymyr
Hnatiuk National Pedagogical University in 2015. The Center's work is aimed at
organizing lifelong learning, professional training and retraining of STEM teachers,
research and project training in order to gather innovative teaching methods and
increase the interest of teachers and students in the STEM sciences, and the creation of
a practice base for the implementation of STEM education. The successful
development of STEM education at the STEM Center is exercised through resource
mobilization and collaboration between school teams and external participants such as higher
education institutions, academic institutions, research laboratories, science museums,
natural history centers, enterprises, public and other organizations during the learning
and teaching process. The teachers of the Department of Computer Science place
special emphasis on the cooperation of specialists of different fields in the
development of a special learning environment using ICT.</p>
      <p>
        STEM-center holds various events of interest for the development of STEM
competencies:
─ Days of science both at the university and in other educational institutions;
─ scientific picnics;
─ university Olympiads in programming and IT, code hours;
─ Competitions, master classes, trainings, winter and summer STEM schools with
gifted students;
─ STEM-festival;
─ Trainings for the improvement of skills and professional retraining of teachers of
the city and region in the field of STEM education [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Informal component of STEM training at the University is provided by the
independent work of students and teachers, by processing of modern scientific sources,
communication with STEM specialists during round tables, seminars, conferences,
discussion panels, webinars, and distance learning on various e-platforms.</p>
      <p>In addition, the model of lifelong learning, professional training and retraining of
teachers based on the development of STEM competency as an activity uses not only
the context of learning, but also the social aspect of learning. In this case, learning
takes place in the community of practitioners, and this helps the teacher to move from
the initial understanding of STEM knowledge, skills and practice to achieving
mastership.</p>
      <p>To test the effectiveness of the model lifelong learning, professional training and
retraining of teachers through the development of STEM competencies, we conducted
a pilot study (analytical-adjustment stage). Thirty-two practicing teachers were the
participants of the experiment. Eight groups were formed. Groups were formed on the
mixed principle, each of them included a teacher of mathematics, physics, computer
science, biology or chemistry.</p>
      <p>The author's model of STEM competencies is based on the H. Jang model. It
contains 37 criteria, which are grouped into three domains: Skills, Knowledge, Work
activities. The selection of criteria is resulting from our experience in practical
implementation of STEM projects in schools and universities.</p>
      <p>
        At the first (qualifying) stage, we suggested that teachers evaluate their level of
development of STEM competencies. The evaluation was carried out in a 5-point
Likert-like scale based on the criteria proposed by H. Jang [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Among the significant
number of criteria, we selected 37 major criteria, which were distributed into three
domains of STEM competencies: Skills, Knowledge, Work activities. Each domain
combined the criteria into the following groups (Table 2):
─ problem solving (PS);
─ working with people (WP);
─ work with technology (WT);
─ work with organizational system (WoS).
Math Knowledge of Computer Sci- Knowledge
Computer Sci- regularities, prin- ence management
ence ciples and methods Basics of mi- principles
Native and of teaching croelectronics
of
Work
Activities
foreign lan- Assessment of
guages learning outcomes
      </p>
      <p>Get feedback
Knowledge of
leadership
technologies
Knowledge of
teamwork
techniques
Information Command for- Interaction with Development of
analysis mation computers goals and
strateEvaluation of Conflict Manage- Data pro- gies
information ment cessing Monitor
processSearch for solu- Coaching and de- Перевірка es, materials, or
tions velopment of oth- обладнання, surroundings
Verification ers конструкцій Work with
reand experi- Networking або матеріалу sources
mental confir- Checking
mation equipment,
structures or
material
STEM Skills of prob- Communication Technological System skills,
Com- lem solving skills and engineer- resource
manpeten- ing skills agement skills
cies</p>
      <p>The average value of each group of criteria was calculated for each respondent
based on the points by respondent (Table 3).</p>
      <p>PS
0,55
0,45
0,58</p>
      <p>WP
0,39
0,43
0,68</p>
      <p>WT
0,47
0,53
0,66</p>
      <p>WOS
0,34
0,53
0,53</p>
      <p>We considered the mean value obtained by the respondent when self-assessing all
37 questions as a latent indicator of the level of development of STEM competencies.
The normalized index In was found from the ratio:</p>
      <p>Normalized</p>
      <p>index
ing to the scale
─ 0 – 0.25 – critical
─ 0.25 – 0.5 – low
─ 0.5 – 0.75 – sufficient
─ 0.75 – 1.0 – high

 =</p>
      <p>−
 
−
(1)
self-assessing all 37 questions.
ble 4.
where si is a total points by respondent i, smax is a maximum points available, N is a
number of questions.</p>
      <p>The normalized index was calculated based on the total respondent’s points during
The mean values of normalized indexes obtained on the first stage are given in
Tabution of each of the samples (data from Table 3). The results of the statistical study
of normality by the One-Sample Kolmogorov-Smirnov Test are presented in Table 5.
The graphical representation of the distribution is shown in Fig. 2.
2,4
2,6
2,8
3
3,2
3,4
3,6
3,8
4
Based on the table data and the graphical representation of the distribution, we can
assert the normal distribution of the samples.</p>
      <p>At the second (exploratory) stage of the study, we developed the STEM
competencies of teachers based on our model of lifelong learning, professional teacher training
and retraining, and lifelong learning based on the development of STEM
competencies.</p>
      <p>It involved training of the established experimental groups of practicing teachers at
the STEM Center and grounding of robotics, the Internet of Things, 3D technologies
(computer 3D modeling and 3D printing systems), and their involvement in the
execution of three STEM project tasks.</p>
      <p>At the third (forming) stage, we again asked teachers to evaluate their own
components of STEM competencies. The distribution of the samples at this stage also
appeared to be normal (Table 6, Figure 3).</p>
      <sec id="sec-2-1">
        <title>Mean</title>
        <sec id="sec-2-1-1">
          <title>Stage1</title>
        </sec>
        <sec id="sec-2-1-2">
          <title>Stage2</title>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>Groups of criteria</title>
        <p>Normalized
index</p>
        <p>Comparing the values of the data of the normalized indexes, presented in Tables 4
and 6, we can state the increase in self-evaluation of STEM competencies of teachers
(Fig. 4).</p>
        <p>3,2
3,4
3,6
3,8
4
4,2
4,4
4,6
4,8
The results of calculations of average values of normalized indexes are given in Table
7:</p>
        <p>PS</p>
        <p>WP</p>
        <p>WT</p>
        <p>WOS
We used the Student's t-test to identify statistical differences between the mean values
of the points given by each respondent at the qualifying and forming stages of the
study.</p>
        <p>We formulate a zero (H0) and an alternative (H1) hypothesis.</p>
        <p>H0 – there are no statistical differences between the mean values of the points for
each of the groups of criteria (PS, WP, WT, WoS);</p>
        <p>H1 – there are statistical differences between the average values of the points for
each of the groups of criteria (PS, WP, WT, WoS) obtained at the qualifying and
forming stages.</p>
        <p>The results of calculations of the Student’s t-test (Temp) for each STEM group are
shown in Table 8.</p>
        <p>The obtained empirical values of the Student's t-test for all groups of criteria are in
the significance zone. Therefore, we adopt the alternative hypothesis (H1), which
confirms the effectiveness of the proposed lifelong learning model, professional
training and retraining of teachers based on the development of STEM competencies of
practicing teachers.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Conclusions</title>
      <p>The results of the conducted scientific research on the qualifying stage indicate that
many practicing teachers are interested in STEM education, but do not believe that
they have sufficiently well-developed STEM competencies.</p>
      <p>During the exploratory stage of our study, we have developed the model of lifelong
learning, the model for professional retraining of teachers for the development of their
STEM competencies, including the definition of diagnostic goals of STEM
disciplines. Among them are development of the model of STEM competencies;
formulation of learning outcomes of STEM disciplines; content of educational projects;
organizational forms of training; training methods; training means; results of training
upon the project.</p>
      <p>The developed model of STEM competencies for professional teacher training and
lifelong learning includes four components (Problem solving, Working with people,
Work with technology, Work with organizational system), which are divided into
three domains of STEM competencies: Skills, Knowledge, Work activities.</p>
      <p>The statistical processing of research data allows us to make a scientifically
substantiated conclusion about the effectiveness of the proposed model of lifelong
learning, professional training and retraining of teachers based on the development of
STEM competencies of practicing teachers.</p>
      <p>Further research and discussion is needed on the implementation of a
comprehensive education policy in the field of lifelong Learning and STEM, the ability of
teachers to broadcast advanced STEM competencies and prepare young people for their
future STEM career.
17. Lund, T., Stains, M. The importance of context: an exploration of factors influencing the
adoption of student-centered teaching among chemistry, biology, and physics faculty.
International Journal of STEM Education, 2(1), pp.1-21 (2015).
18. Ness, R.: Promoting innovative thinking. American Journal of Public Health, 105 (1), pp.</p>
      <p>114-118 (2015).
19. Pinchuk, O.P., Lytvynova, S.G., Burov, O.Y.: Synthetic educational environment – a
footpace to new education, https://journal.iitta.gov.ua/index.php/itlt/article/view/1831/1230 (in
Ukrainian)
20. Recommendation of the European Parliament and of the Council of 18 December 2006 on
key competences for lifelong learning, http://zakon.rada.gov.ua/laws/show/994_975 (in
Ukrainian).
21. Roth, K. J., Garnier, H. E., Chen, C., Lemmens, M., Schwille, K., Wickler, N. I. Z.:
Videobased lesson analysis: Effective science PD for teacher and student learning. Journal of
Research in Science Teaching, 48(2), 117–148 (2011).
22. Sherin, M. G., Han, S. Y.: Teacher learning in the context of a video club. Teaching and</p>
      <p>Teacher Education, 20(2), 163–183 (2004)
23. Shyshkina, M., Kohut, U., Popel, M.: The Systems of Computer Mathematics in the
CloudBased Learning Environment of Educational Institutions,
http://ceur-ws.org/Vol1844/10000396.pdf
24. Spirin, О.М.: Theoretical and methodological foundations of the credit-modular system of
informatics teachers training / O. M. Spirin. – Zhytomyr: Publishing House Zhytomyr Ivan
Franko State University, – 182 p. (2013) (in Ukrainian).
25. Stryzhak, O.Y., Slipukhina, І.A., Polikhun, N.I., Chernetckiy, I.S.: STEM-education: main
definitions, https://journal.iitta.gov.ua/index.php/itlt/article/view/1753/1276 (in Ukrainian)
26. Vasquez, J., Sneider, C., Comer, M.: STEM lesson essentials, grades 3–8: integrating
science, technology, engineering, and mathematics. Portsmouth, NH: Heinemann (2013).
27. Williams, C., Walter, E., Henderson, C., Beach, A.: Describing undergraduate STEM
teaching practices: a comparison of instructor self-report instruments. International Journal
of STEM Education, 2(1), pp.1-14 (2015).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Asunda</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Open courseware and STEM initiatives in career and technical education</article-title>
          .
          <source>Journal of STEM Teacher Education</source>
          ,
          <volume>48</volume>
          (
          <issue>2</issue>
          ), pp.
          <fpage>6</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ball</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sleep</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boerst</surname>
            ,
            <given-names>T. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bass</surname>
          </string-name>
          , H.:
          <article-title>Combining the development of practice and the practice of development in teacher education</article-title>
          .
          <source>The Elementary School Journal</source>
          ,
          <volume>109</volume>
          (
          <issue>5</issue>
          ), pp.
          <fpage>458</fpage>
          -
          <lpage>474</lpage>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Balyk</surname>
            <given-names>N.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shmyger</surname>
            <given-names>G.P.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Approaches and features of modern stem-education</article-title>
          .
          <source>Physical-mathematical education</source>
          ,
          <volume>2</volume>
          (
          <issue>12</issue>
          ),
          <fpage>26</fpage>
          -
          <lpage>30</lpage>
          (in Ukrainian).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Borko</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jacobs</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eiteljorg</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pittman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Video as a tool for fostering productive discussions in mathematics professional development</article-title>
          .
          <source>Teaching and Teacher Education</source>
          ,
          <volume>24</volume>
          (
          <issue>2</issue>
          ), pp.
          <fpage>417</fpage>
          -
          <lpage>436</lpage>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <article-title>5. Concept of the New Ukrainian School, www</article-title>
          .nus.org.
          <source>ua (in Ukrainian)</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ejiwale</surname>
          </string-name>
          , J.:
          <article-title>Barriers to successful implementation of STEM education</article-title>
          .
          <source>Journal of Education and Learning</source>
          ,
          <volume>7</volume>
          (
          <issue>2</issue>
          ), pp.
          <fpage>63</fpage>
          -
          <lpage>74</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Estapa</surname>
            ,
            <given-names>A. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tank</surname>
            ,
            <given-names>K. M.</given-names>
          </string-name>
          :
          <article-title>Supporting integrated STEM in the elementary classroom: a professional development approach centered on an engineering design challenge</article-title>
          .
          <source>International Journal of STEM education</source>
          ,
          <volume>4</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <article-title>General Secondary Education Standard, www</article-title>
          .nus.org.
          <source>ua (in Ukrainian)</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Glancy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moore</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guzey</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mathis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tank</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siverling</surname>
          </string-name>
          , E.:
          <article-title>Examination of integrated STEM curricula as a means toward quality K-12 engineering education</article-title>
          .
          <source>Proceedings of the 2014 American Society of Engineering Education Annual Conference and Exposition</source>
          . Indianapolis, IN, June 15th - 18th. Washington, D.C.:
          <string-name>
            <surname>ASEE</surname>
          </string-name>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Grubbs</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Strimel</surname>
          </string-name>
          , G.:
          <article-title>Engineering design: The great integrator</article-title>
          .
          <source>Journal of STEM Teacher Education</source>
          ,
          <volume>50</volume>
          (
          <issue>1</issue>
          ),
          <fpage>77</fpage>
          -
          <lpage>90</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Guzey</surname>
            ,
            <given-names>S. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moore</surname>
            ,
            <given-names>T. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harwell</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Building up STEM: An analysis of teacher developed engineering design-based STEM integration curricular materials</article-title>
          .
          <source>Journal of PreCollege Engineering Education Research (J-PEER)</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <fpage>11</fpage>
          -
          <lpage>29</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Jang</surname>
          </string-name>
          , H.:
          <article-title>Identifying 21st Century STEM Competencies Using Workplace Data</article-title>
          .
          <source>Journal of Science Education and Technology</source>
          , Vol.
          <volume>25</volume>
          ,
          <issue>Issue</issue>
          : 2, pp.
          <fpage>284</fpage>
          -
          <lpage>301</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Kelley</surname>
            ,
            <given-names>T.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knowles</surname>
            <given-names>J. G.</given-names>
          </string-name>
          :
          <article-title>A conceptual framework for integrated STEM education</article-title>
          .
          <source>International Journal of STEM Education. Springer Nature. Jan</source>
          <volume>1</volume>
          , (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Khairani</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Z.</surname>
          </string-name>
          :
          <article-title>Innovative Solutions for Engineering and Technology Challenges</article-title>
          .
          <source>MATEC Web Conf. Volume 87. The 9th International Unimas Stem Engineering Conference</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kleinbach-Sauter</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montoya</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>STEM 2.0: An Imperative for Our Future Workforce</article-title>
          , https://www.stemconnector.com/wp-content/uploads/2016/12/STEM-2pt0
          <string-name>
            <surname>-</surname>
          </string-name>
          Publication2nd
          <article-title>-Edition-1</article-title>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>LaForce</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noble</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>King</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Century</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blackwell</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ibrahim</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loo</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The eight essential elements of inclusive STEM high schools</article-title>
          .
          <source>International Journal of STEM Education</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>