<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Computational Thinking and Acting: An Approach for Primary School Competency Development</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jan Pawlowski</string-name>
          <email>jan.pawlowski@hs-ruhrwest.de</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kati Clements</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dimitra Dimitrakopoulou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Idzik</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mikko Muilu</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mihkel Pilv</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sofoklis Sotiriou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ellinogermaniki Agogi</institution>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Miksike OU</institution>
          ,
          <country country="EE">Estonia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Ruhr West University of Applied Sciences</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>University of Jyväskylä</institution>
          ,
          <country country="FI">Finland</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <abstract>
        <p>Computational Thinking has become an important concept for almost all age groups. It describes the purposeful utilization of Information and Communication Technologies for solving problems. The approach of Computational Thinking and Acting combines the computational thinking approach with physical computing, including physical activities to explore real-world problems and tangible outcomes. In this paper, we present a competency framework, design principles, and a sample learning scenario for Computational Thinking and Acting. The evaluation has shown that the approach can be integrated across subjects and is promising for both teachers and pupils.</p>
      </abstract>
      <kwd-group>
        <kwd>Computational Thinking</kwd>
        <kwd>Primary School</kwd>
        <kwd>Computational Thinking and Acting</kwd>
        <kwd>Physical Computing</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Computational Thinking (CT) comprises of competencies necessary to utilize
information and communication technologies to solve problems. In the current wave of
Digital Transformation, CT competencies become relevant in many different subjects. In
this paper, we extend the concept of CT showing how CT can be developed across
subjects in primary schools using a physical computing approach.</p>
      <p>
        The current trend of Digital Transformation leads to new requirements for
organizations and individuals [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. New competencies are needed on all hierarchy levels and
in different contexts: basic digital skills for using digital technologies are often
expressed within the concept of Digital Literacy [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. More specific competencies will
be required in the future work environments or the digital / digitized workplace [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ].
Individuals will need specific competencies for purposefully utilizing emerging or
disruptive technologies, such as artificial intelligence, digital security or business analytics
[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It is common to different frameworks for future competencies / skills [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ] that
competencies on the use and utilization of information and communication
technologies are of urgent importance. It is expected that those skills will improve different
aspects, in particular future employability [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ].
Different pathways have been initiated to promote and improve Computational
Thinking in different parts of education systems: on the policy level, the European
Commission strongly promotes CT skills in the school system [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. On the operational level,
many countries have integrated CT into their curricula [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and teacher education
standards [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. One key issue is that CT is no longer focused on the disciplines of Computer
Science or Information systems: CT competencies will be needed in different subjects
and (industry) domains [
        <xref ref-type="bibr" rid="ref15 ref16 ref17 ref18">15, 16, 17, 18</xref>
        ]. Based on these initial findings, we aim at
developing an approach for Computational Thinking integrating latest trends and
developments of Digital Transformation. The main research questions are:
1. Which competencies are necessary to utilize information and communication
technologies for problem solving across subjects?
2. How to design activity-oriented learning and teaching scenarios to be integrated into
curricula across subjects?
We focus on early education in primary schools, in particular for grades 3 to 6. In this
paper, we describe the approach of Computational Thinking and Acting which includes
a pedagogical framework and competencies as well as a proposal for cross-subject
learning scenarios.
2
2.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <sec id="sec-2-1">
        <title>Computational Thinking</title>
        <p>
          Currently, there is no common definition of Computational Thinking (CT). The
current understanding of the idea is based on the concept of Papert [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] and his idea of
teaching computing to children. Previous works [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] have also focused on the ways
computers solve problems, in particular algorithmic thinking [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. The current use of
the term was strongly influenced by Wing [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] who defined Computational Thinking
as an “approach to solving problems, designing systems and understanding human
behavior by drawing on the concepts fundamental to computer science”. Cuny et al [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]
define CT as “Computational thinking is the thought processes involved in formulating
problems and their solutions so that the solutions are represented in a form that can be
effectively carried out by an information-processing agent”. A shorter definition is
given by Berland &amp; Wilensky [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] as “the ability to think with the computer-as-tool”.
While there is no consensus on the definition, we use the following definition:
“The ability to understand and utilize information and communication technologies
and their key concepts, methods and tools to purposefully solve real-world problems”
        </p>
        <p>
          More important than the definition is the range of competencies included in this
concept. As an example, the International Society for Technology in Education (ISTE) and
Computer Science Teachers Association (CSTA) define key competencies as
“Formulating problems in a way that enables us to use a computer and other tools to help solve
them; Logically organizing and analyzing data; Representing data through abstractions
such as models and simulations; Automating solutions through algorithmic thinking (a
series of ordered steps); Identifying, analyzing, and implementing possible solutions
with the goal of achieving the most; efficient and effective combination of steps and
resources; Generalizing and transferring this problem solving process to a wide variety
of problems.” [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Grover &amp; Pea [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] describe the following competencies as common
for the purpose of curriculum development in the K-12 context: “Abstractions and
pattern generalizations (including models and simulations); Systematic processing of
information; Symbol systems and representations; Algorithmic notions of flow of
control; Structured problem decomposition (modularizing); Iterative, recursive, and
parallel thinking; Conditional logic; Efficiency and performance constraints; Debugging and
systematic error detection”
        </p>
        <p>
          To further compare approaches, we have analyzed different approaches. We
identified 15 national and international approaches [
          <xref ref-type="bibr" rid="ref12 ref13 ref14 ref18">12, 13, 14, 18</xref>
          ] which represent the broad
range of competencies which might be included in the concept Computational
Thinking. Four key questions have emerged from the analysis. The first question is whether
programming should be an essential learning outcome in CT. Some approaches
integrate programming into CT, for example using visual programming languages [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. At
least, the long-term intention of most approaches is that children learn programming
languages.
        </p>
        <p>
          The second key question is the inclusion of emotional aspects, i.e., attitudes and
dispositions. As an example, ISTE CSTA [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] propose five dispositions: “Confidence
in dealing with complexity, persistence in working with difficult problems, tolerance
for ambiguity, the ability to deal with open ended problems, the ability to communicate
and work with others to achieve a common goal or solution”. Generally, there are still
many negative dispositions associated with Computer Science, e.g. as a nerd activity or
“not for girls”. [
          <xref ref-type="bibr" rid="ref25 ref26">25, 26</xref>
          ].
        </p>
        <p>The third key question from the analysis regards specific (new) technologies. Almost
no approach includes emerging technologies. However, as currently many technologies
emerge which will dramatically change education and professional life as well as
methods to solve problems (e.g. Machine Learning, Artificial Intelligence, 3D Printing), we
would suggest to incorporate those into competency frameworks.</p>
        <p>
          Finally, it is essential to connect real world problems and computer solutions. As
Tissenbaum et al [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ] criticize the “[...] initial focus on the concepts and processes of
computing, leaving real-world applications for "later" runs the risk of making learners
feel that computing is not important for them.”
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Physical Computing</title>
        <p>
          Computer activities are often seen as passive with even strong negative effects on
children’s physical condition [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]. However, many CT approaches include the use of
tangible, haptic devices such as robots [
          <xref ref-type="bibr" rid="ref29 ref30">29, 30</xref>
          ] to increase motivation, creativity,
engagement and physical activity [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. Przybylla &amp; Romeike [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ] describe Physical
Computing as following: “Physical Computing covers the design and realization of
interactive objects and installations and allows students to develop concrete, tangible products
of the real world, which arise from the learners’ imagination”. A similar concept is
Tangible Computing [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]. Common to those approaches is that computer activities
should result in tangible (visual and haptic) experiences. Thus, most approaches focus
on the physical output. Given the challenges that 1) computer activities are usually
seated and 2) that the transfer from real-world problems to the computer is often
neglected [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ], it might be useful to extend the concept of Physical Computing. Physical
Computing in an educational context should incorporate physical activities to 1) enable
the problem identification in the real world and 2) to promote healthy activities and
exercise. The “physical” perspective can be seen in different ways:
• Physical Input: The problem to be solved in a learning activity is observed and
experienced in the real world. This means that children should physically go to the
place where the problem can be seen.
• Physical Transfer: Every computer activity should be connected with physical
reallife activities to avoid that computers are just perceived as a passive activity. The
problem identified in the real world should then be transferred to a computer activity
in which the solution is elaborated.
• Physical Output: Devices such as small robots are used to create haptic, tangible
experiences as the outcome of the computer activity.
        </p>
        <p>By extending the concept of physical computing, we address the above mentioned
challenges and barriers to create more meaningful, active learning experiences.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Computational Thinking and Acting</title>
      <sec id="sec-3-1">
        <title>Methodology</title>
        <p>
          There is no common methodology for the development of competency frameworks
/ models or curricula due to the variety of disciplines involved in this field. Typically,
competence models are built using deductive approaches (e.g. analysis of existing
models) or expert consultations, often in professional communities such as AIS / ACM (e.g.
[
          <xref ref-type="bibr" rid="ref34">34</xref>
          ]). Further methods include job advert analysis [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ] or design based approaches [
          <xref ref-type="bibr" rid="ref36">36</xref>
          ].
We follow a Design Science Research method aiming at creating artefacts in a rigorous
way [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ]. We see the main outcomes of our research (Learning / Teaching Model
incorporating physical computing paradigm, associated learning scenarios) as
meta-artefacts [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ] as well as a method [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ] for further system design – resulting systems could
be Human Resource Management systems as well as E-Learning courses as
corresponding interventions and IT-artefacts.
        </p>
        <p>
          As guiding theories, we use the competence-based view of the firm [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ] which
explains the relation of individual competencies to the performance of firms. However,
as there is a time-lag of competence development (e.g. in school or university) and their
usage (in a later employment). The second guiding theory is the Human Capital Theory
which explains employability and competencies [
          <xref ref-type="bibr" rid="ref41">41</xref>
          ]. Especially the aspect of
employability [
          <xref ref-type="bibr" rid="ref42">42</xref>
          ] needs to be extended regarding time and the specific impact of CT within
the learning biographies of people. This aspect is not addressed in this paper but it is an
overall goal of our research.
        </p>
        <p>
          In our paper, we focus on the development of the meta-artefacts but also reflect our
results towards contributing to theory building [
          <xref ref-type="bibr" rid="ref43">43</xref>
          ]. As a contribution towards theory
building, we contribute towards the identification of new competencies and related
activities as part of Computational Thinking. Regarding the practical contribution, we aim
at providing useful learning scenarios for teachers to be used across curricula and
subjects. The construction was based on a literature review and the main concept matrix
[
          <xref ref-type="bibr" rid="ref44">44</xref>
          ]. Overall, we used a naturalistic multi-method evaluation [
          <xref ref-type="bibr" rid="ref45">45</xref>
          ]. The initial version
of our artefacts was evaluated with 41 persons discussing the importance and target
group fit of each category. The version described in the next chapter represents the
result of this process.
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Computational Thinking and Acting Framework</title>
        <p>The key concept “Computational Thinking and Acting (COTA)” combines
Computational Thinking and our extended understanding of Physical Computing.
Computational Thinking and Acting (COTA) is defined as
the ability to understand and utilize information
and communication technologies and their key
concepts, methods and tools by identifying and
solving real world problems accompanied by
physical activities and experiences. The definition
describes the scope and specific characteristics of
COTA. To further refine the concept, it is
necessary to clarify competencies included. Our
concept is reflected in the COTA curriculum. It
covers seven main categories derived from the
competency / curriculum analysis.
In contrast to previous curricula (see 2.1), we include 1) Attitudes and dispositions
containing emotional aspects towards computers and computing. This also contains aspects
focusing on the physical perspective, i.e., computer activities should not be seen as
solely seated indoor-activities. Furthermore, positive attitudes towards ICT as problem
solving tools are intended. 2) Disruptive Technologies focus on specific concepts and
technologies which (will) change practices in educational, private and professional life.
A typical example is Artificial Intelligence which will change the ways problems are
solved in business and leisure. Summarizing our approach, we see that Computational
Thinking curricula will be highly dynamic and change frequently. However, the core
curriculum needs to be mapped to and integrated into other subjects.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Pedagogical Approach and Learning Scenarios</title>
        <p>
          As suggested by Kong [
          <xref ref-type="bibr" rid="ref46">46</xref>
          ], a curriculum needs to be extended describing clear
activities and scenarios to be implemented in practice. There are few frameworks for
pedagogical / didactical aspects of CT. Chande [
          <xref ref-type="bibr" rid="ref47">47</xref>
          ] proposes the following phases:
production, recontextualization &amp; problem solving, and reproduction &amp; innovation. The
model, however, is too prescriptive for our context. Kotsopoulos et al [
          <xref ref-type="bibr" rid="ref48">48</xref>
          ] propose four
main types of learning activities: unplugged, tinkering, making and remixing. This
model is well suited for physical activities but too strict for teaching CT across subjects.
Further models apply well established didactical concepts such as Problem-Based
Learning [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ], Project-Based Learning [
          <xref ref-type="bibr" rid="ref50">50</xref>
          ] or Inquiry Based Learning [
          <xref ref-type="bibr" rid="ref51">51</xref>
          ].
        </p>
        <p>Based on the review of existing models and our key concepts, we propose the
following phases: 1) Context setting: In each scenario, the context needs to be clarified
in particular in cross-subject activities, the overall idea should be clarified. 2) Problem
exploration and identification: A real world scenario should be explored by the
learners - facilitated by a teacher, this should include a physical activity. 3) Transfer and
Elaboration: In this phase, the problem is transferred to a computer activity.
Depending on the type of the problem, different competencies are included. 4) Production: In
this phase, the developed solution should be visualized / prototyped in the real world.
If possible, physical outputs should be produced. 5) Reflection: In the final phase, the
experience is reflected amongst participants. The phases are not necessarily sequential
but can be parallel or repeated multiple times. Secondly, we derived principles for the
creation and implementation of learning scenarios. Each learning scenario should be:
• Real World Problem-Oriented: Learners should experience and identify problems
from the real world. They should be allowed to explore and create own ideas for
problem solving / creating projects.
• Learner-Centric: Learners should be engaged and empowered to identify solution
strategies. The teachers should act as facilitators to moderate the learning process
(e.g. scaffolding)
• Cross-subject: Learning scenarios should not be restricted to computer science /
ICT. Projects across subjects and disciplines should be created to provide richer
learning experiences.
• Physical: each learning scenario should incorporate physical activities as input and
output.
• Transferable: Each solution should be reflected to understand the transfer to other
problems / subjects / domains.</p>
        <p>
          Along those principles, initial learning scenarios have been designed for both
teachers and students. To bring curricula into the classroom, it is necessary to provide
concrete learning scenarios related to the competencies [
          <xref ref-type="bibr" rid="ref46">46</xref>
          ]. The following scenario is a
short sample and outlines the main ideas of COTA.
This learning scenario introduces algorithmic descriptions of problem
solutions as well as decomposition. The problem in this case is how to
estimate the rate of damaged / ill trees in a wide area. The scenario is
related to the biology and maths curriculum.
        </p>
        <p>Primary school from grade 5</p>
        <p>Curricula</p>
        <sec id="sec-3-3-1">
          <title>Competencies</title>
        </sec>
        <sec id="sec-3-3-2">
          <title>Pedagogy LA1 Context</title>
          <p>LA2:
Exploration</p>
          <p>LA3:
Elaboration
LA4:
Reflection</p>
        </sec>
        <sec id="sec-3-3-3">
          <title>Roles</title>
          <p>Tools
and
terials
Ma</p>
        </sec>
        <sec id="sec-3-3-4">
          <title>Geography: Use of maps, scale</title>
          <p>Biology: Forests and trees, tree diseases, nature protection
Mathematics: Surfaces, scales, units
Students can 1 Divide a problem into smaller sub-problems, 2) Use
stepby-step instruction to describe a solution, 3) Use variables for
calculations, 4) Use conditions within loops
Explorative learning</p>
        </sec>
        <sec id="sec-3-3-5">
          <title>Learning Activities</title>
          <p>The teacher introduces problems which cannot be solved as a whole –
examples are counting all animals in an area, sorting large amounts of
things. Students get the task to go out to a close-by forest. The question
is asked whether they can count all trees within one lesson.</p>
          <p>Additionally, tree diseases are introduced. What kind of diseases exist
and how can they be observed (e.g. parasites such as birch moth, bark
beetle; acid rain, …). This introduction needs to be modified depending
on the geographical area.</p>
          <p>Students get the task to estimate the number of trees in a given forest.
They g out to the area to get a visual impression of the problem. First,
they calculate the surface of the area. This can be done using a map and
estimating the total size. After this, students determine an adequate
sample size to decompose the problem (a realistic sample is 50m*50m).</p>
          <p>The students split up in groups and distribute tasks (one person for
measuring the length / width of the area, one person to count all trees,
some persons to find and count damaged trees). Students measure the
step length to calculate how many steps equal 50m. The worksheet
provides step-by-step tasks to solve the problem.</p>
          <p>Students go into the woods and find a place from where they can walk
down the sample (50 by 50 metres). The corner points are marked (or a
student stops there). A counter should count the number of steps (e.g.
REPEAT walk_one_step UNTIL counter= number_of_steps)
When the square is marked, students start counting the number of trees
and agree on the number in case of differences. Afterwards students try
to count damaged trees (sick by parasites, breakage etc). Finally, the
students calculate the total number of trees and the rate of damaged
trees.</p>
          <p>Finally the whole algorithm in the four solution steps (calculate area,
walk / mark area, count trees, calculate trees) should be written down.
Students also can discuss in which other situations they could
decompose to find a quicker solutions.</p>
          <p>Students , Teacher / additional person for field trip
Work sheet: Estimating trees
Pen and paper (marking types of trees, conditions, amount
Area map</p>
          <p>The following figure shows sample tasks from the related guiding worksheets.
How many trees are in the forest below? How many are damaged?
Scale: 1:10000
How big ist he surface, use variables to calculate.
length_map = ____________
width_map = ____________
surface_map = ________ * ____________ = ___________
How long / side is the area in real?
length_real = __________
width_real = __________
surface_real = ________ * ____________ = ___________ m
Task: Go to the forest and mark a 50m * 50m square.</p>
          <p>Step_length = __________ cm = _________ m
Number_of_steps = 50m / Step_length =
How many trees have you counted? How many are damaged
Counted_number_of_trees= ____________
Counted_damaged_trees = _____________</p>
          <p>Now you can count the number of trees in the whole area. How many squares do you
need for the full area?</p>
          <p>Our_square * ____X_____ = real_square; X = _____________
Overall_number_of_trees = ___________ * Counted_number_of_trees =
Overall_number_of_damaged_tree = ___ * Counted_number_of_damaged_trees =</p>
          <p>Great, you have helped us a lot to understand the situation in the forest!</p>
          <p>Task: Summarize all steps you went through to measure the number of damaged tress.
Use variables, conditions and loops, e.g.</p>
          <p>IF step_counter == 100, THEN turn right by 90 degrees
IF tree = damaged, THEN counted_damaged_trees++1
REPEAT go_one_step UNTIL step_counter == Number_of_steps</p>
          <p>The scenario is just one example which was designed together with teacher trainers.
It shows the key characteristics of the COTA approach:
• Problem identification in the real world: The physical input (forest excursion,
determining damaged plants) and corresponding problem is discovered in the real world
without computer usage.
• Transferring the problem towards a CT solution: Different steps and task guide
students to the algorithmic description of the solution
• Using CT solutions, in particular pseudo code including object manipulation,
conditions, loops.
• Receiving tangible results such as photos and documentation of the solution.</p>
          <p>The proposed solution was tested with a small group of students and improved based
on the students feedback. Then, a full evaluation of the approach was carried out.
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Evaluation</title>
      <p>To further understand teachers’ views on computational thinking and physical learning
scenarios, we interviewed individual experts and focus groups in Estonia (E), Finland
(F), Germany (DE) and Greece (GR). We involved 41 individuals: teachers (n2=30),
headmasters (n=5), university lecturers (n=4), teacher training specialist (n=1) and
educational technologist (n=1). Out of the teachers, 21 worked on primary level, 4 on
secondary and 7 on both.</p>
      <p>The first part of the evaluation looked at physical computing as a pedagogical
approach. The following solutions were discussed by the interviewees.
E3, E4, E6, E9, E10, GR4). “Students understand deeply physics and mathematics due
to robotics lessons.” (Greek primary school teacher, age 43)</p>
      <p>Microcontrollers: Arduino and MicroBit controllers were popular in Finland and
Greece (F3, F4, F5, E10, GR1, GR5). “I used a couple of years ago the breadboard of
Arduino and for myself it was a fruitful experience because I got to know more about
physics. In addition, I realized that students were motivated, excited and understood
more easily due to physical computing.” (Greek primary school teacher, age 36)</p>
      <p>Collaborative and Hands-on activities: Collaborative and “hands-on” activities
were described by most interviewees as liked and most engaging (F1, F2, F3, F6, F8,
E3). Physical computing has been used in making art and in games. “Hands on group
work seems to offer the easiest way to learn computational thinking.” (Finnish primary
school teacher, age 43)</p>
      <p>Competitions: Different kinds of playful competitions were also mentioned several
times (F2, F9, E4, E10). Beaty contests or dance competitions of the lego-robots were
used. “We used to do only the ‘Hour of code’, but there’s hardly anything that really
grasps and motivates the students. Then again, giving them a task (sumo wrestling lego
robots) that includes programming, they can be motivated. Of course they concentrate
on the looks of the robot, the flag it carries and everything else ‘unimportant’ that
doesn’t have anything to do with the ICT goal. But when they are motivated, they will
do work at home and they will compare their work with other students. After the first
sumo championship games, the students wanted to have a couple of weeks to modify
their robots and their programming and have a rematch. You don’t hear that when the
kids are just coding with the computer.” (Finnish primary school teacher, age 46)</p>
      <p>Overall, the idea of combining physical and computer activities was seen very
positively to also change attitudes towards computer work.</p>
      <p>The second part of the evaluation looked at the Competency Framework. Most
teachers recognised potential to achieve the competencies within the COTA framework
(Fig. 1). More specifically, The German teachers ranked different competences
differently, the most important were: 1) Problem solving, 2) Algorithmic thinking, 3) Digital
/ media literacy, 4) Utilizing programs for problem solving, 5) ICT as tools for learning.
The view of the experts was rather different on the competencies of programming in a
specific language. While one expert found this a regular competency “(Scratch)
Programming is regularly taught from grade 2-3” (GR1), another expert clearly said that
“I don’t think that in primary school students learn programming.” (GR7) The category
of debugging was also controversial. As a consequence, we will continue to revise the
curriculum in further trials with school children and teachers. Overall, there was
consensus that CT is necessary in this age group or as one expert said: “It is the best age
to learn the basics”. Overall, the curriculum was perceived very positively as a starting
point for profile building for different requirements (in each country).</p>
      <p>As a final aspect, we asked for support needs towards enabling teaching of
computational thinking and physical computing. Key findings are quite obvious on resources
(time, funding, learning resources, competences, training) but also the teachers hope
they could have hands-on playing and testing time before introducing physical
computing activities in their teaching. There are some differences between the European
countries, but they all agree on the importance of increasing teachers’ competences and
providing learning resources ready, easy-to-use, easy-to-find, age appropriately
available. Finnish teachers are not currently worried about schools' infrastructure. Their need
is more towards teachers’ time. Chart X shows the country differences in teachers’
needs to see whether our approach of providing Open Educational Resources (OER)
and Practices (OEP) is feasible. The following figure shows the teachers’ requests.</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In this paper, we have outlined the concept of Computational Thinking and Acting
(COTA) which combines the concepts of Computational Thinking and Physical
Computing. The concept aims at providing new learning and teaching experiences with a
focus on contributing to competency development in the field of Computer Science as
well as future employability. We developed meta-artefacts as well as a method to
implement the competency framework, i.e., design principles and learning scenarios. The
initial evaluation has shown that our competency framework covers the most important
aspects of computer science and is feasible for schools and cross-subject teaching.</p>
      <p>As the next steps, learning scenarios will be evaluated in different schools and
subjects. We aim at better understanding the impact of CT competencies and improve the
design guidelines and learning scenarios. In the long-term, it will be of high importance
to understand the relation of CT and employability over time.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgement</title>
      <p>This research has been co-funded by the European Commission within Erasmus+
programme, project COTA, grant no. 2019-FI01-KA203-060877.
7</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Hoberg</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krcmar</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oswald</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Welz</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Skills for digital transformation</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Sousa</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rocha</surname>
            ,
            <given-names>Á.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Digital learning: Developing skills for digital transformation of organizations</article-title>
          .
          <source>Future Generation Computer Systems</source>
          ,
          <volume>91</volume>
          ,
          <fpage>327</fpage>
          -
          <lpage>334</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Buckingham</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Defining digital literacy</article-title>
          .
          <source>In Medienbildung in neuen Kulturräumen</source>
          (pp.
          <fpage>59</fpage>
          -
          <lpage>71</lpage>
          ).
          <source>VS Verlag für Sozialwissenschaften.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Eshet</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Digital literacy: A conceptual framework for survival skills in the digital era</article-title>
          .
          <source>Journal of educational multimedia and hypermedia</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ),
          <fpage>93</fpage>
          -
          <lpage>106</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>White</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Digital workplaces: Vision and reality</article-title>
          .
          <source>Business information review</source>
          ,
          <volume>29</volume>
          (
          <issue>4</issue>
          ),
          <fpage>205</fpage>
          -
          <lpage>214</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Dery</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sebastian</surname>
            ,
            <given-names>I. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>van der Meulen</surname>
          </string-name>
          , N. (
          <year>2017</year>
          ).
          <article-title>The Digital Workplace is Key to Digital Innovation</article-title>
          .
          <source>MIS Quarterly Executive</source>
          ,
          <volume>16</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Andriole</surname>
            ,
            <given-names>S. J.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Skills and Competencies for Digital Transformation</article-title>
          .
          <source>IT Professional</source>
          ,
          <volume>20</volume>
          (
          <issue>6</issue>
          ),
          <fpage>78</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Van</given-names>
            <surname>Laar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Van Deursen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. J.</given-names>
            ,
            <surname>Van Dijk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            , &amp;
            <surname>De Haan</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>The relation between 21st-century skills and digital skills: A systematic literature review</article-title>
          .
          <source>Computers in human behavior</source>
          ,
          <volume>72</volume>
          ,
          <fpage>577</fpage>
          -
          <lpage>588</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Ehlers</surname>
          </string-name>
          , U. D., &amp;
          <string-name>
            <surname>Kellermann</surname>
            ,
            <given-names>S. A.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Future Skills: The future of learning and higher education</article-title>
          ,
          <fpage>2</fpage>
          -
          <lpage>69</lpage>
          . Karlsruhe.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Frey</surname>
            ,
            <given-names>C. B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Osborne</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>The future of employment: How susceptible are jobs to computerisation?</article-title>
          .
          <source>Technological forecasting and social change</source>
          ,
          <volume>114</volume>
          ,
          <fpage>254</fpage>
          -
          <lpage>280</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Southama</surname>
            ,
            <given-names>D. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rohlb</surname>
            ,
            <given-names>A. L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Balserc</surname>
            ,
            <given-names>T. C.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>STEM GRADUATES AS DIGITAL CREATORS: COMPUTATIONAL THINKING FOR TWENTY-FIRST CENTURY EMPLOYABILITY</article-title>
          .
          <source>In The 23rd Australian Conference for Science and Mathematics Education</source>
          ,
          <volume>110</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Bocconi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chioccariello</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dettori</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ferrari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Engelhardt</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kampylis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Punie</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Developing computational thinking in compulsory education</article-title>
          .
          <source>European Commission, JRC Science for Policy Report.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Balanskat</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Engelhardt</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Computing our future: Computer programming and coding-Priorities, school curricula and initiatives across Europe</article-title>
          . European Schoolnet.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>ISTE CSTA</surname>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Operational Definition of Computational Thinking for</article-title>
          K-12
          <string-name>
            <surname>Education</surname>
          </string-name>
          . National Science Foundation.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Chung</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fox</surname>
            ,
            <given-names>E. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sheetz</surname>
            ,
            <given-names>S. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chung</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Fox</surname>
            ,
            <given-names>E. A.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Integrating Computational Thinking into Information Systems and Other Curricula</article-title>
          .
          <source>In Proceedings of the SIGED Conference.</source>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Qualls</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sherrell</surname>
            ,
            <given-names>L. B.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Why computational thinking should be integrated into the curriculum</article-title>
          .
          <source>Journal of Computing Sciences in Colleges</source>
          ,
          <volume>25</volume>
          (
          <issue>5</issue>
          ),
          <fpage>66</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Czerkawski</surname>
            ,
            <given-names>B. C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lyman</surname>
            ,
            <given-names>E. W.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Exploring issues about computational thinking in higher education</article-title>
          .
          <source>TechTrends</source>
          ,
          <volume>59</volume>
          (
          <issue>2</issue>
          ),
          <fpage>57</fpage>
          -
          <lpage>65</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Grover</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Pea</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Computational thinking in K-12: A review of the state of the field</article-title>
          .
          <source>Educational researcher</source>
          ,
          <volume>42</volume>
          (
          <issue>1</issue>
          ),
          <fpage>38</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Papert</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>1980</year>
          ).
          <article-title>Mindstorms: Children, computers, and powerful ideas</article-title>
          .
          <source>Basic Books</source>
          , Inc..
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Tedre</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Denning</surname>
            ,
            <given-names>P. J.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>The long quest for computational thinking</article-title>
          .
          <source>In Proceedings of the 16th Koli Calling International Conference on Computing Education Research</source>
          ,
          <fpage>120</fpage>
          -
          <lpage>129</lpage>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Knuth</surname>
            ,
            <given-names>D. E.</given-names>
          </string-name>
          (
          <year>1985</year>
          ).
          <article-title>Algorithmic thinking and mathematical thinking</article-title>
          .
          <source>The American Mathematical Monthly</source>
          ,
          <volume>92</volume>
          (
          <issue>3</issue>
          ),
          <fpage>170</fpage>
          -
          <lpage>181</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Wing</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Computational thinking</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>49</volume>
          (
          <issue>3</issue>
          ),
          <fpage>33</fpage>
          -
          <lpage>35</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Cuny</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Snyder</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wing</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Demystifying computational thinking for noncomputer scientists</article-title>
          . Unpublished manuscript
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Berland</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wilensky</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Comparing virtual and physical robotics environments for supporting complex systems and computational thinking</article-title>
          .
          <source>Journal of Science Education and Technology</source>
          ,
          <volume>24</volume>
          (
          <issue>5</issue>
          ),
          <fpage>628</fpage>
          -
          <lpage>647</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Weisgram</surname>
            ,
            <given-names>E. S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Bigler</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>The Role of Attitudes and Intervention in High School Girls' Interest in Computer Science</article-title>
          .
          <source>Journal of Women and Minorities in Science and Engineering</source>
          ,
          <volume>12</volume>
          (
          <issue>4</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>WISE</surname>
          </string-name>
          (
          <year>2015</year>
          ). Women in Science,Technology, Engineering and Mathematics:
          <article-title>The Talent Pipeline from Classroom to Boardroom</article-title>
          . https://wise.statementcms.com/uploads/wise/files/WISE_UK_Statistics_
          <year>2014</year>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Tissenbaum</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sheldon</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Abelson</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>From computational thinking to computational action</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>62</volume>
          (
          <issue>3</issue>
          ),
          <fpage>34</fpage>
          -
          <lpage>36</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Carson</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hunter</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuzik</surname>
            , N.,
            <given-names>G.</given-names>
          </string-name>
          et al (
          <year>2016</year>
          ).
          <article-title>Systematic review of sedentary behaviour and health indicators in school-aged children and youth: an update</article-title>
          .
          <source>Applied Physiology</source>
          , Nutrition, and Metabolism,
          <volume>41</volume>
          (
          <issue>6</issue>
          ),
          <fpage>S240</fpage>
          -
          <lpage>S265</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Blikstein</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Gears of our childhood: constructionist toolkits, robotics, and physical computing, past and future</article-title>
          .
          <source>In Proceedings of the 12th international conference on interaction design and children</source>
          (pp.
          <fpage>173</fpage>
          -
          <lpage>182</lpage>
          ). ACM.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Rees</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>García-Peñalvo</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jormanainen</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tuul</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Reimann</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>TACCLE3, An overview of the most relevant literature on coding and computational thinking with emphasis on the relevant issues for teachers.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Hodges</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sentance</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finney</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ball</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Physical computing: A key element of modern computer science education</article-title>
          .
          <source>Computer</source>
          ,
          <volume>53</volume>
          (
          <issue>4</issue>
          ),
          <fpage>20</fpage>
          -
          <lpage>30</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Przybylla</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Romeike</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Physical Computing and Its Scope--Towards a Constructionist Computer Science Curriculum with Physical Computing</article-title>
          . Informatics in Education,
          <volume>13</volume>
          (
          <issue>2</issue>
          ),
          <fpage>241</fpage>
          -
          <lpage>254</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Horn</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Bers</surname>
            ,
            <given-names>M. U.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Tangible computing</article-title>
          .
          <source>The Cambridge handbook of computing education research</source>
          ,
          <volume>1</volume>
          ,
          <fpage>663</fpage>
          -
          <lpage>678</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Topi</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valacich</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wright</surname>
          </string-name>
          , R. T.,
          <string-name>
            <surname>Kaiser</surname>
            ,
            <given-names>K. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nunamaker</surname>
            <given-names>Jr</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>J. F.</given-names>
            ,
            <surname>Sipior</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. C.</surname>
          </string-name>
          , &amp; De Vreede,
          <string-name>
            <surname>G. J.</surname>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Curriculum guidelines for undergraduate degree programs in information systems</article-title>
          . ACM/AIS task force.
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Todd</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McKeen</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Gallupe</surname>
            ,
            <given-names>R. B.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>The Evolution of IS Job Skills: A Content Analysis of IS Job Advertisements From 1970 to 1990</article-title>
          . MIS Quarterly,
          <volume>19</volume>
          (
          <issue>1</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Wesselink</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Biemans</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gulikers</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mulder</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Models and principles for designing competence-based curricula, teaching, learning and assessment</article-title>
          .
          <source>In Competencebased Vocational and Professional Education</source>
          (pp.
          <fpage>533</fpage>
          -
          <lpage>553</lpage>
          ). Springer, Cham
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Peffers</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tuunanen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rothenberger</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chatterjee</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A design science research methodology for information systems research</article-title>
          .
          <source>Journal of management information systems</source>
          ,
          <volume>24</volume>
          (
          <issue>3</issue>
          ),
          <fpage>45</fpage>
          -
          <lpage>77</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Distinguishing and contrasting two strategies for design science research</article-title>
          .
          <source>European Journal of Information Systems</source>
          ,
          <volume>24</volume>
          (
          <issue>1</issue>
          ),
          <fpage>107</fpage>
          -
          <lpage>115</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <surname>Offermann</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blom</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schönherr</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Bub</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Artifact types in information systems design science-a literature review</article-title>
          .
          <source>In International Conference on Design Science Research in Information Systems</source>
          (pp.
          <fpage>77</fpage>
          -
          <lpage>92</lpage>
          ). Springer, Berlin, Heidelberg.
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>Freiling</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gersch</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Goeke</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>On the path towards a competence-based theory of the firm</article-title>
          .
          <source>Organization Studies</source>
          ,
          <volume>29</volume>
          (
          <issue>8-9</issue>
          ),
          <fpage>1143</fpage>
          -
          <lpage>1164</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          41.
          <string-name>
            <surname>Berntson</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sverke</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Marklund</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Predicting perceived employability: human capital or labour market opportunities? Economic</article-title>
          and
          <string-name>
            <given-names>Industrial</given-names>
            <surname>Democracy</surname>
          </string-name>
          ,
          <volume>27</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          42.
          <string-name>
            <surname>Cai</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Graduate employability: A conceptual framework for understanding employers' perceptions</article-title>
          .
          <source>Higher Education</source>
          ,
          <volume>65</volume>
          (
          <issue>4</issue>
          ),
          <fpage>457</fpage>
          -
          <lpage>469</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          43.
          <string-name>
            <surname>Baskerville</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baiyere</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gregor</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hevner</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rossi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Design science research contributions: finding a balance between artifact and theory</article-title>
          .
          <source>Journal of the Association for Information Systems</source>
          ,
          <volume>19</volume>
          (
          <issue>5</issue>
          ),
          <fpage>3</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          44.
          <string-name>
            <surname>Webster</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Watson</surname>
            ,
            <given-names>R. T.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>Analyzing the past to prepare for the future: Writing a literature review</article-title>
          .
          <source>MIS Quarterly</source>
          ,
          <volume>26</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          45.
          <string-name>
            <surname>Venable</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pries-Heje</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Baskerville</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>FEDS: a framework for evaluation in design science research</article-title>
          .
          <source>European journal of information systems</source>
          ,
          <volume>25</volume>
          (
          <issue>1</issue>
          ),
          <fpage>77</fpage>
          -
          <lpage>89</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          46.
          <string-name>
            <surname>Kong</surname>
            ,
            <given-names>S. C.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>A framework of curriculum design for computational thinking development in K-12 education</article-title>
          .
          <source>Journal of Computers in Education</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ),
          <fpage>377</fpage>
          -
          <lpage>394</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          47.
          <string-name>
            <surname>Chande</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A Conceptual Framework for Computational Thinking as a Pedagogical Device</article-title>
          .
          <source>International Journal of Innovative Research in Computer and Communication Engineering</source>
          ,
          <volume>3</volume>
          (
          <issue>11</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          48.
          <string-name>
            <surname>Kotsopoulos</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Floyd</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Namukasa</surname>
            ,
            <given-names>I. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Somanath</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Yiu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>A pedagogical framework for computational thinking</article-title>
          .
          <source>Digital Experiences in Mathematics Education</source>
          ,
          <volume>3</volume>
          (
          <issue>2</issue>
          ),
          <fpage>154</fpage>
          -
          <lpage>171</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          49.
          <string-name>
            <surname>Nuutila</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Törmä</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Malmi</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>PBL and computer programming-the seven steps method with adaptations</article-title>
          .
          <source>Computer Science Education</source>
          ,
          <volume>15</volume>
          (
          <issue>2</issue>
          ),
          <fpage>123</fpage>
          -
          <lpage>142</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          50.
          <string-name>
            <surname>Sierra</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ariza</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Fernandez</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>PBL in programming subjects at engineering</article-title>
          .
          <source>Bulletin of the IEEE Technical Committee on Learning Technology</source>
          ,
          <volume>15</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          51.
          <string-name>
            <surname>Psycharis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kotzampasaki</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>A didactic scenario for implementation of computational thinking using inquiry game learning</article-title>
          .
          <source>In Proceedings of the 2017 International Conference on Education and E-Learning</source>
          (pp.
          <fpage>26</fpage>
          -
          <lpage>29</lpage>
          ). ACM.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>