<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The potential of a robotics summer course On Engineering Education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>N. M. Fonseca Ferreira</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>André Araujo</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>M.S. Couceiro</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>David Portugal</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Engineering Institute of Coimbra</institution>
          ,
          <addr-line>ISEC</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>INESC TEC - Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência (formerly INESC Porto)</institution>
          ,
          <country country="PT">Portugal</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Ingeniarius</institution>
          ,
          <addr-line>Coimbra</addr-line>
          ,
          <country country="PT">Portugal</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Knowledge Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development (GECAD) of the Institute of Engineering, Polytechnic Institute of Porto</institution>
          ,
          <country country="PT">Portugal</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>RoboCorp, I2A, Polytechnic of Coimbra (IPC)</institution>
          ,
          <country country="PT">Portugal</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>RobotCraft is an international internship with a summer course in robotics designed especially for BSc to PhD students. The students attending this 2-months program have the opportunity to work in robotics, focusing on several state-of-theart approaches, technologies and learned how to design, build and program their robots throughout multiple activities, carefully prepared to provide a wide range of skills and knowledge in the topic. This paper describes the methodology used to introduce participants to a hands-on technical craft on robotics and to acquire experience in the low-level details of embedded systems.</p>
      </abstract>
      <kwd-group>
        <kwd>Engineering education</kwd>
        <kwd>Project-based learning</kwd>
        <kwd>educational robotics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Robotics is a very attractive subject in the field of engineering. More frequently,
educators find robotics a suitable project-based learning tool. Using robots as a
teaching tool, can lead to the acquisition of knowledge and skills in several
engineering areas, such as electrical, mechanical and computer engineering areas. As
can also provide the students with problem solving, teamwork and self-taught skills.
With the educational benefits in mind, world-widely, some educators have been
creating for students extra-curricular activities involving robotics, such as Robotics
Summer Camps and Robot Competitions [
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4 ref5">1-5</xref>
        ]. Robot contests present several
successful designs for projects surveyed by students in universities, colleges and
schools. These contests can offer engineering assignments of different levels, from
a high-school competition [
        <xref ref-type="bibr" rid="ref6 ref7">6-7</xref>
        ] to advanced research programs such as the robotic
soccer initiative, or pose a challenging problem, designing a robot that can navigate
autonomously through a maze, find a lit candle, and extinguish it in minimum time.
      </p>
      <p>As a multi-disciplinary subject, robotics involves physics, mathematics, control,
programming, computer-aided design and hands-on technical skills. The primarily
focus of the robotics programs are different, while a Computer Science robotics
program may focus on the high-level algorithms used for image recognition and
navigation, a mechanical engineering program may focus on the manipulation of
servos and motors to complete specific tasks. For college students looking to
become involved in robotics, however, it can be difficult to find an introductory course
that empowers them with the knowledge to construct and operate their own
autonomous robots. The RobotCraft is an international internship with a summer course
in robotics designed especially for BSc to PhD students. The students attending this
2-months program have the opportunity to work in robotics, focusing on several
state-of-the-art approaches and technologies. The summer course, now in its second
edition and entitled as the 2nd Robotics Craftsmanship International Academy.</p>
      <p>RobotCraft 2017 received around 100 applications, but just 84 attended the
summer course. The attendants came from a wide range of countries, namely Egypt,
Spain, Jordan, Lebanon, Palestine, Portugal, Sweden, Turkey, Germany, Algeria,
Estonia, Finland, United Kingdom, Greece, Hungary, Italy, Morocco, Malaysia,
Netherlands, Romania, Russia, Kazakhstan Syria and Kosovo.</p>
    </sec>
    <sec id="sec-2">
      <title>2. International Summer School Program</title>
      <p>This summer school program designed to bring engineering students from all
over the world as a way to experience life and learning hands-on technical skills.
The program provided a solid learning opportunity for international students and
presented two challenges. The first challenge was the wide range of educational
backgrounds from the students. As a result, this course had to be accessible to
students who had never worked with embedded systems before, while at the same time,
it needed to engage and challenge those students who already had some robotics
project experience. This was the second major challenge faced; all of the presented
material had to be interesting and engaging enough to keep participants interested
on the course subjects, meeting the different needs of the international students.</p>
      <p>
        In order to support the wide range of background and skills level of the students,
the course was layout into six different topics, each with the duration of
approximately one week. The topics are summarized in Table 1. For each of these topics,
the participants attended a seminar, lectures and several practical sessions (Table
2.) The seminars presented were on enthusiastic topics and this learning activity
allowed the participants to have contact with researchers referred to each expertise
field. Also as part of their learning activities, as shown on Table 3, the existence of
practical assignments, in order to see results early on in the learning process, while
introducing concepts, allow the more advanced participants to customize their
systems [
        <xref ref-type="bibr" rid="ref8 ref9">8-9</xref>
        ]. The methodology used on this course allowed participants to accelerate
their learning processes, and also the development of systems thinking and the skills
13
13
of intensive purposeful teamwork; reducing the gap between background,
theoretical and practical activities.
      </p>
      <p>The practice is fundamental in the learning process and can offer educational
advantages: the participants acquired skills are required in many professional fields
and various science methods studied, can be apply on robot navigation and other
functions. The assignments provided to the students were creative and involved
instructive activities. The course schedule planning accounted the following factors:
Each topic should be preceded by its prerequisite topics; Each topic should be learned in
parallel with the linked topics; Combination of subjects and balance of theoretical,
seminaries and lab studies are desired; Seminaries presented by researchers in the
specific field of each workshop is extra motivation to the participants, this stimulate
the creative and guided by innovation, which suggests a professional who is capable
of maintaining the skills and knowledge updated to recent scientific–technological
advances. The team assignments given in each week, allowed the participants to
cooperate as a team and to work more independently. Table 3 shows the learning
activities used to achieve the objectives described.</p>
      <p>The final competition, in the end of RobotCraft, had two different goals: maze
solving and patrolling attributes. In the maze scenario, the robot needs to find its
14
14</p>
      <sec id="sec-2-1">
        <title>Seminar</title>
      </sec>
      <sec id="sec-2-2">
        <title>Lecture (theoretical lesson)</title>
      </sec>
      <sec id="sec-2-3">
        <title>Pratical sessions (lab practice)</title>
        <p>way through the maze; where the evaluation contemplates several conditions: the
distance to the maze’s exit elapsed, the time and the number of wall collisions.</p>
        <p>And in the patrol mission, the robot needs to patrol, cooperatively, a given
region, minimizing the idleness of all points of interests; therefore, the evaluation of
this patrol mission is on the average idleness. Table 4 shows for each subject
approached during the course, the intended learning objectives and the observed
outcomes, as well as an example of a proposed assignment given to the participants.
15
15</p>
      </sec>
      <sec id="sec-2-4">
        <title>Observed Learning Outcomes</title>
        <sec id="sec-2-4-1">
          <title>Apply C language in Arduino programming</title>
        </sec>
        <sec id="sec-2-4-2">
          <title>Create the interface to link the Arduino board with the sensors and actuators</title>
        </sec>
        <sec id="sec-2-4-3">
          <title>Simple tasks where both circuit All the participants achieved the</title>
          <p>and program needed to be intended learning objectives.
changed, e.g. modifying the All groups completed the
assigncommunication protocol start ment with good remarks by the
code. teachers.</p>
        </sec>
        <sec id="sec-2-4-4">
          <title>Participants must design a crea</title>
          <p>tive robot housing. The robot All the participants achieved the
housing should hold the 2-ultra- intended learning objectives.
sound sensors (left and right All teams showed creativity in the
sensors), 1 infrared sensor (front design of the 3D structure.
sensor) and 4 LEDs.</p>
        </sec>
        <sec id="sec-2-4-5">
          <title>Participants must follow a given All groups assemble their mobile</title>
          <p>hardware architecture in order platforms.
to construct their mobile robot All participants understood the
platform hardware architecture.</p>
        </sec>
        <sec id="sec-2-4-6">
          <title>Create a function that reads the</title>
          <p>ultrasound sensors and converts
its measurements in millimeters. The participants shown good
reCreate a function that reads the sponse to the Arduino module.
difference between the num- All groups were able to plan,
orbers of pulses counted by the ganize and execute the tasks.
encoders on each wheel since
last request.</p>
          <p>lttrAihhendceeeatarcpioerotnanaalntonhrdfdoablarmodonetwfghrusagplwraeeerhet,evhdceeeoallmoscn.ocdpidtrtieiehsssientogodni- ttTweeharaepsmeep.rvosasoliuntiaavtleiho,ehnlipgohfblaiegltlhwptaeinregtnicteihpaeacnihnt-s</p>
        </sec>
        <sec id="sec-2-4-7">
          <title>Relate kinematics with</title>
          <p>the robot control system</p>
        </sec>
        <sec id="sec-2-4-8">
          <title>Create and implement a kinematic model of a differential drive robot</title>
        </sec>
        <sec id="sec-2-4-9">
          <title>Interpret and operate in a Create a ROS package, that con</title>
        </sec>
        <sec id="sec-2-4-10">
          <title>ROS environment tains a node capable of subscrib</title>
        </sec>
        <sec id="sec-2-4-11">
          <title>Explore ROS features ing 3 topics provided by the</title>
        </sec>
        <sec id="sec-2-4-12">
          <title>Relate Arduino task with ROS code developed in the previous architecture task in Arduino.</title>
        </sec>
        <sec id="sec-2-4-13">
          <title>All participants shown some difficulties upon the introduction of ROS.</title>
        </sec>
        <sec id="sec-2-4-14">
          <title>The assistance and help of the</title>
          <p>teachers were fundamental and
on this module, they overcome
most of their drawbacks by team
interaction.</p>
        </sec>
      </sec>
      <sec id="sec-2-5">
        <title>Subject</title>
        <sec id="sec-2-5-1">
          <title>Robotics</title>
        </sec>
        <sec id="sec-2-5-2">
          <title>Computer</title>
        </sec>
        <sec id="sec-2-5-3">
          <title>Aided De</title>
          <p>sign (CAD)</p>
        </sec>
        <sec id="sec-2-5-4">
          <title>3D mobile</title>
        </sec>
        <sec id="sec-2-5-5">
          <title>Robot</title>
        </sec>
        <sec id="sec-2-5-6">
          <title>Arduino</title>
        </sec>
        <sec id="sec-2-5-7">
          <title>Programming</title>
        </sec>
        <sec id="sec-2-5-8">
          <title>Kinematics and</title>
        </sec>
        <sec id="sec-2-5-9">
          <title>Control</title>
        </sec>
        <sec id="sec-2-5-10">
          <title>ROS Architecture</title>
        </sec>
        <sec id="sec-2-5-11">
          <title>Simulating with Stage and ROS</title>
        </sec>
        <sec id="sec-2-5-12">
          <title>Artificial Intelligence (AI)</title>
        </sec>
        <sec id="sec-2-5-13">
          <title>Competition</title>
        </sec>
        <sec id="sec-2-5-14">
          <title>Sketch a robotic simulation setup and implement the mobile robot platform in ROS.</title>
        </sec>
        <sec id="sec-2-5-15">
          <title>Execute Stage software in ROS and evaluate the mobile robot performance.</title>
        </sec>
        <sec id="sec-2-5-16">
          <title>Illustrate and label differ</title>
          <p>ent AI approaches</p>
        </sec>
        <sec id="sec-2-5-17">
          <title>Implement and compare</title>
        </sec>
        <sec id="sec-2-5-18">
          <title>AI algorithms</title>
        </sec>
        <sec id="sec-2-5-19">
          <title>Operate the mobile robot platform in a real 3D scenario maze).</title>
        </sec>
        <sec id="sec-2-5-20">
          <title>Assess the performance of the surveillance algorithm (patrol).</title>
        </sec>
        <sec id="sec-2-5-21">
          <title>In a ROS package, create the</title>
          <p>needed files to simulate a virtual Almost all groups achieved the
inworld with a robot in Stage. tended learning objectives.</p>
        </sec>
        <sec id="sec-2-5-22">
          <title>The extra goal is to have the ro- Robot design creativity used in bot mapping the environment Stage, rewarded with extra with laser scans, in parallel with points. other tasks.</title>
        </sec>
        <sec id="sec-2-5-23">
          <title>Implement a simple algorithm inspired on biological systems, e.g. an ant algorithm.</title>
        </sec>
        <sec id="sec-2-5-24">
          <title>Conclude the algorithm de</title>
          <p>velopment of the mobile
robot platform. Evaluate and
carry out final
improvements.</p>
        </sec>
        <sec id="sec-2-5-25">
          <title>Almost all groups developed an</title>
          <p>ant algorithm.</p>
        </sec>
        <sec id="sec-2-5-26">
          <title>2-3 groups developed and imple</title>
          <p>mented a more advanced AI
algorithm.</p>
          <p>All groups were able to develop a
full operating mobile robot
platform.
10 of 15 groups enter the maze
final competition and just 3 teams
concluded a successful
surveillance algorithm.
16
16</p>
          <p>Robot Craftsmanship</p>
          <p>The course developed to be a practical hands-on experience for students of
various backgrounds; and to engage students on robotics, met some specific criteria: the
use of hardware and software supported by large communities, allowing students
the benefit of finding help and examples online, both during and after the course.</p>
          <p>All the devices used were relatively affordable, so that students could easily
purchase their own components to tinker with, after the course. Although simplistic,
the mobile robotic platform assembled, needed to comprise all relevant components
inherent to mobile robotics (Figure 1).</p>
          <p>After the assembly of the platforms, students were introduced to C language and
to some common algorithms in mobile autonomous robotic topics, such as mobile
robotic kinematics, motion control, localization, path planning, among others. They
started merging the developed algorithmic into systems capable of basic
autonomous functionality and evaluate it considering the robot performance and then,
improving the developed code.</p>
          <p>As they develop skills working with ROS (Robot Operating System), writing
robot software in a flexible framework, they acknowledge that several kinds of
robot bases have common points: wheels, motors, odometry, among others. The
interprocess communication is an important feature to the overall process. The robot
17
17
needs to see obstacles and decide where to go next (reactive walk). For this, it
continuously needs to read laser scans to make decisions, where through a simple
algorithm; it sends commands to the base. This is a kind of service used on any mobile
robot. Simple service, like navigation consists on the determination of a valid
trajectory between two points, provided by a map. Knowing the robot position, the
localization of the robot in space is possible. Synchronous communication is an
important issue when defining goals for the robot to move, for determining the
possible paths and for knowing when the robot got there.</p>
          <p>In order to avoid harming the robot or oneself, they simulated their approach
before attempting it in the real robot platforms. They used Stage (OpenSource
software), a standalone robot simulation program, on the ROS platform and were able
to simulate multi-robot tasks in a ROS packages (e.g., coverage, patrolling,
formation control, exploration, mapping, and it can include robots, sensors, actuators,
moveable and immovable objects). The attendants learn to configure properly a
workspace, to set up and run the simulation program, and to create a ROS package
for the simulations. They were able to test and validate their project.</p>
          <p>In the final week of the course, participants worked together on the development
and improvement of their mobile robot platforms. They gained experience in how
to accomplish tasks, in problem solving and in design decisions. Instructional time
was primarily spent guiding attendants through the implementation of algorithms,
and working through the difficulties and pitfalls of real hands-on development.
Their skills in scheduling timelines, teamwork and compromise were improved.
One noteworthy event was by the end of the last week, some teams realized that
they would not be able to complete the project in time to enter the competition. In
order to meet this goal, opposing teams worked together and even shared algorithms
and code. At the end of the week, all teams had developed robots that could
autonomously compete.</p>
          <p>In the final day, the competition took place, and comprised two different
objectives: first, the maze solving and second, the patrolling attributes (Fig. 3).</p>
          <p>Figure 3 shows the maze scenario, where the robot needs to find its way through
the maze and the patrol mission, where robots needed to patrol cooperatively a given
18
18
region, minimizing the idleness of all points of interests. The maze scenario
assessment was through the distance elapsed, time and number of collisions and for the
patrol scenario was through the average idleness.
4.</p>
          <p>Surveys</p>
          <p>To obtain a formalized feedback of the course, participants took two surveys.
The first was answered by 96% of enrolled attendants. The main purpose of this
survey was to identify the overall knowledge, of each participant, in different related
topics. The second, taken in the last seminar by 77% of enrolled participants, aimed
to get feedback from the attendants, about their expectations and to provide a useful
overall evaluation of the course.</p>
          <p>4.1. Participants</p>
          <p>During the first seminar, 81 participants answered the initial survey,
corresponding to 96% of enrolled attendants and came from twenty different countries. Being
an intensive summer course in English language and disseminated in several
information channels, Portugal (the host country) is second with just 7% of student
participation behind Turkey, representing 51% of enrolled students.</p>
          <p>The attendants became aware of the existence of this summer course through
several channels of information. The more important ones were through friends and
colleagues, social media and Erasmus channels, representing 70% of the enquiries.</p>
          <p>From the 81 attendants that answered the initial survey, 92.5% were university
students in their home countries, 79% had ages between 20 to 24 years old and 75%
of them were male. BSc, MSc and PhD students, corresponded to 80%, 10% and
2.5% of participants, respectively. Figure 4 shows the distribution of participants
according to the area of specialization. The others 7.5% already concluded their
studies and were not involved in a university course.</p>
          <p>Fig 4. Number of participants according to their area of specialization.</p>
          <p>As is it shown on figure 4, 80% of the participants have a background on, or are
attending, a university course on engineering. Electrical and electronics engineering
19
19
is the area with most participants, 31%, against 26% of participants with a
mechanical or mechatronics engineering background (14% and 12% respectively); 10% are
attending a Computer science course, 5% and 4% of them, are students on
Aerospace and Biomedical engineering, respectively.</p>
          <p>When asked, what were the main reasons (up to 3) for enrolling in this course;
participants gave different and diverse reasons. Some wanted to have an educative
summer, others to learn more on ROS, C# and/or Artificial Intelligence; others the
main purpose was to make an internship, or visit Portugal (9%), or to improve their
English. Most of them, around 42% shown to have personal interest in acquire
experience in robotics. Around 47% of the attendants said they had already built a
robot before.</p>
          <p>4.1.1 Women participation</p>
          <p>
            From the last decades the number of women in engineering courses has been
increasing [
            <xref ref-type="bibr" rid="ref10">10</xref>
            ]. This edition, has been no exception, there was an increase of the
percentage of women involved. There were 84 attendants, 25% of the enquiries
were female, corresponding to an increase of 20% of female participation from last
year edition. These female attendants came mainly from Turkey, followed by
Hungary and Morocco with 40%, 20% and 15% of participation, respectively. 80% of
them are BSc students, with ages between 20 and 24 years old. Their areas of
specialization are mostly on engineering, with 25% on Electrical and Electronics
Engineering, 20% on Business Informatics and 15% on Computer Science.
          </p>
          <p>4.2. Participants knowledge</p>
          <p>
            The initial survey had a series of questions, aimed to access the overall
knowledge of the participants in some areas, such as Computer-Aided Design, 3D
Printing, Mechatronics, Arduino Programming, Kinematics, Control, ROS and
Artificial Intelligence. Figures 5 and 6 illustrate the responses to six of the survey
questions, based on a five point Likert Scale [
            <xref ref-type="bibr" rid="ref11">11</xref>
            ]. Likert Scales have the advantage
that they do not expect a simple answer (yes or no, good or bad) from the
respondent, but rather allow degrees of opinion, and even no opinion at all. For example,
there are Agreement, Frequency, Importance and is assumed that the experience is
linear. The left and right extremes, correspond to numbers 1 and 5, respectively.
And it is assumed that there is a continuum of possible answers from the left to the
right of the scales, that is, from Never to Very Frequently, or from Unimportant to
Very Important, and a choice of five pre-coded responses can be given, with the
neutral point being occasionally or moderately Important [
            <xref ref-type="bibr" rid="ref12">12</xref>
            ]. Figure 5 shows the
current understanding on the topics and reveals that most students do not understand
a large part of these topics. In fact, only 4 participants worked with ROS before
starting the course.
          </p>
        </sec>
        <sec id="sec-2-5-27">
          <title>Computer-Aided Design</title>
        </sec>
        <sec id="sec-2-5-28">
          <title>3D Printing</title>
        </sec>
        <sec id="sec-2-5-29">
          <title>Mechatronics</title>
        </sec>
        <sec id="sec-2-5-30">
          <title>Arduino Programming</title>
        </sec>
        <sec id="sec-2-5-31">
          <title>Kinematics</title>
        </sec>
        <sec id="sec-2-5-32">
          <title>Control ROS</title>
        </sec>
        <sec id="sec-2-5-33">
          <title>Artificial Intelligence</title>
          <p>Also the background in some subjects like electronic, computer, assembly
language, show that the participants have an overall poor knowledge and lack of
handson experience.</p>
          <p>4.3. Participants reactions</p>
          <p>Figure 6 illustrates a comparison made with the initial and final surveys taken by
the participants, the topics, which they had, a non-relevant initial understating are
ROS with 67%, Artificial Intelligence with 49%, followed by Kinematics,
Mechatronics, Control and 3D printing with a percentage of around 40%. The topics where
the seminars were more important in the context of the course were the lectures
within Arduino, Kinematics, ROS, Control and Artificial Intelligence, with 55%,
57%, 66%, 62% and 68%. These were also the topics where the evaluation of the
seminar lectures were more relevant, with 43%, 38%, 40%, 45% and 49%,
considers that the evaluation was positive. When comparing the initial and current
understanding on each topic, when comparing the initial and current understanding are
ROS topic with a 29% drop, from 67% to 38%, Mechatronics with a 17% drop from
42% to 25%, followed by Kinematics and 3D printing with a 15% and 14% drop.
In fact, ROS, Kinematics and Arduino topics had a very subtle increase of 10%, 2%
and 2% of participants with a relevant current knowledge on the topic. When asked
about the difficulty of these topics, the ones that had more percentage of
non-relevant knowledge and higher relevancy of the seminars lectures to their
understanding, ROS, Control and Artificial Intelligence appear with 51%, 46% and 48% of
percentage of participants alleging they were difficult topics to learn. In fact, about
ROS the participants felt this was a very important topic of the robotics course, but
it is very difficult to learn in just two weeks. Based on formal and informal feedback,
the course was successful in providing the participants with a meaningful
introductory, yet comprehensive robotics experience. In addition, their feedback is
important to improve the overall quality of this course.</p>
          <p>Fig 6. Participants opinion on the topics address
5. Conclusions</p>
          <p>A two months robotics course, aimed for international students from varying
engineering backgrounds, with the advantage of coupling various skill levels, was
successful. The methodology used, had the ability to give to participants an appropriate
introduction to a complete robotics design experience. The participants saw their
academic knowledge on some engineering subjects improved. The methodology
used, developed not just their technical skills but social also, through teamwork.
Even a moderate knowledge increase on some approach subjects is a finding that
robotics, if well approached, can be a multi-disciplinary learning platform.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Acknowledgments</title>
      <p>This work is financed by the ERDF – European Regional Development Fund
through the Operational Programme for Competitiveness and Internationalisation
COMPETE 2020 Programme within project «POCI-01-0145-FEDER-006961»,
and by National Funds through the FCT – Fundação para a Ciência e a Tecnologia
(Portuguese Foundation for Science and Technology) as part of
project UID/EEA/50014/2013.
22
22
23
23</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>E.</given-names>
            <surname>Kolberg</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Orlev</surname>
          </string-name>
          , “
          <article-title>Robotics learning as a tool for integrating science technology curriculum in</article-title>
          K-
          <volume>12</volume>
          schools,” presented at the Frontiers in Education Conference,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>F. B. V.</given-names>
            <surname>Benitti</surname>
          </string-name>
          ,
          <article-title>"Exploring the educational potential of robotics in schools: A systematic review"</article-title>
          <source>Computers &amp; Education</source>
          , vol.
          <volume>58</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>978</fpage>
          -
          <lpage>988</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Melchior</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Cohen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Cutter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Leavitt</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Manchester</surname>
          </string-name>
          ,
          <article-title>"More than robots: An evaluation of the first robotics competition participant and institutional impacts," Heller School for Social Policy</article-title>
          and Management, Brandeis University,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Grover</surname>
          </string-name>
          ,
          <article-title>"Robotics and Engineering for Middle and High School Students to Develop Computational Thinking,"</article-title>
          <source>in Annual Meeting of the American Educational Research Association</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>W. W.</given-names>
            <surname>Lau</surname>
          </string-name>
          , G. Ngai,
          <string-name>
            <given-names>S. C.</given-names>
            <surname>Chan</surname>
          </string-name>
          and
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Cheung</surname>
          </string-name>
          ,
          <article-title>"Learning programming through fashion and design: a pilot summer course in wearable computing for middle school students," SIGCSE Bull.</article-title>
          , vol.
          <volume>41</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>504</fpage>
          -
          <lpage>508</lpage>
          ,
          <year>March 2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Welch</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Huffman</surname>
          </string-name>
          , “
          <source>The Effect of Robotics Competitions on High School Students' Attitudes Toward Science,” School Science Mathematics</source>
          , vol.
          <volume>111</volume>
          , no.
          <issue>8</issue>
          , pp.
          <fpage>416</fpage>
          -
          <lpage>424</lpage>
          , Dec.
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Nugent</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Barker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Grandgenett</surname>
          </string-name>
          , and G. Welch, “
          <article-title>Robotics camps, clubs, and competitions: Results from a US robotics project</article-title>
          ,
          <source>” Robotics and Autonomous Systems</source>
          , vol.
          <volume>75</volume>
          , no.
          <source>Part B</source>
          , pp.
          <fpage>686</fpage>
          -
          <lpage>691</lpage>
          , Jan.
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Igor</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Verner</surname>
          </string-name>
          , Shlomo Waks and Eli Kolberg, “
          <article-title>Educational Robotics: An Insight into Systems Engineering”</article-title>
          ,
          <source>European Journal of Engineering Education</source>
          ,
          <volume>24</volume>
          :
          <fpage>2</fpage>
          ,
          <fpage>201</fpage>
          -
          <lpage>212</lpage>
          , DOI: 10.1080/03043799908923555, 1999
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Moshe</given-names>
            <surname>Barak</surname>
          </string-name>
          , “
          <article-title>From 'doing' to 'doing with learning': reflection on an effort to promote self-regulated learning in technological projects in high school”</article-title>
          ,
          <source>European Journal of Engineering Education</source>
          , Volume
          <volume>37</volume>
          ,
          <string-name>
            <surname>Issue</surname>
            <given-names>1</given-names>
          </string-name>
          , DOI: 10.1080/03043797.
          <year>2012</year>
          .
          <volume>658759</volume>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Duyen</surname>
            <given-names>Q.</given-names>
          </string-name>
          <string-name>
            <surname>Nguyen</surname>
          </string-name>
          , “
          <article-title>The Status of Women in Engineering Education”,</article-title>
          <string-name>
            <given-names>Int. J.</given-names>
            <surname>Eng</surname>
          </string-name>
          . Ed. Vol.
          <volume>16</volume>
          , No.
          <issue>4</issue>
          , pp.
          <fpage>286</fpage>
          -
          <lpage>291</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Likert</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , “
          <article-title>A Technique for the Measurement of Attitudes”</article-title>
          .
          <source>Archives of Psychology</source>
          ,
          <volume>140</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>55</lpage>
          ,
          <year>1932</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Paulhus</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          , “
          <article-title>Two-component models of socially desirable responding</article-title>
          ,
          <source>Journal of personality and social psychology</source>
          ,
          <volume>46</volume>
          (
          <issue>3</issue>
          ),
          <fpage>598</fpage>
          ,
          <year>1984</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>