=Paper= {{Paper |id=Vol-1993/8 |storemode=property |title=Experimentation of MOOC Approach to Practical Electronics Course |pdfUrl=https://ceur-ws.org/Vol-1993/8.pdf |volume=Vol-1993 |authors=Felix Garcia-Loro,Elio Sancristobal,Gabriel Diaz,Manuel Castro }} ==Experimentation of MOOC Approach to Practical Electronics Course== https://ceur-ws.org/Vol-1993/8.pdf
                    Experimentation of MOOC approach to Practical
                                  Electronics Course

             Garcia-Loro, F.[0000-0001-5445-2377], Sancristobal, E.[0000-0003-2102-977X] , Diaz, G.[0000-0001-9246-
                                         351X]
                                               and Castro, M.[0000-0003-3559-4235]

                                       UNED, Madrid 28040, Spain
                         [fgarcialoro ,elio, gdiaz, mcastro]@ieec.uned.es



                     Abstract. Massive Open Online Courses (MOOCs) fit well to several areas of
                     knowledge and their quality is tightly related to the designed path from the pre-
                     requisites to the objectives. However, a significant challenge arises when devel-
                     oping courses in which experimentation plays a key role. In 2013, DIEEC-UNED
                     (Department of Electrical and Computer Engineering, Spanish University for
                     Distance Education) launched the first MOOC that, in contrast to the usual learn-
                     ing strategy of these courses (focused on knowledge), is focused on experimen-
                     tation and knowledge application by accessing an electronics remote laboratory.
                     The MOOC was named: “Circuits Fundamentals and Applied Electronics”
                     (BCEP; “Bases de Circuitos y Electrónica Práctica”) and has been re-edited 3
                     times. This paper shows the results and experience acquired in this area, as well
                     as an analytical review of every element and its integration in the whole system.


                     Keywords: Remote laboratory, MOOC, Electronics, VISIR.


             1       Introduction

             Technical courses require practical experiences: the experience acquired through labor-
             atories provides active learning complements to theoretical knowledge and transversal
             benefits. the benefits of practical experiences are widely known for professionals and
             necessary for any person who seeks for a broad comprehension of the real-time perfor-
             mance beyond the ideal/theoretical models. Experimental learning scenarios can be
             used as an environment to corroborate electrical and electronics circuit laws and prin-
             ciples, or to discover the limits of ideal models. Therefore, universities and educational
             institutions trust in experimentation for building successful cross-curricular learning
             opportunities in technical courses [1], [2], [3].
                Traditionally, hands-on laboratories have been the tool used by institutions which
             follow a traditional education model. But Distance Education requires different ap-
             proaches in order to provide experimentation to students. tools as virtual laboratories
             (a software accessible through the Internet designed to imitate a typical lab environment
             and its behavior) have been possible thanks to the Internet. However, both are still a bit
             far from providing to student the real performance and features of equipment under
             real-life operation conditions.




Proceedings of the International Conference MOOC-MAKER 2017.                                                          63
Antigua Guatemala, Guatemala, November 16-17, 2017.
                Remote laboratories (a real laboratory -real equipment and instruments- working on
             a real system, controlled remotely through the Internet) are the last tool merged to this
             ‘experimentation pool’. A review of the current literature shows a great number of uni-
             versities or organizations that have created their own virtual and remote laboratories to
             support life-long learning and students’ autonomous learning activities [4]-[12]. But
             remote labs are not only useful in Distance Education as they can be blended in with
             traditional learning/teaching environments.
                The essential difference between remote laboratories and hands-on laboratories re-
             sults from how the interaction between student and workbench is performed. Therefore,
             remote laboratories have very limited ability to provide manual skills. On this regard,
             some authors, [10]-[12], argue that physical presence is only one element in the per-
             ception of reality, a student's subjective mental reality.
                The possibility of a direct comparison between the different alternatives is con-
             strained by a lack of uniform criteria with which to evaluate the effectiveness of labor-
             atory [1], [13], [14]. It is impossible to conclude that any type of laboratory is superior
             to another objectively, but also each one provides different learning outcomes [1], [15].
             Regardless, the best solution is still a combination of the methods [1].
                In 2013, DIEEC-UNED launched the first MOOC providing access to a remote la-
             boratory for electronics experimentation. In fact, the core of the course was remote lab
             VISIR (Virtual Instruments Systems In Reality): all the activities revolve around its
             handling and the experimentation carried out in it. The MOOC was named: “Circuits
             Fundamentals and Applied Electronics” (BCEP; “Bases de Circuitos y Electrónica
             Práctica”) and has been re-edited 3 times. The goals on the MOOC deployment were:

              To provide access to anyone, with basic knowledge and interest on electronics.
              To test the VISIR remote laboratory performance under a high demand scenario.
              To analyze profile of students interested in this kind of courses and their needs to
               complete satisfactorily the course.


             2      MOOC-BCEP actors

             2.1    MOOC platform
             UNED-COMA platform, aimed at the deployment of MOOCs (xMOOCs) from UNED
             faculties and technical schools, is an Open-UNED initiative (https://uneda-
             bierta.uned.es/wp.). Open-UNED was created by the UNED in order to share Open
             Educational Resources (OER) from UNED. The platform explodes the rich experience
             of UNED in Distance Education.


             Activities
             UNED-COMA platform was not intended/designed for the integration of a remote la-
             boratory in MOOCs. Besides, the possibilities offered by UNED-COMA platform,
             when designing activities and assessment tasks, were: digital documents, the viewing




Proceedings of the International Conference MOOC-MAKER 2017.                                               64
Antigua Guatemala, Guatemala, November 16-17, 2017.
             of videos, video-questions or P2P activities. The assessment tools for evaluating student
             progress were based on quizzes, tests and P2P activities.


             Helpers
             UNED-COMA platform was intended to be a self-learning environment by means of
             videos, documents and the interaction between users. However, there were two figures
             for helping students:

              Facilitator: a person from UNED-COMA team who was monitoring the Forums and
               intervening when needed, resolving frequent questions, guiding participants and
               helping them with the platform.
              Curator: a person from teaching staff, who intervene in questions regarding to the
               content and/or methodology.


             Certificates
             UNED-COMA platform provided three certificates, (one unformal and two official):

              Badge: any student got a badge course by exceeding the cut-off grade point estab-
               lished by teaching staff.
              Online certificate: students had to exceed the cut-off grade point established by
               teaching staff and pay for the certificate.
              In-person certificate: the in-person certificate took place in one of the 61 study cen-
               ters in Spain and, on demand, in one of the collaborating centers outside Spain. The
               in-person certificate required student to have exceed the cut-off grade point.


             2.2    BCEP course
             Although the nature of MOOC BCEP is completely open, this course targets especially
             people with at least basic circuits knowledge, because in no case the course addressed
             theoretical contents: the main objective of the course is to learn practical competences
             in basic electronic circuits and provide to students a work philosophy.
                The core of the MOOC is the remote laboratory VISIR: evaluation and activities
             goes around VISIR and assessment was focused on handling the instruments and the
             interpretation of the measurements obtained from the remote laboratory, knowledge on
             electronics was no assessed, despite being necessary to understand the behavior.


             Structure
                The course structure comprised 8 modules: Module 1 was dedicated to electronics
             simulation; In Module 2 the remote laboratory VISIR is introduced to students, but they
             do not have granted access yet, demonstrative videos with the special features of every
             instrument and a VISIR manual are provided to students in order to familiarize with the
             laboratory workbench; From Module 3 to Module 8 students interact with VISIR, build-
             ing real circuits and performing measurements on them. Module 3 and Module 4 were
             designed for learning the handling of lab instruments (breadboard, multimeter, function




Proceedings of the International Conference MOOC-MAKER 2017.                                             65
Antigua Guatemala, Guatemala, November 16-17, 2017.
             generator, power supply and oscilloscope), whereas Module 5 to Module 8 were cen-
             tered on showing the behavior of real components and specific features of the instru-
             ments (coupling, trigger, cursors, measurements menu, etc.).


             Activities
             The course contains 97 evaluative activities, 55 standard multiple choice questions (in-
             cluding single-answer questions and multiple-answer questions) and 42 videos. The
             weight of the videos is 30% of the final grade and they need 80 over 100 to obtain the
             certifying badge. Besides this structure, two extra modules (one before the beginning
             of the course and another one once the students have completed the course) are respon-
             sible of compiling the students’ profile and their knowledge level by means of optional
             surveys and questions about basic circuit analysis and electronics components.


             2.3    VISIR remote lab
             VISIR is a remote lab for electric and electronic circuits experiments, developed at
             Blekinge Institute of Technology (BTH) in Sweden and in use in several universities
             all around the world [4]. In VISIR, the traditional equipment (DC-power source, func-
             tion generator, multimeter and oscilloscope) are replaced with an equipment platform,
             which is suited for remote control such as PXI (PCI eXtensions for Instrumentation),
             LXI (LAN eXtensions for Instrumentation) and GPIB (General Purpose Interface Bus).
             Therefore, VISIR is a real laboratory, as hands-on laboratories are, but designed for
             being accessible remotely.
                 The main advantage of VISIR, when comparing with other electronic remote labor-
             atories, lies in his concurrent access: multiple users interacting with the remote labora-
             tory simultaneously, designing the same or different circuits and monitoring the same
             or different signals in real time, as in an in-person laboratory with several workbenches.
                 Once the user wires the components and instruments on the breadboard and the in-
             struments are configured, the user is ready to send his/her experiment to the real lab.
             But, prior to the physical construction of the circuit, the designed circuit must be veri-
             fied by the measurement server comparing it with maxlist files. The maxlist files act as
             supervisors resolving if the circuit can be physical construct, and if the instruments
             settings are within the range considered by the instructor. if the designed experiment
             match with one of the possible configurations allocated in any of the maxlist files, the
             measurement server sends the request to the equipment server, and the equipment re-
             ceives server constructs the circuit designed by the user and delivers the results in real
             time. The whole process takes place in milliseconds.


             Hardware
             PXI Platform: the instrumentation platform of VISIR is based on PXI (PCI eXtensions
             for Instrumentation) from National Instruments. In VISIR, the traditional instruments
             (DC-power source, function generator, multimeter and oscilloscope) are replaced by
             the NI PXI-Instruments cards which are plugged into a chassis. A NI-PXI-Controller is
             plugged into the chassis as well.




Proceedings of the International Conference MOOC-MAKER 2017.                                              66
Antigua Guatemala, Guatemala, November 16-17, 2017.
             Relay Switching Matrix: The relay switching matrix is a stack of “PCI/104” sized
             boards, where the components are allocated, which controls the terminals connection
             of the components and the NI PXI-modules (Fig. 1, right), by the opening/closing of
             relays (Fig. 1, left).




                       Fig. 1. Component card (left) and NI PXI-Instrument cards (right).

             Software
              User Interface: The user interface is the frontal web page of VISIR that handles all
               the administration, access, and authentication (Hypertext Preprocessor) in connec-
               tion with a relational database management system MySQL, and it is hosted in an
               Apache HTTP webserver.
              Experiment Client: represents the entire laboratory workbench through an HTML
               page as an embedded object. The version used was written in Adobe Flash and em-
               bedded in the HTML code of the user interface (current version is written in
               HTML5). The available instruments are: Breadboard, DMM (Fluke 23), Function
               generator (HP 33120A), Oscilloscope (Agilent 54622A), DC power supply
               (E3631A).
              Equipment server: it is a software application for instrumentation control developed
               in LabVIEW. The equipment server software receives validated sequential experi-
               ment protocol requests from the measurement server. The results return back to the
               client PC-screen with the same sequence.
              Measurement server: handles the requests from experiment clients. A virtual instruc-
               tor module checks the circuits before they are passed on to the equipment server.


             2.4    Booking System
                The limitation imposed by VISIR on the number of simultaneous users required the
             use of a booking system. VISIR installed version had its own reservation system, how-
             ever it requires user authentication. To save users from manage two user accounts, one
             for UNED-COMA platform and another one for VISIR, it was required to produce a
             “booking system” in UNED-COMA platform. This resource was not designed exclu-
             sively for VISIR access but was designed for any tool which required a reservation.




Proceedings of the International Conference MOOC-MAKER 2017.                                          67
Antigua Guatemala, Guatemala, November 16-17, 2017.
                The settings used in the booking system from UNED-COMA for the three BCEP
             editions have been: 16 concurrent users per turn, 60 minutes per turn, a maximum of 2
             simultaneous turns reserved per user and a maximum of 14 reservations during the
             course. With these settings, VISIR allows a daily maximum of 384 students to experi-
             ment with any of the practices implemented. This configuration may have been altered
             during MOOC depending on the demand, but it was not necessary.
                The booking system was developed at the side of the MOOC platform, but it was
             also required to develop a new authentication service in VISIR. The available authen-
             tication services are shown in Fig. 2.




                            Fig. 2. Authentication in VISIR from UNED-COMA students.


             3      Results

             The data about students’ profile was gathered from different surveys. These surveys
             were created in GoogleForms as UNED-COMA platform did not provide any tool for
             this purpose. Although surveys were optional, over 3,700 responses have been gathered
             from pre-course survey and 102 from post-course survey.
             About the data from the course (individual monitoring final grades, dropout, etc.) the
             MOOC databases (PostgreSQL, MongoDB) were analyzed as UNED-COMA did not
             show this kind of information.


             3.1    Students’ profile
             All the videos and contents were in Spanish, this fact has been reflected in the origin of
             students. 71.4% of enrollments were students from Spain, 5.2% from Colombia, 4.6%
             from Mexico, 3.7% from Peru, 2.4% Argentina, etc.
                The age of students is distributed evenly. Slightly stands out the group of students
             over 40 years old. By contrast, the group of students under 20 years old was the minority
             one. These results are shown in Fig. 3, as well as previous experience in laboratories.




Proceedings of the International Conference MOOC-MAKER 2017.                                              68
Antigua Guatemala, Guatemala, November 16-17, 2017.
              Fig. 3. Main y-axis: Enrolled students grouped by age and divided by previous experience in
               any kind of laboratory (related to electronics or not); Secondary y-axis: percentage of each
             group to the total and percentage of students with previous laboratory experience of each group.


             3.2    Dropout
             The dropout rate has been high as is usually in this type of courses (Fig. 4); less than
             4% have obtained the course credential badge of those who started the course. One of
             the main reasons for this dropout have been the need of a theoretical background to
             understand circuits’ behavior. This fact is reflected in the high dropout rate in the first
             module (over 60%). A second peak (dropout rate almost 60%) happened when the re-
             mote lab activities started.


             3.3    Grades
                The grades obtained for those students who have completed at least one activity dur-
             ing first edition of the course are shown in Fig. 5, the cut-off mark was 0.8. Most of the
             grades under 0.15 were obtained by viewing videos.




             Fig. 4. Dropout. Percentage expressed from enrollments. Module dropout rate refers to the per-
               centage of students that do not completed the module having completed the previous one.




Proceedings of the International Conference MOOC-MAKER 2017.                                                    69
Antigua Guatemala, Guatemala, November 16-17, 2017.
                 Fig. 5. Scatterplot for the final grade of those students who completed at least one activity.


             3.4      Students’ evaluation of the practical work
             A bad design of the MOOC activities may cause students to focus on completing them
             instead of to analyze the results and to understand the behavior of the circuit and/or
             components. In this regard, students have been asked about the length of the experi-
             ments and the activities derived from them. In general terms, (Fig. 6), they agreed that
             both are long. Both distributions are skewed to the right (the mean is slightly greater
             than the median) and are concentrated between “5” and “8” (lower and upper quartiles).


             4        Discussion & Conclusions

             Because of the novelty of the initiative, the MOOC BCEP was well-received by the
             students. However, many aspects could have been better implemented.
             One of the worst actors has been the MOOC platform. The platform didn´t provide any
             tool to carry out surveys, so an external tool has been used to accomplish it, therefore
             there is no way to identify the behavior or interaction of students according to their
             profile.




                             Fig. 6. Answers from students who has completed BCEP MOOC.

                 Besides, the possibilities offered by UNED-COMA platform, when designing activ-
             ities and assessment tasks, were very limited: the viewing of videos, video-questions or
             P2P activities are the assessment tools for evaluating student progress.




Proceedings of the International Conference MOOC-MAKER 2017.                                                      70
Antigua Guatemala, Guatemala, November 16-17, 2017.
                In addition, the platform allows access to any module without any restriction. So,
             unexperienced students could use the remote lab. The course original design limited the
             access to a module to those students who had completed the previous ones.
                Users were anonymous for VISIR due to the way the interaction between the remote
             lab and the MOOC platform is carried out, when a student from BCEP MOOC accesses
             VISIR, the remote lab only records in its database that a user from MOOC platform
             was using the lab, but no further information.
                In this regard, a MOOC platform with the necessary tools for a deeper analysis of
             the students’ learning process and that integrates both environments (MOOC and re-
             mote laboratory) seems necessary in order to evaluate the convenience of the supple-
             mentary documentation (videos, documents, activities, etc.) and their relationship with
             learning and dropout.
                The students’ feedback revealed that practices designed were easy for those students
             who had a previous training in electronics, but complex for those who didn’t. In fact,
             only 33.84% of those enrolled had some training related to electrical/electronic engi-
             neering previously to the MOOC. This lack of academic training in electrical/electronic
             area has been reflected in first modules. As a negative data, only 11.73% of enrollments
             were women but this percentage increases (over 17%) for younger students.
                About the activities, they agreed that, both, the activities they have had to perform
             in the remote laboratory (measurements, wirings, variations of the same circuit, etc.)
             and the activities derived from it (calculations, graphs, tables, etc.), were long.
                About the course and contents, it looks like practices and activities were easy for
             students who had a previous training in electronics, but complex for those who didn’t.
             The high dropout and its analysis suggest that students need a theoretical framework to
             jump successfully into experimentation as well as learning scaffolding designed for
             novice electronics students. A new design of the course is required to include theoretical
             content together with practical experiences, new practices and alleviate the workload.
                About VISIR remote laboratory, it is well suited to courses with massive enrollments
             because of its concurrent access, but the intrinsic limitations of a real laboratory such
             as VISIR collide with one of the most relevant features that any MOOC should achieve:
             scalability. However, students’ opinion about VISIR performance was very positive.

             Acknowledgments. The authors acknowledge the support of the “Escuela Internac-
             ional de Doctorado” de la UNED, UNED Project, PR-VISIR, PIE-13, “Prácticas Remo-
             tas de Electrónica en la UNED, Europa y Latinoamérica con Visir”, eMadrid project
             (Investigación y Desarrollo de Tecnologías Educativas en la Comunidad de Madrid) -
             S2013/ICE-2715, VISIR+ project (Educational Modules for Electric and Electronic
             Circuits Theory and Practice following an Enquiry-based Teaching and Learning Meth-
             odology supported by VISIR) Erasmus+ Capacity Building in Higher Education 2015
             nº 561735-EPP-1-2015-1-PT-EPPKA2-CBHE-JP, PILAR project (Platform Integra-
             tion of Laboratories based on the Architecture of visiR), Erasmus+ Strategic Partner-
             ship nº 2016-1-ES01-KA203-025327 and MECA project- MicroElectronics Cloud Al-
             liance - Erasmus+ Knowledge Alliances 2015 nº 562206-EPP-1-2015-1-BG-EPPKA2-
             KA.




Proceedings of the International Conference MOOC-MAKER 2017.                                              71
Antigua Guatemala, Guatemala, November 16-17, 2017.
             References
              1. Naef, O.: Real Laboratory, virtual laboratory or remote laboratory: what is the most effective
                 way?. Intl. Journal of Online Engineering, Vol 2, No.3. (2006).
              2. Nedic, Z., Machotka, J. and Nafalski, A.: Remote laboratories versus virtual and real labor-
                 atories, 34th ASEE/IEEE frontiers in education conference, session T3E-1, pp.1-6. Novem-
                 ber 2003.
              3. Coble, A., Smallbone, A., Bhave, A., Watson, R., Braumann, A. and Kraft, M.: Delivering
                 authentic experiences for engineering students and professionals through e-labs. IEEE
                 EDUCON. pp 1085 – 1090. (2010).
              4. Tawfik, M., Sancristobal, E., Martin, S., Gil, R., Diaz, G., Colmenar, A., Peire, J., Castro,
                 M., Nilsson, K., Zackrisson, J., Håkansson, L., y Gustavsson, I.: Virtual Instrument Systems
                 in Reality (VISIR) for Remote Wiring and Measurement of Electronic Circuits on Bread-
                 board. IEEE Transactions on Industrial Electronics. vol. 6, no. 1, pp. 60–72. (2013).
              5. Sancristobal, E., Martin, S., Gil, R., Orduna, P., Tawfik, M., Pesquera, A., Diaz, G., Col-
                 menar, A., Garcia-Zubia, J. and Castro, M.: State of Art, Initiatives and New Challenges for
                 Virtual and Remote Labs. IEEE 12th International Conference on Advanced Learning Tech-
                 nologies, ICALT. pp.714-715. (2012).
              6. Potkonjak, V., Vukobratovic, M., Jovanovic, K. and Medenica. M.:Virtual Mechatronic/Ro-
                 botic laboratory - A step further in distance learning. Computers & Education. Vol 55 pp
                 465–475. (2010).
              7. Jara, C. A., Candelas, F. A., Puente, S. and Torres, F.: Hands-on experiences of undergrad-
                 uate students in Automatics and Robotics using a virtual and remote laboratory. Computers
                 & Education. Vol 57 pp 2451–2461. (2011).
              8. Rojko, A. Hercog, D. and Jezernik, K.: Power Engineering and Motion Control Web Labor-
                 atory: Design, Implementation, and Evaluation of Mechatronics Course. IEEE Transactions
                 on Industrial Electronics, Vol. 57, Nº. 10, pp. 3343– 3354. (2010).
              9. Hanson, B., Culmer, P., Gallagher, J., Page, K., Read, E., Weightman, A., Levesley, M.:
                 ReLOAD: Real Laboratories Operated at a Distance. IEEE Transactions on Vol. 2, Issue:
                 4., pp. 331–341. (2009).
             10. Sheridan, T.: Descartes, Heidegger, Gibson, and God: Towards an Eclectic Ontology of
                 Presence. Presence: Teleoperators and Virtual Environments, vol. 8, no. 5, pp. 551-559.
                 (1999).
             11. Biocca, F.: Inserting the Presence of Mind into a Philosophy of Presence: A Response to
                 Sheridan and Mantovaniand Riva. Presence. vol. 10, no. 5, pp. 546-556. (2001).
             12. Vivar M. A., and Magna, A. R.: Design, implementation and use of a remote network lab as
                 an aid to support teaching computer network. Third International Conference on Digital In-
                 formation Management, ICDIM, London (UK), 13-16. (2008).
             13. Ma, J. and Nickerson, J.: Hands-On, Simulated, and Remote Laboratories: A Comparative
                 Literature Review. ACM Computing Surveys, vol. 38, no. 3. (2006).
             14. Lang, D., Mengelkamp, C., Jager, R., Geoffroy, D., Billaud, M. and Zimmer, T.: Pedagogi-
                 cal Evaluation of Remote Laboratories in eMerge Project. European J. Eng. Education, vol.
                 32, no. 1, pp. 57- 72. (2007).
             15. Lindsay, E. and Good, M.: Effects of Laboratory Access Modes Upon Learning Outcomes.
                 IEEE Trans. Education, vol. 48, no. 4, pp. 619-631. (2005).




Proceedings of the International Conference MOOC-MAKER 2017.                                                      72
Antigua Guatemala, Guatemala, November 16-17, 2017.