<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Citizen science, data science and education: how to support teacher's inspiration during the learning activities design with technology enhance learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Miriam Calvera-Isabal</string-name>
          <email>miriam.calvera@upf.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Patricia Santos</string-name>
          <email>patricia.santos@upf.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Davinia Hernández-Leo</string-name>
          <email>davinia.hernandez-leo@mail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Pompeu Fabra University</institution>
          ,
          <addr-line>Plaça de la Mercè, 10-12 08002, Barcelona</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <volume>15</volume>
      <issue>5</issue>
      <fpage>2020</fpage>
      <lpage>2021</lpage>
      <abstract>
        <p>This research will investigate the potential that Citizen Science (CS) projects data has in a formal educational context to learn. CS involves citizens in scientific research generating knowledge and scientific results. Citizens participate in CS projects conducting many activities developing skills, interest in science or scientific literacy. These projects share their information in online repositories also called CS platforms to inform citizens about the aim of the project, their advances on research or how to take part in it. Although the connection between CS and education has been explored, remains to be understood and must be made more explicit. Web scraping and data mining methods have the potential to obtain CS projects data available online and analyze it to extract conclusions. The main aim of this research is to understand how to analyze and visualize CS data in a technology enhanced learning (TEL) tool to support educators during the learning design of educational activities. It is also intended to improve scientific knowledge and to bring official science closer to educational environments.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Citizen science</kwd>
        <kwd>technology enhanced learning</kwd>
        <kwd>data science</kwd>
        <kwd>web scraping</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Scientific literacy and critical thinking are
important skills for youth to raise awareness
and to address today’s societal challenges [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Citizen science (CS) by involving the general
public (from youth to adults) in scientific work,
might enhance public understanding of science,
contribute to Science, Technology, Engineering
and Mathematics (STEM) career motivation
and promote values like ecology or respect for
the natural environment [
        <xref ref-type="bibr" rid="ref2 ref3 ref4 ref5">2, 3, 4, 5</xref>
        ]. Scientific
research in CS is organized into projects, in
which participants carry out many types of
activities, depending on the typology of
participation defined [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. On taking part of the
project, citizens might develop: interest in
science and the environment, self-efficacy for
science and the environment, motivation for
science and the environment, knowledge of the
nature of science, skills of science inquiry and
behavior and stewardship [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        In order to promote and support CS projects,
there are many online platforms that acts as
repositories containing information about CS
projects and other resources (i.e., EU-Citizen
science platform [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]). The platforms share
descriptive metadata about the CS project but
only some of those follow metadata standards
to show it in a structured way [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. The Project
Metadata Model (PMM) which is part of the
Public Participation in Scientific Research
(PPSR) metadata standard [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] describes
project characteristics. Data shared in online
platforms has the purpose of explaining to a
particular audience what a citizen science
project is about. These texts, in general, use
special language related to science and contain
information about the project aim or an
explanation of the research. Web scraping
techniques in combination with data mining
methods have been used to extract and analyze
data from online sites to obtain conclusions in
many fields of science [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The use of data
extracted from texts, that contain information
about science, in combination with context of
real problems and instructions has the potential
of improving scientific literacy [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        Designing, planning and developing
activities requires pedagogical design capacity,
design competencies and design expertise of
teachers during the learning design process
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. It is expected that teachers have subject
matter knowledge (SMK) and pedagogical
content knowledge (PCK) to develop learning
designs [14] although it’s possible that they
need information, materials or training about
specific topics. Citizen science projects support
participants by developing educational
materials (i.e., guides, posters, manuals, videos
or podcasts) or sharing results or information
about the project that teachers can use to inspire
them during the learning design [15, 16]. Our
hypothesis is that facilitating data access for
educational purposes would have a positive
impact on teachers’ scientific knowledge and
pedagogical skills that would influence on
student’s scientific literacy and its relation to
science [17].
      </p>
      <p>Technology tools that support teachers
during the learning designs help them to ensure
a better learning experience [18]. Although
these tools try to cover teacher’s needs like
containing relevant resources (i.e Open
educational resources (OER) [19] or supporting
them during the design of activities, there are
barriers or factors that affect the adoption or
usage of the tool [20]. The benefits of involving
teachers as designers during the design process
of technology enhancing learning (TEL) are
numerous: from improving student’s learning,
their own learning about technology or
motivation and commitment of using
technology and implementing it [21, 22]. The
research conducted in this thesis will be
considered to (co)design (with educators) and
implement a digital tool to inspire and support
teachers. Exploring a tool that uses and shows
data about CS projects during the learning
design process in a formal education context,
will derive from improving SMK that will
foster on developing PCK.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Thesis statement</title>
      <p>The aim of this research is to better
understand the connections between education
and citizen science and to identify the potential
that data from CS has to support the design of
learning activities. The main research question
is: “How can data science methods be
effectively used to gain understanding of the
potential that web data about citizen science
projects have to inspire teachers in designing
for science learning outcomes?”. The related
sub research questions are the followings:
• How web scraping and data mining
methods can be used to collect/analyze data
online about citizen science projects?
• How data from CS projects can be
presented/analyzed in relation to their
potential to support learning outcomes in
formal settings?
• What features and content should be
integrated into a digital tool to inspire
teachers in the design process of scientific
learning activities based on citizen science?</p>
    </sec>
    <sec id="sec-3">
      <title>3. Methodology</title>
      <p>The methodology selected for this study is
Design-Based Research (DBR), it is expected
to meet the objective of contributing to
understanding the connections between citizen
science and educational research. First DBR is
applied to analyze the literature exploring the
connection between citizen science and
education, and identifying gaps. This is an
iterative process where the educator's needs
will be taken into account involving them in the
design process and evaluation of the prototype.
The tool will be used in a real educational
context to assess whether it meets the teachers’
needs and performs the function of supporting
teachers during the learning designs. Finally,
from the lessons learned, actions and
recommendations will be proposed to connect
citizen science with education in formal
settings.</p>
      <p>
        Mixed methods will be used in an iterative
process of testing and refinement cycles of the
design process [
        <xref ref-type="bibr" rid="ref14">23, 24</xref>
        ]. Both qualitative and
quantitative methods will be applied to obtain
results for the research questions defined
above:
• Literature review and exploration to
explore previous work done and how data is
structured in online platforms
• Web scraping methods will be used to
extract CS projects metadata, from online
platforms using web scraping tools [25]
• Workshops with key stakeholders will
be conducted to identify citizen science
community interest on data and teachers
needs during the design of learning activities
• Data mining Methods for data analysis
will be applied to the data extracted and to
explore problems related to the ways of
reporting data
• TEL tool development
      </p>
      <p>The PPM model from the PPSR metadata
standard will be used during this research to
structure data extracted in a database. Data
mining methods will be applied to analyze the
data stored in the database and obtain
conclusions about CS and its connection to
education.</p>
      <p>Moreover, collaborative partnerships with
experts will be built, to apply research findings
aligned to the teachers’ needs, to have a positive
effect on teaching and learning [26]. To fulfil
the main question and research objectives,
many activities have been designed, revised and
evaluated during the research. Interviews and
workshops with teachers and key users to
define and validate data needs, co-design the
tool and evaluate and test the final design of the
tool will be the main actions developed during
the evaluation process.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Research plan,</title>
      <p>limitations and
progress done so far
possible
risks and</p>
      <p>Part of the activities defined to achieve
research objectives are framed within the CS
Track project (European Union’s Horizon 2020
research and innovation program under grant
agreement No 872522) [27]. The work to be
done during the research is divided into four
different phases. There are planned activities to
address each research objective by applying
research methods defined above:</p>
      <p>Initial phase
• Literature review about citizen science,
its connection to education, TEL, data
science methods, web scraping methods
and teacher’s learning designs process.
• Research design and definition
2. Data extraction
• Explore and study how citizen science
projects information is shared online. At
this stage, there is to explore how citizen
science is conducted online and which
information about citizen science projects
is available
• Crawling citizen science projects data
from online platforms
• Defining descriptors/categories to
classify the data and analyzing existing
data to detect issues with the data. Analyze
metadata standards to be used to store
classified data extracted and define
characteristics of the central database
• Applying computational techniques to
address the data problem
3. Data analysis
• Defining and applying mixed methods
to analyze the data
• Creating post-processed data datasets
of interest to the community
4. Tool development and validation
(iterative process)
• Identifying how teachers design
learning activities and their needs during
the process
• Designing tool functionalities with
teachers
• Tool development
• Evaluating the tool with teachers to
validate the design proposed and the
usability. It will also be evaluated if the tool
fulfils the objective of inspiring teachers
and students</p>
      <p>Data extraction and crawler development
was done during this first year (Initial phase).
An initial version of the database has been
created and data has been initially analyzed
(data extraction). Some quantitative methods
and data mining methods have been applied so
far with initial outcomes (data analysis).
Hereinafter, data analysis methods will be
applied to the data stored (data analysis) and, in
parallel, the gathering of key user tool
requirements will begin before the end of the
second year. The outcomes of data analysis will
be available at the middle of third year at the
same time the tool will be being developed.
Finally for the first quarter of last year the tool
will be tested, improved and the potential will
be validated by key users (Tool development
and validation).</p>
    </sec>
    <sec id="sec-5">
      <title>4.1 Identification and prevention of possible limitation and risks</title>
      <p>This study will be focused on analyzing
science teaching in formal education needs
(primary and secondary school levels) and will
not take into account other educational levels
due to lack of time and resources to cover all.
This research will not analyze either the impact
on student’s learning because of the same
limitations. Nevertheless, teacher’s will be
asked about their experience and perceptions of
in which way students have learned after
developing activities designed by them. Finally,
finding participants to join co-design sessions is
challenging so we will do an open call to invite
secondary teachers to join the case studies
sessions. In addition to this, our research plan
includes the organization of workshops with
pre-service teachers that are studying a master
degree in UPF for teaching science subjects in
secondary schools.
4.2</p>
    </sec>
    <sec id="sec-6">
      <title>Progress done so far</title>
      <p>Being part of the CS Track project, gives us
the opportunity to be in touch with the citizen
science community and participate in
conferences. It was on “Knowledge for
Change: A decade of Citizen Science
(20202030) in support of the SDGs” [28], which took
place on 14th-15th October 2020 online and in
Berlin where we presented our advances on
data extraction and its potential on SDG [29].
Furthermore, during the “CitSciVirtual” [30]
conference which took place online throughout
May 2021, we presented a poster about
database development [31] and a workshop
where we presented metadata stored and got
feedback from the community about their data
needs.</p>
      <p>A preliminary study of how data mining
methods allow us to know more about citizen
science and its connection with education has
been accepted for the CELDA conference [32].
This proof of concept was developed to obtain
initial results of the research, design research
and select technology will be used.</p>
      <p>Regarding workshops with science
secondary teachers and tool development
(RO3), we have received “Grant for activities
to increase the social impact of research” from
UPF [33] to conduct it during 2021. As planned,
it will be done during the last quarter of second
year. As part of the CS-Track project,
workshops will also be held with key
stakeholders (teachers and/or CS participants)
Furthermore, as part of “Makers a les aules
(20-21)” program [34], it has developed the
first version of the tool to be tested with
students (8 to 10 years old) and primary school
teachers (Figure 1). The tool contained
information about some citizen science projects
related to the subject of the activity (i.e., sea
pollution). It allowed teachers and students to
read more about the project itself and the tools
used by participants.</p>
      <p>During the co-design activity with teachers
and one of the activities with students, they
explored the tool and the information shared
about citizen science projects and it was
evaluated at the end of the program the
influence of this information on the activity
designed and results. The influence of citizen
science projects data visualization has been
analyzed on the subject of human-machine
interaction with UPF undergraduate students.
The tool used by students contained
information about citizen science projects and
was assigned to a sustainable development goal
(SDG). This relation was established because of
the issue addressed by the activity. Apart from
the description and tools used by participants,
information from the web from where the data
has been extracted was also added in case
students wanted to explore the project in more
detail (Figure 2).</p>
    </sec>
    <sec id="sec-7">
      <title>5 Expected contributions</title>
      <p>The proposed study will make contributions
to the TEL and CS fields on the following
aspects (Figure 3):
1. Technical architecture of web scraping
tools and data management methods to
analyze and describe how citizen science
information is available online. As a result,
datasets of citizen science projects will be
developed.
2. The study will provide evidence on
how computational data analytics methods
can be applied in the context on citizen
science to broaden the knowledge about this
field and its relation to education
3. Proposal and development of a
technical environment to extract and process
data and tool to show it addressing the main
RQ.</p>
      <p>This research aims to contribute to TEL and
CS fields but mainly tries to impact on
teaching/learning science in formal education
settings. This study will be focused on
analyzing science teaching in formal education
needs during the conceptualization phase of the
learning design process.</p>
      <p>Lessons learned from the data scraping and
data mining process connecting CS and
Education, will be shared in the form of
guidelines, datasets and other contributions. A
tool will be co-designed with teachers as an
inspirational resource to get inspiration in
regards to certain scientific topics, and as a
facilitator to help them to design activities
about science. Furthermore, it is expected that
the data exploration process will potentially
improve teachers SMK and PCK.</p>
    </sec>
    <sec id="sec-8">
      <title>6 Acknowledgements</title>
      <p>This work has been partially funded by the
CS Track project, European Union’s Horizon
2020 research and innovation program under
grant agreement No 872522., a Grant for
activities to increase the social impact of
research” from UPF, the EU Regional
Development Fund and the National Research
Agency of the Spanish Ministry of Science and
Innovation under project grants
TIN201785179-C3-3-R, PID2020-112584RB-C33. D.
Hernández-Leo (Serra Húnter) acknowledges
the support by ICREA under the ICREA
Academia program.</p>
    </sec>
    <sec id="sec-9">
      <title>7 References</title>
      <p>[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
[22]</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Siarova</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sternadel</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Szőnyi</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <year>2019</year>
          ,
          <article-title>Research for CULT Committee - Science and Scientific Literacy as an Educational Challenge, European Parliament, Policy Department for Structural and Cohesion Policies</article-title>
          , Brussels
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Vohland</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Land-Zandstra</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceccaroni</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lemmens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perelló</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ponti</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , ... &amp;
          <string-name>
            <surname>Wagenknecht</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <source>The Science of Citizen Science Evolves. Chapter</source>
          <volume>1</volume>
          . in Vohland, K. et al (Eds.).
          <source>(2021) The Science of Citizen Science</source>
          . Springer. pp
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -58278-4.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Strasser</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baudry</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mahr</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanchez</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Tancoigne</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>" Citizen Science"? Rethinking Science and Public Participation</article-title>
          .
          <source>Science &amp; Technology Studies</source>
          ,
          <volume>32</volume>
          (ARTICLE),
          <fpage>52</fpage>
          -
          <lpage>76</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Hiller</surname>
            ,
            <given-names>S. E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kitsantas</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>The effect of a horseshoe crab citizen science program on middle school student science performance and STEM career motivation</article-title>
          .
          <source>School Science and Mathematics</source>
          ,
          <volume>114</volume>
          (
          <issue>6</issue>
          ),
          <fpage>302</fpage>
          -
          <lpage>311</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Kobori</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dickinson</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Washitani</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sakurai</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Amano</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Komatsu</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , ... &amp;
          <string-name>
            <surname>Miller-Rushing</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Citizen science: a new approach to advance ecology, education, and conservation</article-title>
          .
          <source>Ecological research</source>
          ,
          <volume>31</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Bonney</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ballard</surname>
          </string-name>
          , H.,
          <string-name>
            <surname>Jordan</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCallie</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shirk</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wilderman</surname>
            ,
            <given-names>C. C.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Public Participation in Scientific Research: Defining the Field</article-title>
          and
          <article-title>Assessing Its Potential for Informal Science Education. A CAISE Inquiry Group Report</article-title>
          . Online Submission.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Porticella</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Constas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Bonney</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <year>2018</year>
          .
          <article-title>A Framework for Articulating and Measuring Individual Learning Outcomes from Participation in Citizen Science</article-title>
          .
          <source>Citizen Science: Theory and Practice</source>
          ,
          <volume>3</volume>
          (
          <issue>2</issue>
          ), p.
          <fpage>3</fpage>
          . URL: http://doi.org/10.5334/cstp.126
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>EU-Citizen</surname>
          </string-name>
          .
          <source>Science platform. (2021, July</source>
          <volume>29</volume>
          ).
          <article-title>eu-citizen.science</article-title>
          . URL: https://eucitizen.science/ .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Wagenknecht</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Woods</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanz</surname>
            ,
            <given-names>F. G.</given-names>
          </string-name>
          , Gold,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Bowser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Rüfenacht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , ... &amp;
            <surname>Piera</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>EU-Citizen</article-title>
          .
          <article-title>Science: A Platform for Mainstreaming Citizen Science</article-title>
          and Open Science in Europe.
          <source>Data Intelligence</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ),
          <fpage>136</fpage>
          -
          <lpage>149</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Citizen</given-names>
            <surname>Science Association Data</surname>
          </string-name>
          &amp; Meta Data Working Group. (
          <year>2021</year>
          ,
          <article-title>July 29). PPSR Core, A Data Standard for Public Participation in Scientific Research (Citizen Science)</article-title>
          . URL: https://core.citizenscience.org/docs/project .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>D. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mathur</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2019</year>
          , June).
          <article-title>Data analysis by web scraping using python</article-title>
          .
          <source>In 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA)</source>
          (pp.
          <fpage>450</fpage>
          -
          <lpage>454</lpage>
          ). IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Sørvik</surname>
            ,
            <given-names>G. O.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mork</surname>
            ,
            <given-names>S. M.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Scientific literacy as social practice: Implications for reading and writing in science classrooms</article-title>
          .
          <source>Nordic Studies in Science Education</source>
          ,
          <volume>11</volume>
          (
          <issue>3</issue>
          ),
          <fpage>268</fpage>
          -
          <lpage>281</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Huizinga</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Handelzalts</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nieveen</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Voogt</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Fostering teachers' design expertise in teacher design teams: conducive design and support activities</article-title>
          .
          <source>The Curriculum Journal</source>
          ,
          <volume>26</volume>
          (
          <issue>1</issue>
          ),
          <fpage>137</fpage>
          -
          <lpage>163</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [23]
          <string-name>
            <surname>Amiel</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Reeves</surname>
            ,
            <given-names>T. C.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <article-title>Design-based research and educational technology: Rethinking technology and the research agenda</article-title>
          .
          <source>Educational Technology &amp; Society</source>
          ,
          <volume>11</volume>
          (
          <issue>4</issue>
          ),
          <fpage>29</fpage>
          -
          <lpage>40</lpage>
          . Park,
          <string-name>
            <given-names>S.</given-names>
            , &amp;
            <surname>Oliver</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. S.</surname>
          </string-name>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <article-title>Revisiting the conceptualisation of pedagogical content knowledge (PCK): PCK as a conceptual tool to understand teachers as professionals</article-title>
          .
          <source>Research in science Education</source>
          ,
          <volume>38</volume>
          (
          <issue>3</issue>
          ),
          <fpage>261</fpage>
          -
          <lpage>284</lpage>
          . Bonney,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Cooper</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. B.</given-names>
            ,
            <surname>Dickinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Kelling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Phillips</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Rosenberg</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <given-names>V.</given-names>
            , &amp;
            <surname>Shirk</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Citizen science: a developing tool for expanding science knowledge and scientific literacy</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>BioScience</surname>
          </string-name>
          ,
          <volume>59</volume>
          (
          <issue>11</issue>
          ),
          <fpage>977</fpage>
          -
          <lpage>984</lpage>
          . Brossard,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Lewenstein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            , &amp;
            <surname>Bonney</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Scientific knowledge and attitude change: The impact of a citizen science project</article-title>
          .
          <source>International Journal of Science Education</source>
          ,
          <volume>27</volume>
          (
          <issue>9</issue>
          ),
          <fpage>1099</fpage>
          -
          <lpage>1121</lpage>
          . Chan,
          <string-name>
            <given-names>K. K. H.</given-names>
            , &amp;
            <surname>Yung</surname>
          </string-name>
          ,
          <string-name>
            <surname>B. H. W.</surname>
          </string-name>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          (
          <year>2018</year>
          ).
          <article-title>Developing pedagogical content knowledge for teaching a new topic: More than teaching experience and subject matter knowledge</article-title>
          .
          <source>Research in Science Education</source>
          ,
          <volume>48</volume>
          (
          <issue>2</issue>
          ),
          <fpage>233</fpage>
          -
          <lpage>265</lpage>
          . Bennett,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Agostinho</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , &amp;
            <surname>Lockyer</surname>
          </string-name>
          ,
          <string-name>
            <surname>L.</surname>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Technology tools to support learning design: Implications derived from an investigation of university teachers' design practices</article-title>
          .
          <source>Computers &amp; Education</source>
          ,
          <volume>81</volume>
          ,
          <fpage>211</fpage>
          -
          <lpage>220</lpage>
          . Hylén,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Open educational resources: Opportunities and challenges</article-title>
          . Dagnino,
          <string-name>
            <given-names>F. M.</given-names>
            ,
            <surname>Dimitriadis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. A.</given-names>
            ,
            <surname>Pozzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Asensio‐Pérez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. I.</given-names>
            , &amp;
            <surname>RubiaAvi</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.</surname>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Exploring teachers' needs and the existing barriers to the adoption of Learning Design methods and tools: A literature survey</article-title>
          .
          <source>British Journal of Educational Technology</source>
          ,
          <volume>49</volume>
          (
          <issue>6</issue>
          ),
          <fpage>998</fpage>
          -
          <lpage>1013</lpage>
          . Kali,
          <string-name>
            <given-names>Y.</given-names>
            ,
            <surname>McKenney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , &amp;
            <surname>Sagy</surname>
          </string-name>
          ,
          <string-name>
            <surname>O.</surname>
          </string-name>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          (
          <year>2015</year>
          ).
          <article-title>Teachers as designers of technology enhanced learning</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Instructional</surname>
          </string-name>
          science,
          <volume>43</volume>
          (
          <issue>2</issue>
          ),
          <fpage>173</fpage>
          -
          <lpage>179</lpage>
          . Recker,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Walker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Giersch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Mao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            ,
            <surname>Halioris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Palmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            , ... &amp;
            <surname>Robertshaw</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. B.</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A study of teachers' use of online learning resources to design classroom activities</article-title>
          .
          <source>New Review of Hypermedia and Multimedia</source>
          ,
          <volume>13</volume>
          (
          <issue>2</issue>
          ),
          <fpage>117</fpage>
          -
          <lpage>134</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>