<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A design-based study of Citizen Inquiry for geology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Maria Aristeidou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eileen Scanlon</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mike Sharples</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Educational Technology, The Open University</institution>
          ,
          <addr-line>UK. (Maria.Aristeidou, Eileen.Scanlon, Mike Sharples) @open.ac.uk</addr-line>
        </aff>
      </contrib-group>
      <fpage>7</fpage>
      <lpage>13</lpage>
      <abstract>
        <p>Citizen Inquiry forms a new method of informal science learning and aims to enable the engagement of citizens in online scientific investigations. Citizen Inquiry combines aspects from Citizen Science and Inquiry-based learning and is implemented through a community of practice where people having a shared interest interact and exchange knowledge and methods supported and guided by online systems and tools within a web-based inquiry environment. To explore the potential of Citizen Inquiry, a series of design-based studies will be developed to help in understanding and improving the engagement of citizens in online scientific investigation. “Inquiring Rock Hunters” is the first designstudy of Citizen Inquiry, applied to Geology, and it explores the experience of participants with inquiries, other participants and tools.</p>
      </abstract>
      <kwd-group>
        <kwd>Citizen Inquiry</kwd>
        <kwd>Online Science Education</kwd>
        <kwd>Citizen Science</kwd>
        <kwd>Inquiry-based Learning</kwd>
        <kwd>Geology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        The aim of the research project is to support members of the public in designing and
engaging in practical science investigations through online communities of interest.
Today, citizens are required more than ever before to make decisions concerning
scientific issues that influence their personal lives. The involvement of citizens in public
decision making has always been an obligation which is now even more vital in
addressing problems of common concern [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Citizens have to adopt a sense of shared
responsibility for issues regarding their communities or the world and become active
during the change process. Issues such as health care or energy policy are linked
directly to the well-being of the community and hence our personal lives.
      </p>
      <p>
        According to the “Public Attitudes to Science” report [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], while citizens recognise
personal benefits from involvement in science, the largest proportion (56%) of the
citizens in the U.K. say they do not feel informed about science. In addition, a smaller
but significant percentage (32%) of citizens report that they do not feel clever enough
to understand science and technology and 15% do not understand the point of all the
science being done today. It is this lack of scientific literacy and involvement in
science that forms the focus of the present research.
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>
        To address the problem of the lack of scientific literacy, the National Research
Council [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] proposed changes to science teaching to engage learners in authentic inquiry
and research. Inquiry-based learning (IBL) has been proposed as the best path to
achieve scientific literacy because it provides learners with the opportunity to discuss
and debate scientific ideas [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Moreover, IBL involves a departure from
contentaware learning while enhanceing the engagement of learners in the processes of
science by giving them the opportunity to pose questions, generate and analyse data,
draw conclusions, and communicate findings [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Informal science education
programs [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] as well as authentic inquiry practices and science outside of the classroom
can provide one of the venues for the scientific inquiry to be explored. An example of
this orchestration is the Personal Inquiry project [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        The Public Engagement with Science (PES) “dialogue” or “participation” model
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], developed in the last 14 years, aims to change personal science understanding, the
role of the individual person within a community, and the relation between science
and the society. An important component of PES is to bring together science experts
and non-experts in discussions to improve understanding of issues and to engage them
in shared scientific activities. Public Participation in Scientific Research (PPSR) is
another public-science model in which adults and children take part in the various
aspects of scientific enterprise [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Citizen Science projects are included in PPSR and
are defined as “Projects in which volunteers partner with scientists to answer
realworld questions” [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The main aim of a Citizen Science project is to produce more
science and it is usually directed by scientists. In some cases citizens are only
considered by scientists as a way to monitor and gather data [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] or as a means for the
scientists to increase their research productivity by the computational or intellectual power
of citizen volunteers [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. In these cases the citizen scientists participate in a small
part of the overall process, usually the data collection (e.g. iSpot) or the data
classification (e.g. Galaxy Zoo). Only a few projects involve Citizens in all the stages of the
research (e.g. Sherman’s Creek Conservation Association).
      </p>
      <p>
        Citizen Science can also be considered a powerful tool for public education as it
contributes to the advancement of scientific literacy, informs about specific sciences,
enlightens the scientific method, and it brings new voices to scientific research [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
Citizen Science generates important informal learning experiences through its
engagement with several aspects of authentic science [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Inquiry experiences can
provide valuable opportunities for public to improve their understanding of both science
content and scientific practices [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and Citizen Science makes them available.
However, in order for citizen science to be educationally beneficial a number of key
factors have been identified.
      </p>
      <p>
        Jordan et al. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] note the need for balance between learning goals and scientific
goals in a Citizen Science project. Thus, there must be a balance in the data collection
to be achieved and the expected broad learning goals. The evaluation plan should
ensure that the learning goals are consistent with the project activities, the learning
outcomes are presented with clarity and both of them can be measured through
indicators [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Pandya [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] also suggests that the most successful projects will involve
community members as active participants in every aspect of the scientific procedure.
That will happen by co-managing the project (involving community leaders,
interactions between scientists and citizens and providing training to the members), engaging
the community at every step including entire families, incorporating multiple kinds of
knowledge and disseminating findings shared to all the participants. Yet, people of all
ages need support to act as scientists, by carrying out appropriate investigations,
collecting and examining authentic data and presenting their results in a systematic
manner [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Citizen Inquiry</title>
      <p>
        Citizen Inquiry forms a new method of online science learning and combines aspects
from Citizen Science and Inquiry-based learning, producing science learning
experiences within distributed communities of interest. Important components of such an
orchestration are collaboration, knowledge sharing and peer review (Citizen Science)
as well as experimentation, discovery, critique and reflection (Inquiry-based
Learning). At the same time, Citizen Inquiry applies to adult learners who no longer
participate in formal education [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and includes personal meaning
making activities. Citizen Inquiry may fill the gap between Citizen Science and
Inquirybased learning and lead to a novel way of public engagement in science.
      </p>
      <p>
        Citizen inquiry is proposed as a new method of learning, which will enable the
engagement of citizens in online scientific inquiries. Regarding the level of public
engagement, it falls closer to the co-created projects [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] and to this end, the participants
of Citizen Inquiry projects will be expected not only to be active during the whole
project but also to improve their understanding of science and develop skills used by
scientists.
      </p>
      <p>
        Moreover, Citizen Inquiry emerges as an informal learning mechanism as it is
developed outside the formal education’s curricula and is being driven by the personal
interest of citizens employing their everyday experience with science and its
underpinning reasoning. Similar to Inquiry-based Learning, it engages citizens with
scientific activities such as collecting data, conducting experiments and reflecting on their
work [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. By extension, Citizen Inquiry involves citizens in planning and
implementing their own inquiries in a self-directed way, employing scientific tools and
skills, sparked by their personal experience of everyday science. Citizen Inquiry
would be implemented through a community of practice where people (experts and
beginners) having a shared interest will interact and exchange knowledge and
methods supported and guided by online systems and tools within a web-based inquiry
environment.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Research Question</title>
      <p>This research will focus onthosescience fields where expert and non-expert scientists
caninteract in an online community of practice in order to exchange knowledge and
methods of experimentation through peer collaboration and mentoring. The outcomes
of the research will help in understanding and improving public engagement with
science and facilitate the design of Citizen Inquiry. Within this frame of reference, the
research question formed at this stage is:
“How can non-expert scientists engage in successful online inquiry based learning
through peer collaboration and mentoring by experts without formal instruction?”</p>
      <p>Focusing on its main components, the question is then split into four
subquestions/categories:
1. Inquiry-based Learning: How do non-expert scientists engage with the phases of
the inquiry process?
2. Collaboration: In what ways do the participantscollaborate: which tools do they
prefer to use and how do they interact?
3. Mentoring: What help do non-expert scientists requestand how do they make use
of that help?
4. Informal settings: How effective is the web-based inquiry environment in
supporting engagement in scientific investigation?
5</p>
    </sec>
    <sec id="sec-5">
      <title>Research Methodology</title>
      <p>
        The current study employs a design-based research method. Designed-based research
utilizes mixed methods during the iterative research in order to analyse the outcomes
and re-design the intervention [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. Hence, it is a methodology comprised of
both qualitative and quantitative research applied to the research needs. The
combination of these increases the “objectivity, validity, credibility and applicability” of the
findings [25].
      </p>
      <p>
        The current methodology is considered sustainable for this research as it focuses on
the “development of sustained innovation in education” (p. 251) [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] and therefore it
acknowledges the enabling contributions of technology to education and the call for
understanding its connection with learning.Design-based research in this study
analyses and develops the interactions of participants with the technology, the activities and
the other participants. Each design study will build on the knowledge gained from
initially the pilot study (first design-study) and then a series of design-based studies
over the next 2 years of my doctoral studies. The results will help in understanding
the engagement of citizens in online scientific investigation and then improving it by
informing the design of the pedagogy and technology accordingly.
      </p>
      <p>The research questions will apply to each of the forthcoming design-studies. It is
expected that the question-framework mentioned above will be revised and modified
to fulfil the specific aim of each design-study. The evaluation of the studies employs
both qualitative and quantitative analysis techniques and includes:
 Interviews and focus group discussions with the individual participants involved in
the design-studies to assess engagement with the process and technology and the
attitudes to Citizen Inquiry.
 Processing of the scientific investigations and other scientific related data
produced.</p>
      <p>Collecting and analysing online communication, interaction and engagement with
the other participants.</p>
      <p>Surveying participants for the effectiveness, desirability and usability of the online
platform.</p>
    </sec>
    <sec id="sec-6">
      <title>Citizen Inquiry on Geology: “Inquiring Rock Hunters” project</title>
      <p>The first design-study of Citizen Inquiry applies to Geology and focuses on
engagement by amateur geologists in online scientific investigation through collaboration
with other amateurs and mentoring by expert geologists. The “Inquiring Rock
Hunters” project lasted for a month and exemplified Citizen Inquiry by enabling adult
citizens to run their own investigations in geology and giving them the opportunity to
collaborate with scientists. The interaction of the citizens with the scientific
investigation and the scientists took place on an online platform called nQuire[26] which
supports the social nature of Citizen Inquiry and provides tools to support both the
investigation and the communication between the participants. The 25 participants of
Citizen Inquiry were expected not only to be active during the whole project but also to
improve their understanding of science and develop skills used by expert
geologists.The evaluation methods of this first design-study include online questionnaires,
online and face-to-face interviews and online focus groups discussions seeking to
explore the experience of the participants with the inquiries, the other participants and
the tools. The data analysis will follow a top-down approach, driven by the research
objectives. The outcomes of this study will then inform the design of the next
intervention.
25. Mulholland, P., Anastopoulou, S., Collins, T., Feisst, M., Gaved, M., Kerawalla, L.,
Paxton, M., Scanlon, E., Sharples, M., Wright, M.: nQuire: Technological support for
personal inquiry learning. IEEE Transactions on Learning Technologies 5(2), 157-169
(2011)
26. Wang, F., Hannafin, M. J.: Design-based research and technology-enhanced learning
environments. Educational Technology Research &amp; Development 53(4), 5-23 (2005)</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>McCallie</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bell</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lohwater</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Falk</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehr</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewenstein</surname>
            ,
            <given-names>B. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Needham</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiehe</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          : Many Experts, Many Audiences:
          <article-title>Public Engagement with Science and Informal Science Education. A CAISE Inquiry Group Report</article-title>
          . Executive Summary.
          <article-title>Center for Advancement of Informal Science Education (</article-title>
          <year>2009</year>
          ), http://www.eric.ed.gov/ERICWebPortal/recordDetail?accno=
          <source>ED536432 (accessed March 25</source>
          ,
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ipsos</surname>
            <given-names>MORI</given-names>
          </string-name>
          . Public Attitudes to Science
          <source>2011: Summary Report</source>
          (
          <year>2011</year>
          ), http://www.ipsos-mori.com/Assets/Docs/Polls/sri-pas-2011
          <source>-summary-report.pdf (accessed March 16</source>
          ,
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>NRC</surname>
          </string-name>
          (National Research Council):
          <article-title>Learning science in informal environments: people, places, and pursuits</article-title>
          . Washington, DC: National Academies Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <article-title>American Association for the Advancement of Science</article-title>
          . AAAS Centers:
          <article-title>Center for Public Engagement with Science and Technology (</article-title>
          <year>2008</year>
          ), http://www.aaas.org/programs/centers/pe (accessed
          <source>March 21</source>
          ,
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Oberhauser</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>LeBuhn</surname>
          </string-name>
          , G.:
          <article-title>Insects and plants: engaging undergraduates in authentic research through citizen science</article-title>
          .
          <source>Frontiers in Ecology and the Environment</source>
          ,
          <volume>10</volume>
          (
          <issue>6</issue>
          ),
          <fpage>318</fpage>
          -
          <lpage>320</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Crall</surname>
            ,
            <given-names>A. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jordan</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holfelder</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Newman</surname>
            ,
            <given-names>G. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Graham</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waller</surname>
            ,
            <given-names>D. M.:</given-names>
          </string-name>
          <article-title>The impacts of an invasive species citizen science training program on participant attitudes, behavior, and science literacy</article-title>
          .
          <source>Public Understanding of Science</source>
          ,
          <volume>22</volume>
          (
          <issue>6</issue>
          ):
          <fpage>745</fpage>
          -
          <lpage>764</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Sharples</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anastopoulou</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Designing orchestration for inquiry learning</article-title>
          . In: Littleton,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Scanlon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Sharples</surname>
          </string-name>
          , M. (eds.) Orchestrating Inquiry Learning, pp.
          <fpage>69</fpage>
          -
          <lpage>85</lpage>
          .
          <string-name>
            <surname>Routledge</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Citizen</given-names>
            <surname>Science</surname>
          </string-name>
          <string-name>
            <surname>Central</surname>
          </string-name>
          , Cornell Lab of Ornithology: Defining Citizen Science (
          <year>2013</year>
          ), http://www.birds.cornell.edu/citscitoolkit/about/definition (accessed May 25,
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Conrad</surname>
            ,
            <given-names>C. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hilchey</surname>
            ,
            <given-names>K. G.</given-names>
          </string-name>
          :
          <article-title>A review of citizen science and community-based environmental monitoring: issues and opportunities</article-title>
          .
          <source>Environmental monitoring and assessment</source>
          <volume>176</volume>
          (
          <issue>1-4</issue>
          ),
          <fpage>273</fpage>
          -
          <lpage>291</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kostadinova</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Citizen science - the new helping hand for scientists</article-title>
          .
          <source>New Focus. Current Science</source>
          <volume>100</volume>
          (
          <issue>7</issue>
          ),
          <fpage>973</fpage>
          -
          <lpage>976</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Duke</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tonkin</surname>
          </string-name>
          , E.:
          <article-title>Patients participate! Literature review: Usability and human factors in citizen science projects, and trust and credibility on the Web</article-title>
          .
          <source>Report. Bath: UKOLN</source>
          (
          <year>2012</year>
          ), http://opus.bath.ac.uk/33730/1/PatientsParticipate_literature_
          <source>review_v1.2</source>
          .pdf (
          <issue>accessed September 4</issue>
          ,
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Jordan</surname>
            ,
            <given-names>R. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ballard</surname>
            ,
            <given-names>H.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
          </string-name>
          , T.B.:
          <article-title>Key issues and new approaches for evaluating citizen-science learning outcomes</article-title>
          .
          <source>Frontiers in Ecology and the Environment</source>
          <volume>10</volume>
          (
          <issue>6</issue>
          ),
          <fpage>307</fpage>
          -
          <lpage>309</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Edelson</surname>
            ,
            <given-names>D. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gordin</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pea</surname>
          </string-name>
          , R. D.:
          <article-title>Addressing the challenges of inquiry-based learning through technology and curriculum design</article-title>
          .
          <source>Journal of the Learning Sciences</source>
          <volume>8</volume>
          (
          <issue>3- 4</issue>
          ),
          <fpage>391</fpage>
          -
          <lpage>450</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>T.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bonney</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shirk</surname>
          </string-name>
          , J.:
          <article-title>What is our impact? Toward a unified framework for evaluating impacts of citizen science</article-title>
          . In: Dickinson,
          <string-name>
            <given-names>J.L.</given-names>
            ,
            <surname>Bonney</surname>
          </string-name>
          ,
          <string-name>
            <surname>R</surname>
          </string-name>
          . (eds.) Citizen Science:
          <article-title>public participation in environmental research</article-title>
          . Ithaca, NY: Cornell University Press (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Pandya</surname>
          </string-name>
          , R. E.:
          <article-title>A framework for engaging diverse communities in citizen science in the US</article-title>
          .
          <source>Frontiers in Ecology and the Environment</source>
          <volume>10</volume>
          (
          <issue>6</issue>
          ),
          <fpage>314</fpage>
          -
          <lpage>317</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. de Jong, T.:
          <article-title>Computer simulations - technological advances in inquiry learning</article-title>
          .
          <source>Science</source>
          <volume>312</volume>
          (
          <issue>5773</issue>
          ),
          <fpage>532</fpage>
          -
          <lpage>533</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Falk</surname>
            ,
            <given-names>J.H.</given-names>
          </string-name>
          :
          <article-title>Free-choice environmental learning: Framing the discussion</article-title>
          .
          <source>Environmental Education</source>
          <volume>11</volume>
          (
          <issue>3</issue>
          ),
          <fpage>265</fpage>
          -
          <lpage>280</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Falk</surname>
            ,
            <given-names>J.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Storksdieck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dierking</surname>
          </string-name>
          , L.D.:
          <article-title>Investigating public science interest and understanding: Evidence for the importance of free-choice learning</article-title>
          .
          <source>Public Understanding of Science</source>
          <volume>16</volume>
          ,
          <fpage>455</fpage>
          -
          <lpage>469</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Bell</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewenstein</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shouse</surname>
            ,
            <given-names>A. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Feder</surname>
            ,
            <given-names>M. A</given-names>
          </string-name>
          . (Eds.):
          <article-title>Learning science in informal environments: People, places, and pursuits</article-title>
          . National Academies Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Ballard</surname>
            ,
            <given-names>H. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huntsinger</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Salal harvester local ecological knowledge, harvest practices and understory management on the Olympic peninsula</article-title>
          , Washington.
          <source>Human Ecology</source>
          <volume>34</volume>
          ,
          <fpage>529</fpage>
          -
          <lpage>547</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Dewey</surname>
          </string-name>
          , J.:
          <article-title>How we think: A restatement of the relation of reflective thinking to the educative process. D.C Heath and Company (Original work published</article-title>
          <year>1910</year>
          )
          <article-title>(</article-title>
          <year>1933</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>White</surname>
            ,
            <given-names>B. Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frederiksen</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          : Inquiry, modeling, and
          <article-title>metacognition: Making science accessible to all students</article-title>
          .
          <source>Cognition and Instruction</source>
          <volume>16</volume>
          (
          <issue>1</issue>
          ),
          <fpage>3</fpage>
          -
          <lpage>118</lpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Design-Based Research</surname>
          </string-name>
          Collective.:
          <article-title>Design-based research: An emerging paradigm for educational inquiry</article-title>
          .
          <source>Educational Researcher</source>
          <volume>32</volume>
          (
          <issue>1</issue>
          ),
          <fpage>5</fpage>
          -
          <lpage>8</lpage>
          ,
          <fpage>35</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Bell</surname>
            ,
            <given-names>P. L.</given-names>
          </string-name>
          :
          <article-title>On the theoretical breadth of design-based research in education</article-title>
          .
          <source>Educational Psychologist</source>
          <volume>39</volume>
          (
          <issue>4</issue>
          ),
          <fpage>243</fpage>
          -
          <lpage>253</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>