<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Mobile Learning contexts for problem-solving competence assessment at higher education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alex Rayón</string-name>
          <email>alex.rayon@deusto.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>DeustoTech Learning - Deusto Institute of Technology - University of Deusto Avda. Universidades 24</institution>
          ,
          <addr-line>48007 Bilbao</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <fpage>93</fpage>
      <lpage>100</lpage>
      <abstract>
        <p>The leitmotiv and the real objective of this dissertation are to focus on new learning paradigms and contexts around mobile devices and problemsolving competence. This research begins with a thorough review of literature and other related works. It analyses them and extracts a number of conclusions regarding the reasons for the lack of specific Knowledge and Learning Technologies for mobile learning scenarios at higher education. Then, based on the trend of mobile computation and doing many activities in mobility, and the limitations encountered in the existing current teaching-learning processes, the dissertation proposes to create a new framework for mobile teaching-learning at higher education. Although some researchers offer a framework for theorizing about mobile learning, lecturers do not have yet a guideline about how to integrate mobile learning into their teaching more effectively.</p>
      </abstract>
      <kwd-group>
        <kwd>mobile learning</kwd>
        <kwd>collaborative learning</kwd>
        <kwd>competence based learning</kwd>
        <kwd>Knowledge and Learning Technologies</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Across the past two decades Information and Communication Technologies (ICT in
advance) have become ubiquitous in many aspects of life, changing the practices and
procedures within organizations and having the potential to improve many aspects of
them. Generally, ICT is a tool that any sector can use to deliver its services, since
communication among people has become independent of physical distance and time.
ICTs, in consequence, are transforming all human activities that depend on
information, including education services. Education and learning, as a social process of
individual growth and skill acquisition is derived from its social context. However,
this social frame has been radically changed by technology in general, and ICT
particularly; therefore these technologies should be included in the educational processes,
in all the stages of the education process (designing and developing educational
resources, teaching, evaluation, tutoring, etc.). Accordingly, the ICTs for education we
use at the University of Deusto, what we call Knowledge and Learning Technologies
(KLT in advance), are particularly stressed in the uses we can make of them for
learning and knowledge acquisition.</p>
      <p>A report from the McKinsey Global Institute 1 of May 2013, selects a dozen
of disruptive technologies, being Mobile Internet the technology with the most
outstanding one. Mobile learning technology is gaining a wide acceptance in education
as it is opening many possibilities. Current smart phones are not just phones; they are
computers in students’ pockets. If mobile technology is an effective learning tool, it is
especially among active mobile technology users, such as most university students.
According to comScore’s 2013 Europe Digital Future in Focus report 2, 57% of EU5
(France, Germany, Italy, Spain and United Kingdom) mobile users owned a
smartphone in the 3 month average ending December 2012. And, according to
comScore’s 2013 Spain Digital Future in Focus report 3, 81% of new phones acquired
in December 2012 in Spain were smartphones, so that is the country in EU5 which
shows a highest penetration in Smartphones with 66%. Already, almost 4 million
Spanish people had a Smartphone as well as a Tablet in December 2012.</p>
      <p>
        In general, m-learning is a learning activity that takes place without
considering a fixed location [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. It emphasizes the ability to facilitate the learning process
without being tied to a physical location [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. A number of researchers have
investigated the applicability of mobile technology in the learning context. Taylor et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
have identified a number of examples for how mobile technology can be adopted in
the learning environment, taking into consideration the user behavior, technology
infrastructure, and environment structure. So, the interest in this dissertation is not
only how learning occurs in a variety of settings and contexts, but also how learning
progresses across contexts using mobile devices.
      </p>
      <p>
        Besides of the new teaching-learning context produced by the new
humancomputer interaction paradigm mobile learning provokes, there is a new education
model oriented to the development of competences among the students. Society is
demanding new competences of its professionals and citizens in general, who are
required to have specific skills and abilities. So two positions can be adopted:
building on these competences in the professional sphere, or developing them within the
academic sphere prior to a career. Among these competences, this dissertation wants
to focus the analysis in problem-solving competence due to the increasing relevance
is getting in developed countries. In an analysis with data of the U.S. Department of
Labor made by Greiff et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], it was found that computerization was associated with
a reduction of routine tasks and a correspondent increase of complex tasks [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], as well
as a boost on demand for professionals who perform non-routine tasks, so-called
abstract tasks that require problem-solving, intuition, persuasion and creativity. These
tasks are characteristic of professional, managerial, technical and creative
occupations, like science, engineering, advertising, law, or medicine among others. People in
these jobs typically have high levels of education and analytical capability, and they
benefit from computers that facilitate the transmission, organization and processing of
1 http://www.mckinsey.com/insights/business_technology/disruptive_technologies
2 http://www.comscore.com/Insights/Blog/2013_Digital_Future_in_Focus_Series
3 http://www.comscore.com/Insights/Presentations_and_Whitepapers/2013/2013_Spain_Digital
_Future_in_Focus
information. This development has been observed in a number of countries and
appears particularly distinctive in service-oriented Western economies ([
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]).
      </p>
      <p>
        However, traditional instructional design models and classroom settings,
which remain the norm in formal educational settings such as the one we have at
higher education, have some limitations when it comes to addressing problem
complexity. So, accordingly, in this dissertation, we are going to consider Bloom’s Digital
taxonomy to classify KLT that could be applied in mobile learning contexts for the
development and assessment of problem-solving competence. We consider this
taxonomy as a proper reference because all the communication spectrum’s actions fit to
the activities that we develop within the teaching and learning processes under our
University of Deusto’s Learning Model [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], which allow accomplishing deeper level
of knowledge generation, besides promoting creativity, personal initiative, critical
thinking and the achievement of shared learning objectives [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Corbeil et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
summarized the benefits of mobile learning as great for people on the go, having
access to content on mobility.
      </p>
      <p>
        When technology-based tools serve as frame in learning environments, they
are often called cognitive tools, which, according to Jonassen [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], are
“computerbased tools and learning environments that have been adapted or developed to
function as intellectual partners with the learner in order to engage and facilitate critical
thinking and higher order learning”. Research has shown that cognitive tools have the
potential to facilitate knowledge construction, support conceptual understanding, and
scaffold higher-order cognitive tasks within complex learning environments ([
        <xref ref-type="bibr" rid="ref12">12</xref>
        ],
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]).
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Problem description and motivation</title>
      <p>The leitmotiv and the real objective of this dissertation are to focus on new learning
paradigms and contexts around mobile devices and the development and assessment
of problem-solving competence. This research begins with a thorough review of
literature and other related works. It analyses them and extracts a number of conclusions
regarding the reasons for the lack of specific KLT for previously stated contexts.
Then, based on the trend of mobile computation and doing many activities in
mobility, and the limitations encountered in the existing current teaching-learning processes,
the dissertation proposes to create a new set of web services to gather and later exploit
data from the interaction the student makes with the selected KLT for supporting of
the activities proposed by the professor for problem-solving competence assessment.</p>
      <p>Although some researchers offer a framework for theorizing about mobile
learning, lecturers do not have yet a guideline about how to integrate mobile learning
contexts with the support of KLT into their teaching more effectively. The University
of Deusto, under its 2011-2014 Strategic Plan, is committed with the integration of
learning technologies in the teaching-learning process to achieve academic
excellence. So, a major task for educational evaluation is to identify and analyze learning
within and across contexts. However, competence-based learning and its later
assessment in mobile contexts has not been faced yet. At the same time, the use of mobile
devices at class with learning purposes and the mass introduction of KLT at class,
have to get off the ground in the field of higher education. There are a number of
reasons for this:
•
•
•
•
•
•</p>
      <p>There is no sufficient consensus for efficient and useful KLT at class, and
thus, there cannot be an institutional push for the use of them.</p>
      <p>As a consequence, it has not yet been possible to establish neither a common
or standard framework, nor a methodology, nor specific tools to model
competence-based learning scenarios.</p>
      <p>Other research projects propose the use of mobile devices to enhance and
complement some teaching and learning activities, but not for the sake of
studying learning contexts itself.</p>
      <p>Other researchers have approached the notion of mobile devices at class
regarding the tool, without considering its possible uses and integration in
teaching-learning environments.</p>
      <p>Existing mobile learning successful experiences have been developed in an
adhoc manner and need a number of pre-requisites in order to work properly.
Besides, this experiences require huge hardware investments and heavy
dataload applications, what greatly restricts the use of mobile devices
Although Mobile learning settings show positive benefits, there has been little
empirical work done to translate them into the learning outcomes to get after
the competence development and its correspondent assessment.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Goals, hypothesis, assumptions, limitations and scope</title>
      <p>Based on what has been explained so far, this dissertation aims to: firstly, construct a
theoretical framework to model mobile teaching-learning contexts with the support of
KLT at higher education and, secondly, to carry out an experiment to test the
suitability of introducing those contexts at higher education for the development of
problemsolving competence throughout KLT at mobile devices. The information gathered will
be used to help ascertain the methods and strategies that should be incorporated in
future courses to improve learning effectiveness, so that we present a forecast of
experimentation and evaluation of formal experiences and proposes future research.</p>
      <p>The focus will be problem-solving competence, since it is considered one of
the most challenging ability students must gain, and one of the most important skill
students could develop throughout mobile devices. We propose a catalog of KLT to
use in mobile devices conducive to the assessment of this skill in those scenarios.
Under the main question of exploring Mobile Learning effectiveness in the
assessment of problem-solving competence, the general research questions that have guided
the piece of work proposed in this dissertation are: 1) Is the integration of mobile
learning experiences in higher education effective in terms of students’ perception and
results?; 2) Are KLT in mobile applications suitable to support the development and
assessment of competences?; 3) How do Mobile Learning and KLT influence
students’ work while solving problems proposed by the teacher?</p>
      <p>Considering these three questions, this dissertation describes a framework
proposing Knowledge and Learning Technologies that could be used in Mobile
Collaborative teaching-learning scenarios for the assessment of problem-solving
competence at higher education. Rather than developing new KLT suitable for the research
questions proposed, the Framework uses existing KLT and students’ Smart Devices,
taking into account the following premises: Students’ Smart Devices is the gadget that
will allow the interaction for the activity completion; WiFi and 3G/4G connections,
depending on the availability, will be mobile communication technologies; Bloom’s
Digital Taxonomy will be employed to classify KLT suitable for each context and
learning outcomes of problem-solving competence.</p>
      <p>The work presented here addresses two very important research areas:
Mobile Learning and Competence Assessment. The previous paragraphs introduced the
challenges that must be faced, so based on them; we enunciate the main hypothesis of
our research as follows:</p>
      <p>It is possible to develop a set of web services that extract interaction data between
the student and KLT on mobile learning contexts to assess students’ performance.
Those web services will gather data from institutional KLT, these are Google Apps
for Education and Moodle, that will allow teachers to provide feedback to the
students of the followed resolution process, and thus, improve their results in the
future.</p>
      <p>In order to validate the hypothesis, we must design and develop a data gathering web
services and validate them experimentally. So, the general goal of our research is:
The development and test of a set of web services that will gather interaction data
between the student and the KLT proposed by the teacher in mobile learning
contexts, capable of providing to the teacher enough data to improve students’
problem resolution strategy.</p>
      <p>Four specific goals arise from this general goal, as described below:
• Specific Goal 1.1. Provide an API to integrate these web services in and
across Moodle Learning Management System and other related educational
software.
• Specific Goal 1.2. To design and model Mobile Learning contexts supported
in KLT that result in a new definition of teaching-learning settings.
• Specific Goal 1.3. To check if we can improve technology enhanced digital
learning scenarios taking advantage of existing mobile communications,
mobile devices and users’ knowledge.
•</p>
      <p>Specific Goal 1.4. Identify interesting interaction parameters between the
student and the KLT in mobile learning contexts.</p>
      <p>These specific goals focus on the need to study these new teaching-learning scenarios
from a completely new perspective and address on of the major limitations of current
educational settings: not to be taking advantage of mobile devices, which generates an
opportunity cost in the whole educational processes (contents cannot be studied from
mobile devices, lecturing at class is not adapted to be compatible with mobile devices,
cheating at traditional exams is quite easy with mobile devices, etc.).</p>
      <p>These specific goals will be accomplished, and hence the general goal and
hypothesis, by means of a number of operational goals:
• Operational Goal 1: To establish the state of the art in Mobile Learning
and its use in competency-based learning models.
• Operational Goal 2: To establish taxonomy of KLT to use in Mobile</p>
      <p>Learning contexts for competence assessment.
• Operational Goal 3: To design and implement a data acquisition web
services over Google Apps for Education according to the indicators of
problem-solving competence.
• Operational Goal 4: To design and implement a procedure for the
automatic analysis of the results.
• Operational Goal 5: To apply, implement and use these web services to
obtain model results.
• Operational Goal 6: To design and implement a set of metrics to
measure the results of these new learning contexts.
• Operational Goal 7: To design and implement a set of criteria to select
the best KLT, according to the requirements and nature of a given subject.
• Operational Goal 8: To test and validate the proposed methodology.
• Operational Goal 9: To design and implement experiments by using for
the assessment and the improvement of students’ strategy our web
services.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Research methodology</title>
      <p>Seeking to achieve the goals marked and defined to validate the hypothesis, we
propose a research strategy that includes the following steps:
1. Acquisition of knowledge through constant review of publications that
advance the state-of-the-art techniques for spam filtering and detection, and by
attending conferences that bring together scientists involved in advancing the
state-of-the-art.
2. Design and development of models and applications that allow endorsing
the validity of the partial hypotheses and open new avenues of research.
3. Experimentation and evaluation of the results obtained with the
aforementioned models.
4. Redesign the models created, following the feedback obtained in the
experimentation.</p>
      <p>Presentation of preliminary results to the scientific community to obtain
feedback to help validate the followed path and see if the contributions
manage to offer a real advance in the state-of-the-art.</p>
      <p>Validation and diffusion of the acquired knowledge and learned lessons to
the scientific community.</p>
      <p>
        The figure shows graphically the schematic view of the research process, with the
main activities that take place and the flow of input and output that feeds the process.
In addition, in order to implement and evaluate the prototypes and the partial
approaches resulting from the investigation, we choose the Action Research
methodology [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], a cyclical methodology that comprises the following steps [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]:
      </p>
      <p>Diagnosis: identify or define a problem.</p>
      <p>Planning: consider the different alternatives of action.</p>
      <p>Action: select the action to take.</p>
      <p>Evaluation: study the consequences of the action.</p>
      <p>Definition: identify and detail the overall findings.</p>
      <p>These steps will be taken into account throughout the research process to provide
scientific rigor and critical thinking to all the activity.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Naismith</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lonsdale</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vavoula</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sharples</surname>
            ,
            <given-names>M. Literature</given-names>
          </string-name>
          <article-title>Review in mobile Technologies and Learning</article-title>
          .
          <source>Futurelab Series</source>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Kukulska</surname>
          </string-name>
          , H., and
          <string-name>
            <surname>Traxler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <article-title>Mobile learning. A handbook for educator and trainers</article-title>
          . New York. Routedge Falmer. (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , J.
          <article-title>Towards a Task Model for Mobile Learning: a Dialectical Approach</article-title>
          .
          <source>International Journal of Learning Technology</source>
          , vol.
          <volume>2</volume>
          , pp.
          <fpage>138</fpage>
          -
          <lpage>158</lpage>
          . (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Greiff</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wüstenberg</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holt</surname>
            ,
            <given-names>D. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldhammer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Funke</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <article-title>Computer-based assessment of Complex Problem Solving: concept, implementation, and application</article-title>
          .
          <source>Educational Technology Research and Development</source>
          . Vol.
          <volume>61</volume>
          (
          <issue>3</issue>
          ). pp.
          <fpage>407</fpage>
          -
          <lpage>421</lpage>
          . (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Frensch</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Funke</surname>
            ,
            <given-names>J..</given-names>
          </string-name>
          <article-title>Complex problem solving: The European perspective</article-title>
          . Hillsdale, NJ: Lawrence Erlbaum Associates. (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Autor</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dorn</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>This job is Getting Old: Measuring changes in job opportunities using occupational age structure</article-title>
          .
          <source>American Economic Review</source>
          . Vol.
          <volume>99</volume>
          . pp.
          <fpage>45</fpage>
          -
          <lpage>51</lpage>
          . (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Spitz-Oener</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Technical change, job tasks, and rising educational demands: Looking outside the wage structure</article-title>
          .
          <source>Journal of Labor Economics</source>
          . Vol.
          <volume>24</volume>
          (
          <issue>2</issue>
          ). pp.
          <fpage>235</fpage>
          -
          <lpage>270</lpage>
          . (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. University of Deusto.
          <source>Pedagogical framework UD. General Orientations</source>
          . pp
          <fpage>18</fpage>
          -
          <lpage>23</lpage>
          . Bilbao. (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Palloff</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          , Pratt,
          <string-name>
            <given-names>K. Collaborating</given-names>
            <surname>Online</surname>
          </string-name>
          . Learning together in Community, San Francisco, CA: John Wiley and Sons. (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Corbeil</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valdes-Corbeil</surname>
            ,
            <given-names>M. E.</given-names>
          </string-name>
          <article-title>Are we ready for mobile learning?</article-title>
          <source>EDUCAUSE Quarterly</source>
          ,
          <year>2007</year>
          , Vol.
          <volume>2</volume>
          , pp.
          <fpage>51</fpage>
          -
          <lpage>58</lpage>
          . (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Jonassen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>Computers as Cognitive Tools: Learning with Technology, Not from Technology</article-title>
          .
          <source>Journal of Computing in Higher Education</source>
          . Vol.
          <volume>6</volume>
          (
          <issue>2</issue>
          ). pp.
          <fpage>40</fpage>
          -
          <lpage>73</lpage>
          . (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Jonassen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>Modeling with technology: Mindtools for conceptual change</article-title>
          .
          <source>Upper Saddle River</source>
          , NJ: Merrill Prentice Hall. (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Pea</surname>
          </string-name>
          , R. D.
          <article-title>Beyond amplification: Using the computer to reorganize mental functioning</article-title>
          .
          <source>Educational Psychologist</source>
          . Vol.
          <volume>20</volume>
          (
          <issue>4</issue>
          ). pp.
          <fpage>167</fpage>
          -
          <lpage>182</lpage>
          . (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Salomon</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perkins</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Globerson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <article-title>Partners in cognition: Extending human intelligent technologies</article-title>
          . Vol.
          <volume>20</volume>
          (
          <issue>3</issue>
          ). pp.
          <fpage>2</fpage>
          -
          <lpage>9</lpage>
          . (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Berg</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <article-title>Qualitative research methods for the social sciences</article-title>
          .
          <source>Allyn and Bacon Boston</source>
          . (
          <year>1989</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Susman</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>Action research: a sociotechnical systems perspective</article-title>
          .
          <source>Beyond method: Strategies for social research</source>
          , pages
          <fpage>95</fpage>
          -
          <lpage>113</lpage>
          . (
          <year>1983</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>