<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshop on Collaborative Technologies for Working and Learning, Sept.</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Towards a Design Research Framework for Designing Support for Informal Work-Based Learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bauters</string-name>
          <email>merja.bauters@aalto.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Colley</string-name>
          <email>Jo.Colley@tribalgroup.com</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bannan</string-name>
          <email>bbannan@gmu.edu</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Schmidt</string-name>
          <email>andreas_peter.schmidt@hs-karlsruhe.de</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Leinonen</string-name>
          <email>teemu.leinonen@aalto.fi</email>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Aalto University</institution>
          ,
          <country country="FI">Finland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>George Mason University</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Karlsruhe University of Applied Sciences</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Tribal Labs</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>University of the West of England</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2013</year>
      </pub-date>
      <volume>21</volume>
      <issue>2013</issue>
      <abstract>
        <p>This workshop a i m s to bring together different experiences of various design approaches for active and early scaling up of the appropriation of tools and practices. There exists, many Design Research approaches for developing TEL, but synthesising these approaches into a systematic framework is rare, even more so for scaling the use of TEL to support informal work-based learning. We briefly describe the work of four cases: Integrative Learning Design Framework (ILDF), the Design Process for scaling agility, Co-design approach, and Agile approach. In the workshop we drive for the framework that enables aggressive scaling. The design approaches are described with the goal to point the similarities and challenges for forming a synthesised framework.</p>
      </abstract>
      <kwd-group>
        <kwd>Design Research</kwd>
        <kwd>Research-based design</kwd>
        <kwd>Informal Learning</kwd>
        <kwd>Work-Based Learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Copyright © 2013 for the individual papers by the papers' authors.
transcend the everyday life-worlds of users and permeate the workplace and its
practices. Design Research has been often introduced as a modern approach suitable
to address complex problems in educational practice for which no clear guidelines
or solutions are available [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The approaches of: Integrative Learning Design
Framework (ILDF) and Shared Conceptual Models for Agility in Interdisciplinary
Research have been tested in previous projects for scaling and maturing of
knowledge (e.g. MATURE project http://mature-ip.eu/, ended March 2012).
These aspects are important to take into account because they enable the focus to
remain on aims other than tools and practice design. Especially scaling has
proved to be problematic in various EU-projects (e.g. KP-LAB project,
http://www.kp-lab.org/). Scaling is often related to uncovered drivers and obstacles
for adoption, which have to be found out. Knowing these aids the acceptance of
innovation and related processes early on in the design research cycle, which again will
aid opportunities for new modes of learning to scale beyond the local context. The
other two approaches: Co-design and agile process are intended to get the most
out of the design process. The first is focused more on ways of integrating all
stakeholders into the process to deepen engagement and ownership of the
stakeholders. Agile methods ([2, 3 and 4]) aim at being efficient in design and
development whilst still keeping the stakeholders involved. These two approaches
work hand in hand, with the emphasis on rapid iteration between establishing
requirements, designing alternatives, and building and evaluating prototypes. Through
the early and regular involvement of users, these approaches enable simultaneous
exploration of how users and the establishment of technical and pedagogical
requirements work, but if the approaches fall into the technology-first approach they lose the
end-users/stakeholders voice. Gulliksen et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] have identified that holistic design is
a key principle in designing for work and learning (learning in work). It explicitly
considers the work context, physical and social environment. The broader and deeper
insights into the users holistically has been highlighted in the UK, on issues
surrounding the National Health Service’s ongoing National Programme for Information
Technology (see [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]). This holistic aspect is the one where the Integrative Learning
Design Framework (ILDF) and the Design Process for scaling agility can
complement the other two selected approaches. Agile methods are mostly concerned with
end-user requirements, and often make the simplistic assumptions that: (a) suitable
users are available to interact with the development team and (b) the user
requirements are congruent with broader organisational requirements. Thus, the focus on
interaction with individual users does not address the need for broader socio-technical
awareness in systems. These focus differences point out further needs for the more
holistic approaches, which ensure that the scaling, physical and social environment,
feelings and practices are taken into account. These should be integrated with the
Agile methods and co-design approaches. [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
      </p>
    </sec>
    <sec id="sec-2">
      <title>2 Design approaches</title>
      <p>
        The Integrative Learning Design Framework (ILDF) has the general intent of
generating research-based insights about informal or formal teaching, learning and/or
training situations as well as applied solutions that provide and inform practical
understanding and applicability to real-world design projects. The ILDF is a
designbased research model that incorporates design process efficiencies from multiple
disciplines such as instructional design, object oriented software development,
product development, and diffusion of innovations research. It aims to provide the
opportunities to leverage the design process as a vehicle for analysing, codifying and
documenting what is learned when the designed artefact is enacted in the context of the
design process. The progressive yield from iterative and connected research and
design cycles is often lost because it is not always carefully documented [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It is
expected that the design process for creating e.g., mobile social learning (content
and interactions) will offer several new opportunities to generate best practices and
guidelines for both co-design and design research. The claim of this approach is
that following the ILDF model will inherently result in documenting designs. The
approach consists of four phases (Informed Exploration, Enactment, Local
Evaluation and Broad Evaluation) and aims to solve the problem often encountered in
traditional research of not capturing the research-based knowledge and important factors
relating to learning context, culture, and technology within the design process.
      </p>
      <p>
        The aim of the Shared Conceptual Models for Agility in Interdisciplinary
Research is to support and enhance the collective knowledge development
(“knowledge maturing”) in organisations from various perspectives. To be able to do
this, an agile project management approach is adopted to integrate parallel design
teams, empirical activities (ethnographic fieldwork, interviews, case studies) as well
as evaluation and theory building. It has been found that Design Research fits very
well with agile methods for design of software systems, but agile methods encounter
challenges when they are scaled towards interdisciplinary research in larger teams.
Broad projects such as EU-projects (e.g. The MATURE project, http://mature-ip.eu/,
ended March 2012), have shown that such contexts of many parallel interdependent
activities necessitate trade-offs between (i) relevance and usefulness to practice, (ii)
research advances, and (iii) technological innovation. By taking the assumption of
Design Research seriously that the design process itself is a learning and
problematisation process that interweaves the deepening of understanding of a broader
concept and the design of tools, the projects are able to adopt a design process that is
iterative, spiral-shaped approach where in each cycle we have the same recurring
generic activities (prioritisation, investigation, design, evaluation). This iterative
process corresponds to sprints in the scrum methodology, but needs to take into
account the fact that there are parallel activities that have different timelines and
mutual dependencies. The core mechanism to achieve coherence between theoretical,
empirical, and design and implementation activities, and to foster negotiation
processes between conflicting interests, has shown to be a strong shared conceptual
model as a mediating artefact that continuously evolves. All activities are informed
by the model, and all activities feedback their results into the model [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>
        The co-design taken as participatory design has been developed during a
decade of international research and development projects. In research-based design,
the artefact, which can include tools, are considered to be outcomes. The researcher
is the facilitator that guides the way to the outcomes. Certain phases can be
distinguished in the process, although, one of the most important aspects is that many
activities are going on in parallel, and often in the iterative cycles (to the previous
process the strongest difference being that co-design here underlines the activity of
end-users especially in the creative practices of designing the “tool”) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]; indeed one
may be required to go back to previous cycles. The process also claims to allow
different strands of design that are in different phases to go forward within the
same project. This is important to note because one of the advantages is that even
though there are strands that are on different phases these can potentially still feed
knowledge into each other due to the iterative nature of the cycles. The tolerance
for parallel design threads allows to change and take into account information and
end-users through-out the process. The main phases that can be distinguished are:
Contextual inquiry, Participatory design, Product design and Software prototype as
hypothesis phase. In co-design, artefacts, tools, and services are used as a means of
providing boundary and shared objects (mediated artefacts) to communicate between
different participants during design activities.
      </p>
      <p>
        In professional agile development in tool design the aim is to produce a
prototype which could be tested in a large scale evaluation process, and following
feedback, produce further iterations of the app which could be appropriate for a broad
base of work-based users, for example: military during deployment, NGO personnel
and aid workers, and those working in emergency relief1. Although an extended
period of prototyping is enabled, there are issues over the process of involving so many
stakeholders dispersed over many countries. Difficulties emerge surrounding direct
access to the intended user group. In effect, the research process is carried out with
the expert input of the main user groups with little contribution from others. It is
becoming increasingly clear, as users themselves become more “expert”, that to
design without their input will not result in a successful product. Making use of all
the research data gathered, the core project team develops the initial proposition, and
design, via an iterative process, early prototypes of how the mobile learning app
might look and function. This is complex process a n d i t i s d i f f i c u l t t o identify
single sources of content, or single functional requirements that would suit all
users. The ability to move quickly through rapid iterations in small teams is a key
attribute of the agile design process. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Towards a synthesised framework</title>
      <p>The above approaches have similarities in their processes and aims. It could be
said that differences are in the emphases of the approaches. The similarities that all
approaches stress as important are: Iterative design cycles, The process itself is a
learning and problematisation space; various activities go on in parallel and allow
these to feed into each other and All stakeholders (end-users included) come along
into the design process.</p>
      <p>1 MoLE Project’s (Mobile Learning Environment) http://www.mole-project.net/research
The challenges and differences that appear in these four processes are: Level of
involvement of the stakeholder; Iteration scale varies from narrow to broad; Position of
produced artefacts (the boundary and mediating or shared artefacts) varies; Meaning
and position of research in the processes varies (research-based/design research) and
how broadly the context and scaling is taken into account.</p>
      <p>
        We have gathered potential starting points for synthesised framework. These points
are the following ones: there is a need for creating and agreeing on on the conceptual
model that provides the direction and aims for the design, development and research;
There is a need to find out ‘core principles’ of the design and research – these could
be based on the shared conceptual model; Deeper connection iterations based on the
feedback of end-users – aim is to have continuous evaluation; The stakeholders need
support in their Professional Learning Networks [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to build ownership for sustained
continuous work.
      </p>
      <p>In the workshop after the description of the four approaches and, the above points
work as staring part for the discussion and generating of experiences and previous
‘best practices’. After which, a joint effort to integrate these into framework is
attempted. All required material are brought along to the workshop.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>McKenney</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Reeves</surname>
            ,
            <given-names>T. C.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <source>Conducting Educational Design Research</source>
          . New York: Routledge.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. da Silva,
          <string-name>
            <given-names>T. S.</given-names>
            ,
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Maurer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            , &amp;
            <surname>Silveira</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>User-Centered Design and Agile Methods: A systematic review</article-title>
          .
          <source>2011 AGILE Conference IEEE</source>
          . Retrieved from: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=
          <fpage>6005488</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Abrahamsson</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Salo</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ronkainen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Warsta</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , (
          <year>2002</year>
          ).
          <article-title>Agile Software Development Methods: Review and Analysis (No. VTT 478)</article-title>
          .
          <source>VTT Technical Research Centre of Finland</source>
          , Oulu, Finland.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Boehm</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turner</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <year>2004</year>
          .
          <article-title>Balancing Agility and Discipline: A Guide for the Perplexed</article-title>
          . Addison-Wesley, Boston, MA.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Gulliksen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Görannson</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boivie</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blomkvist</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Persson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , Cajander,
          <string-name>
            <surname>Å.</surname>
          </string-name>
          , (
          <year>2003</year>
          ).
          <article-title>Key principles for user-centred system design</article-title>
          .
          <source>Behaviour &amp; Information Technology</source>
          <volume>22</volume>
          (
          <issue>6</issue>
          ),
          <fpage>397</fpage>
          -
          <lpage>409</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Brennan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , (
          <year>2007</year>
          ).
          <article-title>The biggest computer programme in the world ever! How's it going</article-title>
          ?
          <source>Journal of Information Technology</source>
          <volume>22</volume>
          (
          <issue>3</issue>
          ),
          <fpage>202</fpage>
          -
          <lpage>211</lpage>
          . Checkland,
          <string-name>
            <surname>P.</surname>
          </string-name>
          ,
          <year>1981</year>
          . Systems Thinking, Systems Practice. Wiley, Chichester, UK.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bannan-Ritland</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>The Integrative Learning Design Framework: An Illustrated Example from the Domain of Instructional Technology</article-title>
          . In T. Plomp &amp; N. Nieveen (Eds.), An Introduction to Educational Design Research. Enschede,
          <article-title>Netherlands; SLO Netherlands Institute for Curriculum Development</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kunzmann</surname>
          </string-name>
          , C. (eds.) (
          <year>2012</year>
          ).
          <article-title>Knowledge Maturing - Creating Learning Rich Workplaces for Agile Organizations</article-title>
          .
          <source>Project Report</source>
          ,
          <year>2012</year>
          . http://knowledge- maturing.com/files/whitepaper.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Leinonen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Designing Learning Tools: Methodological Insights</article-title>
          . Ph.D. Aalto University School of Art and Design. Jyväskylä: Bookwell.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Colley</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bradley</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stead</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Wakelin</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Global MedAid: Evolution of an m-Learning App for International Work-based Learners</article-title>
          .
          <source>Presented at mLearn</source>
          <year>2012</year>
          ,
          <article-title>Helsinki, and published in the conference booklet</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Cook</surname>
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Pachler</surname>
            <given-names>N.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Online people tagging: Social (mobile) Network(ing) Services and Work-Based Learning</article-title>
          .
          <source>British Journal of Educational Technology</source>
          , vol
          <volume>43</volume>
          <issue>No 5</issue>
          ,
          <fpage>711</fpage>
          -
          <lpage>725</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>