<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Assessing competences for digital creativity</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kathy Kikis-Papadakis</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Foteini Chaimala</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>A Snapshot to Digital Creativity</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper deals with assessment issues pertaining to digital creativity in educational contexts. Following a short introduction about the concept of digital creativity, the first part of the paper discusses tensions and challenges in its assessment- rooted on the complexity of the interplay between creativity and digital technologies. The focus is then turned on teaching competences for digital creativity from an assessment perspective. Presented are areas and components of the DoCENT framework for digital creative teaching competences, related to the assessment of the teaching and the learning process - namely the areas “creative assessment” (i.e. the use of digital strategies to assess students' creativity), and “learners' digital creativity” (i.e. the competences required to enhance students' digital creativity). A way to operationalize the DoCENT framework for self-assessing purposes through rubrics tool under the five-level conscious competence learning model is then proposed. Concluding remarks reflect on implications of the work presented for further research and study, outlining the need to explore the effects of assessing teaching competences for digital creativity on the promotion of students' creative mind-set.</p>
      </abstract>
      <kwd-group>
        <kwd>Digital creativity</kwd>
        <kwd>Teacher competences</kwd>
        <kwd>Formative assessment</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        teaching and learning should emphasize their connection [5, p.28]. Currently there is
consensus that the affordances of technologies may have a strong influence on
creative processes and achievements. Loveless for example, outlining the potential roles
of digital technologies in supporting creativity mentions that “digital technologies can
be tools which afford learners the potential to extend or enhance their abilities, allow
users to create novel ways of dealing with tasks which might then change the nature
of the activity itself, or provide limitations and structure which influence the nature
and boundaries of the activity” [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Nevertheless, understanding the interplay between
“digital” and “creative” still appears as a challenge in academic and research
discourse and teaching practice.
      </p>
      <p>
        The notion of digital creativity expresses the concern to consider issues pertaining
to creativity and digital technologies in tandem. Broadly speaking it can be defined as
working creatively within a digital medium [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. In a more comprehensive definition
digital creativity refers to a “purposive imaginative activity, mediated by digital
technologies, generating outcomes that are original and valuable in relation to the
learner” [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. As applied to education, digital creative teaching consists of applying digital
technologies with the aim to support creative pedagogies, i.e. learner-centred
approaches, open-ended ethos, synergistic collaboration and knowledge connection.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Tensions and Challenges in Assessing Digital Creativity</title>
      <p>Dealing with assessment issues relating to digital creativity in educational contexts is
complex and challenging. Difficulties in assessing digital creativity mainly emerge
from the challenge to conceptualize creativity and digital technologies in tandem, and
the complex interplay between the two notions.</p>
      <p>
        The assessment of creativity per se involves tensions for different reasons, which
are mainly rooted both on the dispense notion of creativity and on decisions need to
be taken relating to the assessment purpose. Definitional challenges that may be faced
by educators trying to assess ‘creativity’ can be illustrated by the questions: Person –
is the student a creative person and have his/her learning experiences made thin/her
more creative? Process – is the process through which the person learnt or the product
was made creative? Product – is the essay or other piece of work creative? [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. On the
other hand, questions relating to the purpose of assessing creativity may include: Do
we want measures of creativity for summative assessment purposes, for structures in
which quantifiable outcomes are valued (for example national examinations)? Do we
want to be able to assess creativity for formative purposes in order to give feedback to
individuals on their achievements and ways forward for progression? Do we want to
have means to recognise meaningful and original personal expression? [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
      </p>
      <p>According to Henriksen et al. ‘the theme of creativity and assessment revolves
around the challenge of navigating tensions in evaluating and assessing creativity’ [5,
p.34]. Their study identifies the following dichotomous tensions: Psychometric vs.
behavioral (i.e identification of psychometric characteristics of creative individuals,
such as cognitive flexibility vs. behavioral measures such as alternative uses test);
process vs. product (i.e. focusing on the learning process for creative solutions vs.
focusing on the output of the creative activity); individual vs. group (i.e. how to
engage students in collaborative open-ended projects that support creativity, while also
assessing individual performance?); domain general vs. domain specific (i.e. whether
creativity is located specifically within domains or whether it is something more
general and extendable). Challenges that arise from decisions to be taken by educators in
relation to these tensions include: Exploration and use of a range of alternative
assessment formats and technics that consider how technology and creativity interact;
Definition of criteria for assessing both the creative process and the product of the
creative activity; Contextual challenges (e.g. formal-informal settings;
disciplinarytransdisciplinary – multi-disciplinary contexts).</p>
      <p>
        The assessment of students’ digital capabilities for creativity is no less challenging.
Starting points for the discussion of assessing creativity and digital technologies have
been offered by Jonassen [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] - who suggests dimensions for assessment along a
range of criteria and Sinker [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] - who offers a detailed discussion of the issues
associated with evaluating young people’s creative multimedia production. Nevertheless,
work on assessing creativity and digital competences in tandem is still in its infancy
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. The use of digital technologies for enhancing students’ creativity raises
questions about the evaluation and judgement of creative processes and products that are
different from more traditional tools. The main challenge according to Loveless
(2002) is that it is difficult to find correlations between the use of digital techniques
and their attainment in other subjects (for example to identify the indirect effects of
the use of ICT on motivation, attitude, and problem solving capability, critical
thinking and information handling abilities) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Teaching Competences for Digital Creativity: the DoCENT project framework</title>
      <p>
        For educators to be able to deal with assessment challenges for digital creativity, they
need to develop competences so as to undertake assessment tasks effectively
(achieving the desired outcome) and efficiently (optimizing resources and efforts). The
DoCENT framework for digital creativity competences – developed in the frame of the
DoCENT ERASMUS+ project – proposed a set of competences for digital creative
teaching [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The methodological processes for the development of the DoCENT
framework included: an audit of existing competence frameworks (General
competence frameworks, Teacher competence frameworks Teacher educator frameworks,
Digital competence frameworks, and creative teaching competences); and negotiation
and expert validation of the framework in consultation workshops with teacher
educators and teachers.
      </p>
      <p>Figure 1 here below presents the areas of DoCENT framework for digital creative
teaching competences. Highlighted are areas and competences relating to assessment
namely: a) creative assessment – i.e. the use of digital strategies to assess students’
creativity, and b) assessment of learners’ digital creativity – i.e. the competences
required to assess students’ digital creative competences.</p>
    </sec>
    <sec id="sec-4">
      <title>Operationalization of the DoCENT competence framework for assessment purposes</title>
      <p>This section presents a proposal for operationalizing the DoCENT framework through
rubrics for self-assessing competences for digital creativity. Rubrics are useful tools
for formative assessment purposes, designed to clarify criteria and standards against
which teaching and learning processes can be assessed.</p>
      <p>
        Proposed here below are a) criteria for self-assessing the teaching and learning
process for digital creativity informed by the DoCENT framework of digital creative
teaching competences and b) mastery competence levels, informed by the five-level
conscious competence learning model [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
4.1
      </p>
      <sec id="sec-4-1">
        <title>Criteria and sub-criteria for assessing competences for digital creativity</title>
      </sec>
      <sec id="sec-4-2">
        <title>Criteria</title>
        <p>Actively engage
students in
assessment processes
which foster
metacognition and critical
thinking</p>
        <sec id="sec-4-2-1">
          <title>Use technologies to</title>
          <p>evaluate students’
creativity
encourage students to critically reflect on their learning path,
competences, mistakes and progress
Use a variety of assessment formats and approaches
Use digital technologies to carry out formative and
summative assessment (e.g., learning analytics)
Apply criteria (e.g., fluency, flexibility, originality,
elaboration) for evaluating students’ little-c (personal) creativity</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>Apply tools (e.g., digital rubrics) for evaluating students’</title>
          <p>little-c (personal) creativity</p>
        </sec>
        <sec id="sec-4-2-3">
          <title>Digital creation and expression</title>
        </sec>
        <sec id="sec-4-2-4">
          <title>Information literacy and digital citizenship</title>
        </sec>
      </sec>
      <sec id="sec-4-3">
        <title>Criteria</title>
        <p>Divergent and
convergent thinking</p>
        <sec id="sec-4-3-1">
          <title>Use digital technologies to promote students’ openness to</title>
          <p>experience, responsible risk taking, tolerance of ambiguity,
learning from failure, and viewing challenges as possibilities
for learning</p>
        </sec>
        <sec id="sec-4-3-2">
          <title>Computational thinking and design thinking</title>
        </sec>
        <sec id="sec-4-3-3">
          <title>Stimulate students to solve problems and model systems, as well as understand mindsets and behaviors, by drawing on the concepts fundamental to computer science and design thinking</title>
          <p>4.2</p>
        </sec>
      </sec>
      <sec id="sec-4-4">
        <title>Mastery competence levels under the 5-level conscious learning model</title>
        <p>The five stages of competence, or the "conscious competence" learning model, relates
to the psychological states involved in the process of progressing from incompetence
to competence in a skill. It involves Stage 1 - Unconscious incompetence (the person
is blissfully unaware of their ignorance); Stage II – Conscious incompetence (the
person aware of their skills shortage); Stage III – Conscious competence (the person
is able to demonstrate their competence with a high level of concentration or focus);
Stage IV – Unconscious competence (the person is able to demonstrate their
competence with a low level of concentration or focus); Stage V – Shared competence (the
person is able to teach others by explaining not only how but also the why’s to
achieve a level of competency).</p>
        <p>In conjunction to the above stages, the following items for the rubrics (relating to
the mastery competence level) are proposed, illustrated in Table 3.</p>
        <p>The above mastery levels can be used both for teachers’ self-assessment of the
teaching process (see Table 1 for the according criteria) and for teachers’ assessing
students learning process (see Table 2 for the according criteria) for enhancing digital
creativity.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Concluding Remarks</title>
      <p>In this paper it has been outlined that assessing digital creativity in educational
contexts is a complex task. Tensions and challenges in this endeavour are rooted on the
dispense notion of creativity and on difficulties in conceptualizing creativity and
digital technologies in tandem. In the view of these challenges, it has been argued that if
teachers are to undertake assessment tasks effectively and efficiently, they need to
practice competences relating to digital creativity assessment. Under this concern, we
presented the DoCENT framework’s teaching competences for digital creativity
relating to assessment issues. We also proposed a way to operationalise the framework for
self-assessment purposes through rubrics– by illustrating criteria for assessing the
teaching and learning process for digital creativity, and by proposing mastery
competence levels informed by the five-level conscious competence theory.</p>
      <p>The work presented in this paper should be considered as a preliminary step in
facilitating the assessment of competences for digital creativity. The applicability and
the feasibility for adoption of the proposed tool is yet to be seen through validation
studies. Of interest would also be to explore teachers’ competence development path
through the five-level conscious competence theory - for example to identify critical
incidents that allow the progression from one mastery level to another in relation to
competences for digital creativity and challenges in teachers’ mastering the reflective
competence level. Finally, investigating implications of the proposed approach for
assessing competences for digital creativity on the promotion of students’ creative
mind-set would be an area for further research and study.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          :
          <article-title>Council conclusions of 12 May 2009 on a strategic framework for European cooperation in education and training ('</article-title>
          <source>ET</source>
          <year>2020</year>
          ').
          <year>2009</year>
          /C 119/02 (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          :
          <article-title>Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions: Rethinking Education: Investing in Skills for Better Socio-economic</article-title>
          <string-name>
            <surname>Outcomes</surname>
          </string-name>
          ,
          <volume>20</volume>
          .
          <fpage>11</fpage>
          .2012
          <string-name>
            <surname>COM</surname>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>669 final</article-title>
          , Strasbourg: European Commission (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Wyse</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ferrari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Creativity and education: Comparing the national curricula of the states of the European Union and the United Kingdom</article-title>
          .
          <source>British Educational Research Journal</source>
          ,
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <fpage>30</fpage>
          -
          <lpage>47</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Cachia</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ferrari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ala-Mutka</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Punie</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Creative learning and innovative teaching: Final report on the study of creativity and innovation in education in the EU member states</article-title>
          .
          <source>Luxembourg: Publications Office of the European Union. doi:10.2791/52913</source>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Henriksen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mishra</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Fisser</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Infusing Creativity and Technology in 21st Century Education: A Systemic View for Change</article-title>
          .
          <source>Educational Technology &amp; Society</source>
          ,
          <volume>19</volume>
          (
          <issue>3</issue>
          ),
          <fpage>27</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Loveless</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Creative learning and new technology? A provocation paper</article-title>
          . In J. SeftonGreen (Ed.),
          <article-title>Creative learning</article-title>
          (pp.
          <fpage>61</fpage>
          -
          <lpage>72</lpage>
          ). London, UK: Creative Partnerships (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Sefton-Green</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , L.:
          <article-title>Mapping learner progression into digital creativity A state of the art review written for Nominet Trust (</article-title>
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Barajas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frossard</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Alcaraz-Domínguez</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>DoCENT - Digital Creativity ENhanced in Teacher Education Framework of digital creative teaching competences http://www</article-title>
          .ub.edu/euelearning/O1_FRAMEWORK_
          <article-title>DIGITAL_CREATIVE_TEACHIN G_COMPETENCES</article-title>
          .pdf,
          <source>last accessed</source>
          <year>2019</year>
          /04/07 (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Charyton</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ivcevic</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plucker</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Kaufman</surname>
          </string-name>
          , J. C.
          <article-title>: Creativity Assessment in Higher Education, Handbook of Research on Assessment Technologies, Methods,</article-title>
          and Applications in Higher Education, C. S. Schreiner, ed.,
          <source>Hershey: IGI Global</source>
          ,
          <volume>78</volume>
          -
          <fpage>96</fpage>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Loveless</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <source>Literature Review in Creativity, New Technologies and Learning</source>
          .
          <year>2002</year>
          . hal00190439 (
          <year>2002</year>
          ) https://telearn.archives-ouvertes.fr/hal-00190439, last accessed
          <year>2019</year>
          /04/07 (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Jonassen</surname>
            ,
            <given-names>D.H.</given-names>
          </string-name>
          :
          <article-title>Computers as Mindtools for Schools: Engaging Critical Thinking</article-title>
          .
          <source>2nd Edition</source>
          . Upper Saddle River, New Jersey, Columbus, Ohio: Merrill/Prentice Hall (
          <year>2000</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Sinker</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Making Multimedia: Evaluating young people's creative multimedia production in J.Sefton-Green and</article-title>
          R. Sinker (eds) Evaluating Creativity. London: Routledge (
          <year>2000</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Cerrato</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siano</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Marco</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Ricci</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The Importance of Spacial Abilities in Creativity and Their Assessment Through Tangible Interfaces</article-title>
          .
          <source>International Conference in Methodologies and Intelligent Systems for Technology Enhanced Learning</source>
          ,
          <fpage>89</fpage>
          -
          <lpage>95</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. Pivotal Education Homepage, https://pivotaleducation.com
          <article-title>/hidden-trainer-area/trainingonline-resources/levels-of-competence/</article-title>
          ,
          <source>last accessed</source>
          <year>2019</year>
          /07/04
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>