<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards an agile innovation capability maturity framework to enhance investments on ICT organizations</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Languages and Systems Department. Escuela Tecnica Superior de Ingenier a Informatica, Avenida Reina Mercedes</institution>
          ,
          <addr-line>s/n, 41012, Sevilla.</addr-line>
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Emergya. Calle Luis de Morales</institution>
          ,
          <addr-line>32, 5</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Innovation is a complex process that has been studied from di erent perspectives. There are numerous studies, standards and reference models in the literature about it. Just a few works have been focused on covering a signi cant problem: innovation limits caused by public or private funding because of the restrictions imposed on the project in terms of scope and time. These restrictions are usually caused by the lack of trust and understanding of the innovation process by investors. In this Ph.D., the aim is to propose a framework that measures innovation maturity and capacity from ICT organizations. The initial hypothesis is that this Framework will allow improving investment since investor's risk will decrease and the trust will be increased, both, based on the maturity of the companies. The increasing of trust will eliminate the restrictions caused by nancing, making it more adapted to the needs of innovation. Besides, organizations will have a framework that will allow them to compare their innovation maturity. As regards the research strategy is concerned, this Ph.D. will follow the Design Science methodology. A framework will be designed, developed and validated in a real use case in an ICT company. The framework is intended to assist public and private investors in the nancing of ICT organizations.</p>
      </abstract>
      <kwd-group>
        <kwd>Innovation</kwd>
        <kwd>Capability Maturity Framework</kwd>
        <kwd>Agile</kwd>
        <kwd>Pub- lic Funding</kwd>
        <kwd>Business Angel</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Innovation is a very unusual business process, since creativity, which needs
freedom, plays a decisive role [
        <xref ref-type="bibr" rid="ref11 ref14">14, 11</xref>
        ]. Moreover, for a project to be innovative, it
must be executed as soon as possible while maintaining its initial scope. Scope,
time and cost are important. The cost is obtained from external sources, which
stress time and scope, causing projects to lose their innovative character.
      </p>
      <p>
        As innovation is implemented through projects, it is subject to the Triple
constraint or Project Management Triangle [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]: scope-time-cost, which is
particularly crucial since:
      </p>
      <p>Copyright © 2020 for this paper by its authors. Use permitted under
Creative Commons License Attribution 4.0 International (CC BY 4.0).
{ Scope is the root idea, which arises from the discovery process. It is a novelty
and has a signi cant associated risk.
{ Time determines whether an idea becomes an innovation. If it is not
executed in time, another idea comes forward.
{ Cost is the fuel of the project. The funding comes to alleviate its lack, but
the other two restrictions are a ected.</p>
      <p>
        Innovation is a dual process [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] that needs systematisation and creativity,
both, internal aspects of organisations. Despite the existence of numerous models
that have tried to explain the foundations of the innovation process, most of
them are unable to capture all the complexity that they try to describe [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
Some studies have noticed that standardizing the innovation process results in
higher process control, which may disrupt the level of freedom necessary for
creativity and R&amp;D processes [
        <xref ref-type="bibr" rid="ref11 ref14">14, 11</xref>
        ].
      </p>
      <p>
        In this Ph.D., taking as reference the Frascati and Oslo manuals [
        <xref ref-type="bibr" rid="ref21 ref22">21, 22</xref>
        ],
innovation will be considered as a business process that involves di erent
stakeholders within its value chain. In both cases, innovation is considered to be a
process carried out through projects. Innovation is a very unusual business
process, since creativity, which needs freedom, plays a decisive role.
      </p>
      <p>In this work, \agile" means to be able to move quickly and easily the private
and public organizations' investments towards ICT organizations to enable their
research, development, and innovation. Then, to evaluate innovation capacity
processes and maturity levels on ICT organizations, an iterative and increment
life cycle process will be de ned following the Deming Cycle phases (plan, do,
check, act). These phases will include the division of tasks into short phases of
work and frequent reassessment and adaptation of innovation evaluation plans.
In these lines, a set of principles will guide the methods, techniques and/or
practices included in each phase. These principles will be focused on build trust,
less funding risk, fewer project restrictions, and R&amp;D agile in time and scope.</p>
      <p>This paper presents a Ph.D. project in the context of business innovation.
It contests if the current standards and models contribute to the proper
development of innovation because they do not consider such a relevant factor as
funding restrictions.</p>
      <p>The rest of the paper is organized as follows: Section 2 states the problem that
aims to be solved in this research work. Section 3 illustrates the methodology
that guides the development of this thesis. Section 4 enumerates all the artefacts
that will be generated to response the objectives stated in section 2. Section 5
describes the closest research in relation to the topic treated in this research.
Finally, section 6 summarizes the conclusions and states a set of future work.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Research Objectives</title>
      <sec id="sec-2-1">
        <title>Problem Statement</title>
        <p>
          To carry out innovation, resources (mainly money), are needed. They
constitute the third element (in addition to systematization and creativity), and it
is external to the organisation. Funding, according to the EU Green Paper on
Innovation [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], is the obstacle to innovation that companies cite most, regardless
of their size, in all European Union countries and practically all sectors.
Moreover, they state that coping with or even shortening the time taken considering
the applications for government aid is particularly important in connection with
innovative projects.
        </p>
        <p>Fig. 1, represents the problem statement and the Ph.D. focus. The cost is
provided by investors, who due to their lack of trust, impose a series of
restrictions on project time and scope. The outcome is distorted and usually remains
outside the market, no longer being an innovation.</p>
        <p>
          From an idea generation perspective, innovation, as a business process, must
be systematised, but it is inherently a creative process that needs agility and
freedom. This fact is considered as the Creative paradox in this Ph.D., which
has been extensively studied in numerous studies [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ].
        </p>
        <p>From an ideas execution perspective, innovation needs speed. Once an idea
is created, it needs to be executed through a project as soon as possible. The
maximum resources have to be provided to be executed explosively. Otherwise,
its momentum will be lost. However, public aid and private investment are slow,
restricted and bureaucratic processes. This fact is considered as the
Implementation paradox in this thesis.</p>
        <p>Discovery strategy is tightened by frameworks, models or standards while
Development &amp; Operations strategy is tightened by Funding (See Fig. 1).</p>
        <p>
          Most studies focus on the rst part of the problem (Creative Paradox), de
ning reference models, standards or capacity assessment systems. They share a
common objective: to systematically and e ciently manage company innovation
processes to improve innovative capability and business performance[
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
However, the problem caused by the need for funding, which once achieved limits
innovative Development &amp; Operations strategies by imposing severe restrictions
on Scope and Time, has not been considered by these reference models. This
often interrupts or distorts the innovative process, leaving discovery results
unexecuted or the results outside their \Time to Market". Discovery results without
execution within a Development &amp; Operations strategy is useless. Furthermore,
it is counterproductive since frustration is generated in the teams. Innovation
depends on standards and reference models that measure maturity in innovation,
resources (funding) and creativity, which is tightened by the rst two elements.
Most studies focus on the relationship between frameworks and creativity,
ignoring the relationship between resources and discovery execution (projects ), cf.
Fig. 1).
        </p>
        <p>Obstacles and restrictions are imposed by public administration and private
investors when they provide resources for innovation because they lack the
necessary con dence. Investors don't have an instrument to assess the maturity and
trust of innovative organisations.</p>
        <p>{ The purpose of the ISO/UNE R&amp;D standards is not to provide trust to
investors.
{ There are no standard de nitions, concepts and practices that measure
maturity in innovation.
{ Restrictions on funding have not been analysed.
{ Investors operate on intuition rather than analysis.
{ There is no agility in funding. Innovation needs speed. Innovating using
nancing is slow.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Aim and objective</title>
        <p>This Ph.D. seeks to answer the second part of the problem described above by
tackling the Implementation Paradox.</p>
        <p>The aim is to design a framework that facilitates investment, by reducing risk
and increasing trust based on the maturity of ICT companies (Fig. 2). This will
make the funding's models more agile and adapted to the needs of innovation.
ICT companies are chosen because, overall, they have more developed innovation
processes, and it seems easier to implement a rst iteration of the proposed
framework. Subsequently, the framework can be scaled to any organization.</p>
        <p>The organization's innovation maturity needs to be understood to build trust
for public and private investors. By doing so, public and private investment
processes will be optimized.</p>
        <p>Innovation needs to generate ideas, and then implement them in the shortest
possible time through projects. The rst phase involves creativity, the second
resources. Resources come from investors, which impose a series of restrictions
on the project triangle, that depend on the degree of trust with the organization.
If trust is increased, the restrictions would decrease and R&amp;D capabilities too.</p>
        <p>
          Trust depends on the investor's knowledge of organizations [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ].
Understanding their maturity and capacity to execute R&amp;D is a means of building trust.
For this purpose, a distinction is made between three types of investments :
{ Public aid: Aid from public bodies is slow, and its structure and bureaucracy
are contrary to the principles of innovation. A model that measures the
organizations' maturity is necessary to ensure that the public administration
is becoming more agile. This framework will simplify the administrative
procedures and their requirements, helping through maturity levels to increase
trust.
{ External private aid: Venture capital in Europe is clearly lower than in other
regions such as the US. Less risky investments prevail as well. Large
commercial banks are reluctant to get involved in nancing innovation. Their
ability to appreciate the technological risk of innovation and their relations
with innovation organizations are generally weak. Tools that facilitate their
development are necessary, turning risk into the trust.
{ Internal private: Companies are very little prone to risk. Investments with
own capital are very limited, although they are the most appropriate way of
promoting innovation projects since they involve very few restrictions.
        </p>
        <p>Therefore, this Ph.D. aims to create a framework (integrated set of good
practices) to assess the R&amp;D maturity and capacity of ICT organizations, which
will be used as a methodological scale of investor trust to agility the funding
process. In addition, the framework will help organizations to develop strategic,
agile and comparable R&amp;D.
The primary research objective of this Ph.D. is to investigate how innovation
can be enhanced building investor's trust, through the assessing R&amp;D maturity
and capabilities in the organizations. For this purpose, a maturity innovation
framework will be developed to reduce the gap between nancing models and
the requirements of the innovation process. To this end, the following research
questions (RQ) guide the research:
{ RQ1. How much important is to measure the innovation capability maturity
level of an organisation?
{ RQ2. What is the state-of-the-art in measuring the capability maturity in
terms of innovation of an organization?</p>
        <p>RQ2.1. What methods, techniques or tools have been investigated for
developing R&amp;D in ICT organizations?
RQ2.2. Which have been used for developing R&amp;D in ICT organizations?
RQ2.3. What is the nature of found results to help ICT organizations
develop R&amp;D?
RQ2.4. What are the objectives pursued in research to help ICT
organizations develop R&amp;D?
{ RQ3. What key performance indicators should be considered to measure the
innovation maturity level of an organization?
{ RQ4. How should a capability maturity framework be to enhance investment
on ICT organizations?
{ RQ5. How can the capability maturity framework be evaluated?
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Research Approach</title>
      <p>
        In the literature, there are many publications on research methodologies for both
natural and social sciences. In this Ph.D., the Design Science research
methodology will be followed. This research methodology was provided by Johannesson
and Perjons [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] in combination with the guidelines by Wieringa [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] and
Peffers et al. [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. Design Science introduces a method framework for design science
research that can be used by any design science project. The framework consists
of four components:
{ A number of logically related activities, with well-de ned input and output.
{ Guidelines for:
      </p>
      <p>Executing the activities.
Selecting research strategies and methods to be used in the activities.</p>
      <p>Relating the research to an existing knowledge base.</p>
      <p>
        The method framework includes ve main activities that range from problem
investigation and requirements de nition, through artefact design and
development, and nally, to demonstration and evaluation. In addition, this PhD thesis
won't undertake all of the ve activities of the method framework in depth.
Instead, this PhD thesis will focus on one or two of the activities, while the others
are treated more lightly. Then, this PhD thesis will follow a Problem-Focused
Design Science Research combined by a Requirements- and Development-Focused
Design Science Research. The rest of the activities will undertake lightly. Figure
3 shows the main activities and artefacts that will be obtained in each activity.
Based on the identi ed problem that there are no approaches to increase investor
con dence in R&amp;D and that current investment conditions distort results, a
wide variety of Design Science activities and contributions have already been
identi ed, which are summarized below:
{ A Delphi study [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] to validate the baseline problem.
{ A Systematic Mapping Study (SMS) [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] to solve the problem described
before, rst trying to understand the state-of-the-art, and then identifying
any gaps in current research.
{ An agile R&amp;D capability maturity Framework to serve as a reference for the
public administration, decreasing bureaucracy and restrictions and leaving
more freedom to companies funding. Likewise, private investors will have a
methodological reference to base their trust when investing in R&amp;D.
Private investment could increase, and public investment conditions could be
improved.
{ A Case Study for a real ICT organization to validate the framework
applicability and its bene ts.
5
      </p>
    </sec>
    <sec id="sec-4">
      <title>Related Work</title>
      <p>Concerning the proposal presented in this work, to evaluate the capacity and
maturity of ICT organizations in the context of R&amp;D, some related works are
described below.</p>
      <p>
        Berg [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] proposes a method for assessing the quality and maturity of R&amp;D in
companies examining six viewpoints: R&amp;D as part of business strategy and
product and technology strategy, strategic implementation, outputs, implementation
of projects and R&amp;D as a business section.
      </p>
      <p>
        Several proposals study how to evaluate the innovation capacity in projects
or companies [
        <xref ref-type="bibr" rid="ref1 ref10 ref28 ref5 ref9">1, 10, 5, 9, 28</xref>
        ]. Bouwer [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] proposes a framework based on ten
innovation management capabilities with strong interdependencies and critical
relationships to support successful innovation within enterprises. However, they
have not presented a real-context validation. Knoke [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] presents a framework
result of the BIVEE research project, where the concept of the collaborative
innovation capability maturity model (CICMM) is described.
      </p>
      <p>
        On the other hand, Raghuvanshi et al. [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] carry out a state-of-the-art study
on innovation capability frameworks. Their classi cation framework analyse
different variables that enhance the innovation capacity of any organisation. The
closest proposals to the topic of this Ph.D. are those related to the evaluation of
the maturity and capacity of companies [
        <xref ref-type="bibr" rid="ref15 ref17 ref19 ref20">20, 17, 19, 15</xref>
        ].
      </p>
      <p>Finally, standards that references to maturity and/or capability assessment
related to this topic of this Ph.D. are described in Table 2. All of them, present
a super cial description, and the need to measure maturity is not developed, nor
does it o er frameworks for this purpose.</p>
      <p>The biggest di erence of this proposal, with respect to the related work
described above lies in that they do not enough consider the critical factor that
investors have in innovation processes. R&amp;D maturity models proposed ignore the
gap produced by the barriers that investors cause due to their lack of con dence.
Therefore, a framework that helps to increase investor con dence is necessary to
decrease the restrictions applied to projects when they are nanced.
6</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and Future Work</title>
      <p>
        This paper presents a Ph.D. approach to enhance the innovation process in
ICT organizations. It focuses on the gap that public or private funding leads
to distortions in the execution of innovation projects. For this purpose, Design
Science [
        <xref ref-type="bibr" rid="ref12 ref23 ref26">12, 26, 23</xref>
        ] methodology has been selected to guide the research and ve
research questions have been proposed.
      </p>
      <p>
        To validate the problem statement asked in RQ1, a Delphi study [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] will
be performed. The response of RQ2 will be the results of the execution of an
SMS [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. On this basis, the performance indicators should be further re ned
and validated giving response to RQ3. RQ4 will be answered by developing the
capability maturity framework under consideration of the KPIs de ned in RQ3.
Finally, the capability maturity framework will be evaluated in a real-world
industrial context to o er a response to RQ5. Although this work is in an early
stage of its development, the SMS and Delphi study artefacts have been already
started obtaining promising results.
      </p>
      <p>To sum up, this Ph.D. contributes to the knowledge base of software
development by providing a capability maturity framework that o ers an organisation
the possibility to know its maturity level and compare it with other
organisations.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgements</title>
      <p>This research has been supported by the Pololas project
(TIN2016-76956-C32-R) of the Spanish Ministry of Economy and Competitiveness. In addition, I
would like to recognize my PhD supervisors, Dr. Francisco Jose Dom nguez Mayo
and Dr. Jose Gonzalez Enr quez, for their ongoing support as I progress through
the doctoral program.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Altuntas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dereli</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Predicting the innovation capability of investment projects using the bifpet algorithm: a framework and case study</article-title>
          .
          <source>Journal of Engineering Research</source>
          <volume>4</volume>
          (
          <issue>4</issue>
          ) (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Atkinson</surname>
          </string-name>
          , R.:
          <article-title>Project management: cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria</article-title>
          .
          <source>International journal of project management 17(6)</source>
          ,
          <volume>337</volume>
          {
          <fpage>342</fpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Balmaseda</surname>
            ,
            <given-names>E.M.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Elguezabal</surname>
            ,
            <given-names>I.Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clemente</surname>
            ,
            <given-names>G.I.</given-names>
          </string-name>
          :
          <article-title>Evolucion de los modelos sobre el proceso de innovacion: desde el modelo lineal hasta los sistemas de innovacion</article-title>
          . In:
          <article-title>Decisiones basadas en el conocimiento y en el papel social de la empresa: XX Congreso anual</article-title>
          de AEDEM. p.
          <fpage>28</fpage>
          . Asociacion Espan~ola de Direccion y Econom a de la
          <source>Empresa (AEDEM)</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Berg</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pihlajamaa</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leinonen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leivo</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Assessment of quality and maturity level of r d</article-title>
          .
          <source>In: PICMET '01. Portland International Conference on Management of Engineering and Technology. Proceedings</source>
          Vol.
          <volume>1</volume>
          :
          <article-title>Book of Summaries (IEEE Cat</article-title>
          .
          <source>No.01CH37199)</source>
          .
          <source>vol. Supplement</source>
          , pp.
          <volume>168</volume>
          {182 vol.
          <volume>2</volume>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>BOUWER</surname>
          </string-name>
          , L.:
          <article-title>Capabilities-driven innovation managementtm: Conceptual framework to manage the innovation ecosystem (</article-title>
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Branscomb</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auerswald</surname>
            ,
            <given-names>P.E.</given-names>
          </string-name>
          :
          <article-title>Between invention and innovation an analysis of funding for early-stage technology development</article-title>
          .
          <source>Nist</source>
          Gcr pp.
          <volume>02</volume>
          {
          <issue>841</issue>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Commission</surname>
          </string-name>
          , E.:
          <article-title>Green Paper on Innovation. O ce for O cial Publications of the European Communities (</article-title>
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Cropley</surname>
            ,
            <given-names>D.H.</given-names>
          </string-name>
          , Kaufman, J.C.,
          <string-name>
            <surname>Cropley</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          :
          <article-title>Measuring creativity for innovation management</article-title>
          .
          <source>Journal of technology management &amp; innovation 6(3)</source>
          ,
          <volume>13</volume>
          {
          <fpage>30</fpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Elmquist</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , Le Masson,
          <string-name>
            <surname>P.</surname>
          </string-name>
          :
          <article-title>The value of a `failed'r&amp;d project: an emerging evaluation framework for building innovative capabilities 1</article-title>
          .
          <source>R&amp;d Management</source>
          <volume>39</volume>
          (
          <issue>2</issue>
          ),
          <volume>136</volume>
          {
          <fpage>152</fpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Haldma</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>N</surname>
          </string-name>
          "asi,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Grossi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Saunila</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Ukko</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.:</surname>
          </string-name>
          <article-title>A conceptual framework for the measurement of innovation capability and its e ects</article-title>
          .
          <source>Baltic Journal of Management</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Jayawarna</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holt</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>Knowledge and quality management: An r&amp;d perspective</article-title>
          .
          <source>Technovation</source>
          <volume>29</volume>
          (
          <issue>11</issue>
          ),
          <volume>775</volume>
          {
          <fpage>785</fpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Johannesson</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perjons</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>An introduction to design science</article-title>
          . Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Knoke</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The bivee framework and the collaborative innovation capability maturity model (cicmm)</article-title>
          .
          <source>Enterprise Innovation:</source>
          From Creativity to Engineering pp.
          <volume>91</volume>
          {
          <issue>110</issue>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kondo</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Are creative ability and work standardization in contradictory relationship? Training for Quality pp</article-title>
          .
          <volume>35</volume>
          {
          <issue>39</issue>
          (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>Application of cmmi in innovation management</article-title>
          .
          <source>In: 2007 International Conference on Wireless Communications, Networking and Mobile Computing</source>
          . pp.
          <volume>4966</volume>
          {
          <fpage>4969</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Linstone</surname>
            ,
            <given-names>H.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turo</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al.:
          <article-title>The delphi method</article-title>
          . Addison-Wesley Reading, MA (
          <year>1975</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Livotov</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , et al.:
          <article-title>Competitive capability assessment of industrial companies within the framework of advanced innovation design approach</article-title>
          .
          <source>In: DS 92: Proceedings of the DESIGN 2018 15th International Design Conference</source>
          . pp.
          <year>1903</year>
          {
          <year>1914</year>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Mir</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Casadesus</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Petnji</surname>
            ,
            <given-names>L.H.</given-names>
          </string-name>
          :
          <article-title>The impact of standardized innovation management systems on innovation capability and business performance: An empirical study</article-title>
          .
          <source>Journal of Engineering and Technology Management</source>
          <volume>41</volume>
          ,
          <issue>26</issue>
          {
          <fpage>44</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>Mortazavi</given-names>
            <surname>Ravari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.S.</given-names>
            ,
            <surname>Mehrabanfar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Banaitis</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          , Banaitiene_, N.:
          <article-title>Framework for assessing technological innovation capability in research and technology organizations</article-title>
          .
          <source>Journal of Business Economics and Management</source>
          <volume>17</volume>
          (
          <issue>6</issue>
          ),
          <volume>825</volume>
          {
          <fpage>847</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Narayana</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>A framework approach to measure innovation maturity</article-title>
          .
          <source>In: Proceedings. 2005 IEEE International Engineering Management Conference</source>
          ,
          <year>2005</year>
          . vol.
          <volume>2</volume>
          , pp.
          <volume>765</volume>
          {
          <fpage>769</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>OECD: Frascati Manual</surname>
          </string-name>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22. OECD, Eurostat: Oslo Manual (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23. Pe ers,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Tuunanen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Rothenberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.A.</given-names>
            ,
            <surname>Chatterjee</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.:</surname>
          </string-name>
          <article-title>A design science research methodology for information systems research</article-title>
          .
          <source>Journal of management information systems 24(3)</source>
          ,
          <volume>45</volume>
          {
          <fpage>77</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Petersen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vakkalanka</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuzniarz</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Guidelines for conducting systematic mapping studies in software engineering: An update</article-title>
          .
          <source>Information and Software Technology</source>
          <volume>64</volume>
          ,
          <issue>1</issue>
          {
          <fpage>18</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Raghuvanshi</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ghosh</surname>
            ,
            <given-names>P.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agrawal</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , et al.:
          <article-title>Taxonomy of innovation capability framework with future directions</article-title>
          .
          <source>International Journal of Business Excellence</source>
          <volume>17</volume>
          (
          <issue>3</issue>
          ),
          <volume>265</volume>
          {
          <fpage>289</fpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Wieringa</surname>
          </string-name>
          , R.J.:
          <article-title>Design science methodology for information systems</article-title>
          and software engineering. Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Wright</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sturdy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wylie</surname>
          </string-name>
          , N.:
          <article-title>Management innovation through standardization: Consultants as standardizers of organizational practice</article-title>
          .
          <source>Research Policy</source>
          <volume>41</volume>
          (
          <issue>3</issue>
          ),
          <volume>652</volume>
          {
          <fpage>662</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , X.:
          <volume>34</volume>
          .
          <article-title>model construction and statistical analysis of enterprise management innovation capability evaluation system</article-title>
          .
          <source>Bolet n Tecnico</source>
          , ISSN:
          <fpage>0376</fpage>
          -723X
          <volume>55</volume>
          (
          <issue>19</issue>
          ) (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>