<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>KPIs to Manage Innovation Processes in VEEs - Initial Thoughts and Results</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Benjamin Knoke</string-name>
          <email>kno@biba.uni.bremen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jens Eschenbaecher</string-name>
          <email>esc@biba.uni.bremen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>BIBA - Bremer Institut für Produktion und Logistik GmbH</institution>
          ,
          <addr-line>Bremen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>While enterprise collaboration has become a significant factor to achieve business success, the distributed structure of virtual enterprise environments still carries new challenges towards successful operation of business processes within these networks. As one group of business process, innovation processes do challenge virtual enterprises to a much higher degree, because new products and services are target point. This paper discusses the utilization of key performance indicators to enable and to support the continuous flow of information between the collaborators. They are essential towards successful innovation processes and their usability in managing these processes. As the predicted impact and outcome are essential factors, the manageability of ongoing innovation processes decreases with its rising innovative potential and level of uncertainty. The performance indicators raised by each enterprise of the network are highly divertive. This presents another challenge to the management of these distributed innovation processes, which may be met by partial unification and ICT based communication platforms.</p>
      </abstract>
      <kwd-group>
        <kwd>Key performance indicators</kwd>
        <kwd>virtual enterprise environments</kwd>
        <kwd>systematic business innovation</kwd>
        <kwd>uncertainty levels of innovation processes</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        As one of the first researchers Josef Schumpeter described the innovation term by
discussing the impacts of newly combined processes and products on the balance of
the economic markets [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. A second line of research was discussing the diffusion of
innovation paradigm raised by Rogers and gained a lot of attention [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Since then,
research on innovation constantly gained influence and became a concept of interest
for both, business managers and economists. The competition within the global
market forces enterprises to shorten and improve their development processes and
innovation cycles [
        <xref ref-type="bibr" rid="ref3 ref4">3-4</xref>
        ]. Providing innovative products and services, which address current
customer needs, is a key factor to business success for most enterprises (e.g. Apple,
Google).
      </p>
      <p>
        To meet current market needs, enterprises have to connect each other in networks.
This may provide single enterprises with the ability to extend their products, include
competencies of other enterprises or simply to expand their production volume.
Because these collaborations are constantly gaining importance, new challenges raise by
managing their distributed processes [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Combining these issues, the challenge of managing innovation processes within
enterprise networks appears. Regarding this task, supporting communication flows
and monitoring the performance of innovation processes gain significant value. A
possible approach is the utilization of key performance indicators (KPIs) to measure
the performance of systematic business innovation processes in virtual enterprise
environments. Initial thoughts and results covering this approach are described within
this paper. Section 2 introduces the concept of Virtual Enterprise Environments and
the levels of uncertainty regarding innovation processes. Section 3 highlights the
application of Key Performance Indicators on Innovation management. Finally a short
discussion and conclusions summarizes the paper.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Approaching Systematic Business Innovation in Virtual</title>
    </sec>
    <sec id="sec-3">
      <title>Enterprise Environments</title>
      <sec id="sec-3-1">
        <title>Terminology and Concept of Virtual Enterprise Environments</title>
        <p>
          The idea of networking is based on the collaboration of independent enterprises
aiming at taking different advantages, while maintaining their individual independency
[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. The rising challenges for collaborative networks to maintain their ability to
compete have led towards a broad field of research concerning collaborations. Higher
demands in product complexity and rising market intensity have led from
hierarchical, single organisations over strategic alliances and modular organizations to virtual
enterprise environments. This also led from mass-production, standardized services
and fixed hierarchical structures to the implementation of task-oriented ad-hoc
collaborations. This high level of dynamical behaviour is influencing the connections
and behaviour within a VEE [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
Regarding the fuzzy-terms of virtual organisations and virtual enterprise
environments in particular, no clear typology can be identified [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], although some authors
have suggested quite a few definitions of different network types [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Various
variants and manifestations of collaborative networks have appeared during the last years
[
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. However, virtual organisations shall be perceived as the collaboration between
organisations in general and virtual enterprise environments as the collaboration
between enterprises, as sketched in Fig. 1. Here four enterprises bundle resources,
competencies and relationships within a virtual enterprise environments.
2.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Systematic Approach Towards Innovation</title>
        <p>
          While business innovation itself is a widely used and fuzzy term [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], only few widely
accepted models, approaches and tools have been developed [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Especially little
research work is available concerning business innovation in enterprise collaboration,
such as [
          <xref ref-type="bibr" rid="ref13 ref14 ref8">8, 13-14</xref>
          ]. A summary of the existing approaches is composed by Kotelnikov
[
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. Service innovation has been added by the authors as an individual new area. As
shown in Fig. 2, it is comprised of eight interwoven areas. This concept is called
―systematic innovation‖, due to the inclusion of the most important approaches to the
topic of business innovation. This integrated view will be developed within further
research.
The focus will be put on product, service, process and technology innovation, as these
areas have a more direct connection to the manufacturing within the VEE and their
performance is therefore easier to monitor. On the other hand, the impact of
marketing, strategy or organizational innovation is less tangible, long-ranging and difficult to
quantify.
2.3
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>Business Innovation and Level of Uncertainties - Exemplary Concepts</title>
        <p>
          One approach to categorize innovation activities is to apply different areas of
uncertainty (inspired by [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]). Fig. 3 shows the different levels of uncertainty for
incremental, market, technical and radical innovation concerning market and technical
uncertainty by positioning them within the displayed grid. The incremental innovation
can merely be perceived as the improvement of existing structures, since it implies
rather small changes of existing structures and therefore contains a small amount of
uncertainty. The market and the technical innovation include more significant
innovation, which has a bigger impact on the market or the technical environment and
therefore contains higher uncertainty. A radical innovation carries a high amount of
uncertainty in both areas.
This grid can be applied to analyze the performance measurability of innovation
processes. Measuring the performance of ongoing innovation processes demands the
ability to predict its output and to monitor its impact. This performance measurability
directly decreases with rising uncertainty. Therefore it is in principle possible to
measure the performance of incremental innovation, since these changes apply on
existing structures with existing measurement routines. Measuring the performance of
radical innovation on the other hand, is a significantly more challenging task, since
the outcome of these processes is usually unexpected and their impact is not to be
predicted.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Applying Key Performance Indicators on Innovation management</title>
      <sec id="sec-4-1">
        <title>Key Performance Indicators to Measure Process Performance</title>
        <p>
          A broad range of approaches to evaluate process performances in general have been
developed, following the raising importance of VEEs. An overview on the evolution
of the main approaches is given in Fig. 4. It sorts them by their comprehensiveness
and time of development. Key performance indicators (KPIs) as tool to measure
process performance have gained massive attention during the last decade [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. A
collection of KPIs is integrated into the Value Reference Model (VRM) of the Value Chain
Group. KPIs are also used to manage supply chains and existing approaches connect
them with the SCOR model [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. Another relation can be identified towards the
balanced scorecard, as many enterprises apply KPI scorecards within practice [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
Key performance indicators are a type of performance measurement. They are usually
used to evaluate the success of an organisation or an activity, which they are related
to. Opposed to the stage-gate approach, which are oriented towards the achievement
of milestones, key performance indicators can be used to measure the performance of
repetitive tasks. For example, these KPIs can be the error rate within a production
process or the rate of satisfied customers.
        </p>
        <p>The selection of the right KPIs is an important issue regarding the comprehension
of the needs and weak points of an organisation. The selection of which KPIs are
important depends on the organisation and the branch or the market the organisation
reaches for. Due to the importance of identifying the right KPIs, this selection process
has to be supported. This happens usually by applying management tools, such as the
balanced scorecard and is often related to business improvement processes.
Following, we will discuss the concept of KPI and the applicability in the context of VEE.
3.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Discussion on KPIs to Monitor and Manage Innovation and Improvement</title>
      </sec>
      <sec id="sec-4-3">
        <title>Processes in VEEs</title>
        <p>The success of incremental innovations and business improvement processes can
directly be measured by monitoring KPIs that represent the efficiency of the improved
processes and the business itself. These KPIs vary regarding the subject of the process
and their selection is a challenging task. Nevertheless their general attention and the
success of concepts like continuous improvement processes (CIP) and its approaches
to evaluate process performance show that measuring business improvement can
already considered state of the art.</p>
        <sec id="sec-4-3-1">
          <title>The percentage of ideas accepted into concept development.</title>
        </sec>
        <sec id="sec-4-3-2">
          <title>Percent R&amp;D resources/investment devoted to new products.</title>
        </sec>
        <sec id="sec-4-3-3">
          <title>This equals the net present value of product cash flows</title>
          <p>multiplied by the probability of commercial success
minus the commercialization cost. This is multiplied by
the probability of technical success minus the
development costs
Number of ideas/proposed products in the pipeline or
the investigation stage (prior to formal approval).</p>
        </sec>
        <sec id="sec-4-3-4">
          <title>Number of new, innovative, or upgraded product features distinguishable from the previous product.</title>
        </sec>
        <sec id="sec-4-3-5">
          <title>Average number of engineering man-months for each design released to production. This ratio shows the resources required</title>
          <p>UoM
%
%
$
#
#
time
Despite approaches to measure the quality or maturity level of ideas and knowledge
(compare the MATURE1 project), no directly applicable tools to measure the
performance of innovation processes could be identified. Regarding more uncertain types of
innovation, the development of KPIs becomes significantly more difficult. This is
caused by the huge impact of creativity and intuitive thinking, which can hardly be
quantified by applying KPIs. Another barrier towards the application of KPIs is the
previously described market or technical uncertainty influencing the ability to monitor
innovation processes. Without an idea of the estimated outcome of the innovation
process and its impact on the market, defining KPIs becomes rather difficult. Ho
wever, some general KPIs provided by the value reference model (VRM) can be</p>
        </sec>
        <sec id="sec-4-3-6">
          <title>1 http://mature-ip.eu/</title>
          <p>adapted as initial step forward. A selection of the most suitable KPIs towards
systematic business innovation is listed in Table 1. This list may be extended by KPIs
measuring the estimated risk of the innovation due to technical and market uncertainty.</p>
          <p>Due to the distributed structure of a VEE, the innovation processes of a VEE also
differ from those within single enterprises. The ideas and information usually
circulate between geographically distributed units. Since the VRM provides a framework
for the management of value chains, it can partly be used for innovation management
in VEEs. However, this adaptation requires elaboration that will be addressed in
further research.</p>
          <p>Since VEEs are comprised of diverging enterprises that house different processes
and follow individual strategies and paradigms, the relevant KPIs to each enterprise
will vary as well. This makes the management of the collaborative innovation
processes a very demanding challenge. To overcome this challenge, complying with a set
of core KPIs within the VEE may be necessary. Moreover, an ICT based platform
needs to be applied, which enables and supports the communication within the VEE
and monitors the KPIs of the distributed innovation processes.</p>
          <p>To utilize a KPI for managing an innovation process, information about its subject
and position within the process has to be provided. The information related to each
KPI should be: Name, description, unit of measurement, calculation formula,
information about relations (related innovation process and process owner) and Range of
values (green zone, yellow zone, red zone).
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Discussion and Conclusion</title>
      <p>The elaboration of KPIs for business innovation in VEEs is in its infancy. As already
shown, the definition of KPIs is easier if the level of uncertainty is lower. Secondly
the dynamic VEE makes it even more difficult to define KPIs. It is much easier if
KPIs are defined for relatively stable business environments, as these environments
allow a better understanding of the other enterprises. Nevertheless, complying with
common core KPIs may be necessary. For proper management of the distributed
innovation processes, an ICT based platform should be applied, which allows the
monitoring of the relevant KPIs and supports the communication regarding the innovation
process within the VEE.</p>
      <p>Regarding the state of the art towards business innovation and business innovation
it can be noticed, that key performance indicators (KPIs) are already utilized to
manage and monitor business improvement processes. One important factor to consider is
that different selections of KPIs may suit to each enterprise. It has to be pointed out
that these KPIs can already differ significantly within enterprises of the same branch.</p>
      <p>Nevertheless, the management of business innovation processes instead becomes a
lot more difficult. Since key elements like creativity and innovative thinking can
hardly be measured and quantified, alternative indicators have to be used. The value
reference model (VRM) provides a broad basis to select possible KPIs regarding the
systematic business innovation. A possible selection made out of these KPIs has been
listed in Table 1.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Schumpeter</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          :
          <article-title>The theory of economic development: An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle</article-title>
          . USA: Transaction Publishers,
          <year>1931</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Rogers</surname>
            ,
            <given-names>E. M.:</given-names>
          </string-name>
          <article-title>Diffusion of innovations (4th ed</article-title>
          .). New York: Free Press,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Segarra</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>The advanced information technology innovation roadmap</article-title>
          .
          <source>Computers in Industry</source>
          ,
          <volume>40</volume>
          (
          <issue>11</issue>
          ), pp.
          <fpage>185</fpage>
          -
          <lpage>195</lpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gassmann</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          and
          <string-name>
            <surname>von Zedtwitz</surname>
          </string-name>
          , M.:
          <article-title>Trends and determinants of managing virtual R&amp;D teams</article-title>
          . R&amp;
          <string-name>
            <given-names>D</given-names>
            <surname>Management</surname>
          </string-name>
          ,
          <volume>33</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>243</fpage>
          -
          <lpage>262</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Eschenbaecher</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Graser</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Managing and Optimizing Innovation Processes in Collaborative and Value Creating Networks</article-title>
          .
          <source>International Journal of Innovation and Technology Management</source>
          , Vol.
          <volume>8</volume>
          , No.
          <issue>3</issue>
          , pp.
          <fpage>379</fpage>
          -
          <lpage>391</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>H. S.</given-names>
            <surname>Jagdev</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>K.-D. Thoben</surname>
          </string-name>
          :
          <article-title>Anatomy of enterprise collaborations</article-title>
          ,
          <source>Production Planning &amp; Control: The Management of Operations</source>
          ,
          <volume>12</volume>
          :5, pp.
          <fpage>437</fpage>
          -
          <lpage>451</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Reichwald</surname>
          </string-name>
          , Ralf; Goecke, Robert; Pribilla, Peter:
          <article-title>Telekommunikation im Management - Strategien für den globalen Wettbewerb</article-title>
          . Stuttgart,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Eschenbaecher</surname>
          </string-name>
          , J.:
          <article-title>Gestaltung von Innovationsprozessen in Virtuellen Organisationen durch Kooperationsorientierte Netzwerkanalyse</article-title>
          . Mainz Verlag. Aachen,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Seifert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Unterstützung der Konsortialbildung in virtuellen Organisationen durch prospektives performance measurement</article-title>
          .
          <source>Verlag Mainz. Aachen</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Camarinha-Matos</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Afsarmanesh</surname>
          </string-name>
          , H.:
          <article-title>Collaborative networks: A new scientific discipline</article-title>
          ,
          <source>Journal of Intelligent Manufacturing</source>
          ,
          <volume>16</volume>
          , pp.
          <fpage>439</fpage>
          -
          <lpage>452</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Camarinha-Matos</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Afsarmanesh</surname>
          </string-name>
          , H.:
          <article-title>Collaborative Networked Organizations - A Research Agenda for Emerging Business Models</article-title>
          , Kluwer Academic Publishers, Boston,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Chesbrough</surname>
          </string-name>
          , H.:
          <article-title>Open Innovation: The new Imperative for Creating and Profiting from Technology, edn</article-title>
          . Boston, Massachussetts : Harvard Business School Press,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Borchert</surname>
          </string-name>
          , J.-E.:
          <article-title>Operatives Innovationsmanagement in Unternehmensnetzwerken: Gestaltung von Instrumenten für Innovationsprojekte</article-title>
          . Göttingen: Cuvillier,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>O</given-names>
            <surname>'Sullivan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ;
            <surname>Cormican</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          :
          <article-title>A Collaborative Knowledge Management Tool for Product Innovation Management</article-title>
          .
          <source>In: International Journal of Technology Management</source>
          ,
          <volume>26</volume>
          , pp.
          <fpage>53</fpage>
          -
          <lpage>67</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kotelnikov</surname>
          </string-name>
          , V.:
          <article-title>Systemic innovation</article-title>
          .
          <source>Accessed on March 23</source>
          ,
          <year>2012</year>
          , at: http://www.1000ventures.
          <article-title>com/products/bec_mc_innovation_systemic</article-title>
          .html,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bongsug</surname>
            ,
            <given-names>K. C.</given-names>
          </string-name>
          :
          <article-title>Developing key performance indicators for supply chain: An industry perspective</article-title>
          .
          <source>Supply Chain Management: An International Journal</source>
          , Vol.
          <volume>14</volume>
          Iss: 6 pp.
          <fpage>422</fpage>
          -
          <lpage>428</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Kaplan</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norton</surname>
            ,
            <given-names>D. P.</given-names>
          </string-name>
          :
          <article-title>Transforming the balanced scorecard from performance measurement to strategic management: Part 1</article-title>
          . Accounting Horizons Vol.
          <volume>15</volume>
          No. 1. P.
          <volume>87</volume>
          -
          <fpage>104</fpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Graser</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jansson</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eschenbaecher</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Westphal</surname>
            ,
            <given-names>I.:</given-names>
          </string-name>
          <article-title>Towards performance measurement in virtual organisations -</article-title>
          <string-name>
            <surname>Potentials</surname>
          </string-name>
          , Needs, and Research Challenges. ECOLEAD - 6th
          <source>Frame7work Research Programme</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>