<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>How to Handle a Massive Change: Guidance on a Process Improvement Project, Our Journey to Excellence</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>FNSS Savunma Sistemleri A.Ş.</institution>
          ,
          <addr-line>Oğulbey Mahallesi Kumludere Caddesi No: 11, 06830 Gölbaşı, ANKARA</addr-line>
          ,
          <country country="TR">TURKEY</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper FNSS's Design &amp; Development (D&amp;D) Process Improvement studies are presented. With the increasing number of projects and employees FNSS launched an improvement project aiming to revise and enhance its D&amp;D processes to remain competitive and efficient under these circumstances. Based on the gaps between “As-Is” and “To-Be” process models, existing process is revised and improved. Numerous new and significant practices like Earned Value Management and Lessons Learned Capturing &amp; Sharing Sessions are introduced within the new process. A management practice based on PDCA (Plan-Do-Check-Act) approach is defined and currently being used for the management of the new D&amp;D process. Through all this effort, FNSS obtained a streamlined but also flexible process which creates outputs that add value. Results show that improvements made throughout the project contributed to the output quality, through put time and stakeholder satisfaction considerably.</p>
      </abstract>
      <kwd-group>
        <kwd>Design Process</kwd>
        <kwd>Process Improvement</kwd>
        <kwd>Interface Management</kwd>
        <kwd>Defense Industry</kwd>
        <kwd>Performance Management</kwd>
        <kwd>Engineering Management</kwd>
        <kwd>PDCA</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        FNSS Savunma Sistemleri A.Ş. (FNSS), a joint venture company owned by Nurol
Holding Inc. and BAE Systems Inc., is a leading manufacturer and supplier of tracked
and wheeled armored vehicles and weapon systems for the Turkish and Allied Armed
Forces. FNSS develops its wide range of indigenously designed tracked and wheeled
vehicles and weapon systems at its own R&amp;D Division, and using its own engineering
experience. In the last seven years, the number of concurrent programs tripled and and
this significant growth in business volume resulted in a considerable increase in number
of engineers in the R&amp;D department. In order to ensure quality and remain competitive,
FNSS needs to continuously improve its processes in that exponentially growing
environment [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>F. Casati et al. (Eds.): Proceedings of the Dissertation Award and Demonstration,
Industrial Track at BPM 2018, CEUR-WS.org, 2018. Copyright © 2018 for the
individual papers by its authors. Copying permitted for private and academic purposes.
This volume is published and copyrighted by its editors.
The existing process was mostly valid for a small, dedicated group working on a single
project. With a small group of engineers and relatively less workload things were going
well. However, as it comes to doing many things with many people, a comprehensive
and well defined process (in terms of interfaces, inputs, outputs, responsibilities etc.) is
required to ensure quality and efficiency. In addition, with increasing number of
projects, stakeholder management became vital for FNSS and it should be effectively
managed. Therefore, it was highly required for FNSS to reconsider its processes to align
with stakeholder expectations.</p>
      <p>For this purpose, the company launched a project in consultation with Truenord
Management Consultancy aiming to redesign, deploy and improve its design processes.
This study covers the story of FNSS’s Design Process.</p>
      <p>The rest of the paper is organized as follows: in Section 2 we introduce the design
process and highlight major improvements, Section 3 is devoted to the deployment
phase. In Section 4 we discuss results achieved and in Section 5 conclusion is given.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Design &amp; Development Process</title>
      <p>D&amp;D processes improvement studies started with the establishment of a project
team, including representatives of all stakeholders (both internal and external). The core
team, who runs the project actively, consisted of functional managers, project managers
and capture managers. Besides, a review team consisting of upper management and
functional &amp; program directors was established to review and approve the progress at
pre-defined milestones of the project.</p>
      <p>After the team was established, our next step was to analyze the “As-Is” situation.
Throughout the workshops organized with the participation of all stakeholders
(supporting units, engineers from different hierarchical levels etc.), areas in the “As-Is”
model that need improvement were determined. Based on the feedbacks from
workshops and team members, “To-Be” model was constructed and gaps between the
current state and future state were identified. Existing design processes were then revisited
and main steps in the process were redefined. After main steps were established and
approved, related parties worked on the detailed process steps, input-output definitions,
interface and responsibility distributions accordingly.</p>
      <p>In this section, we discuss distinctive aspects of FNSS’s new D&amp;D process and what
we improved throughout our project.
2.1</p>
      <sec id="sec-2-1">
        <title>Responsibility Matrix:</title>
        <p>
          Step by step definition of a process provides a road map for how things should be done.
RACI (Responsible, Accountable, to be Consulted, to be Informed) matrix (Please see
Fig.1) defines responsibilities for design steps. It is a useful tool to streamline complex
chain of events, enable clear communication, facilitate quick and efficient decisions
and establish accountability among team members. It also clarifies interfaces with other
departments such as Project Management and other project team members. Lack of
such clarity often causes trouble if responsibilities are not defined clearly. [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]
        </p>
        <sec id="sec-2-1-1">
          <title>Task # Task</title>
        </sec>
        <sec id="sec-2-1-2">
          <title>Input</title>
        </sec>
        <sec id="sec-2-1-3">
          <title>Output</title>
          <p>Notes
1
n
o
itc
n
u
F
2
n
o
itc
n
u
F
3
n
o
itc
n
u
F
4
n
o
itc
n
u
F
5
n
o
itc
n
u
F
1.
2.</p>
          <p>1.1
1.2
1.3
2.1
2.2</p>
          <p>Process Step 1
Process Step 2</p>
          <p>Task/activity 1.1
Task/activity 1.2
Task/activity 1.3
Task/activity 2.1
Task/activity 2.2
xxxx document xxxx document
A I R
xxx report
xxx plan
xxx report
xxx plan
xxxx document
xxxx document xxx drawing
C</p>
          <p>R
xxx report
xxxx document
C
I
A
6
n
o
itc
n
u
F</p>
          <p>I
7
n
o
itc
n
u
F</p>
          <p>FS dependency with
1.1
Interface with 1.2
FS dependency with
2.1
2.2</p>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>Design Reviews:</title>
        <p>Design reviews are vital to assess the degree of completion of technical efforts related
to major milestones before proceeding with further technical effort. [6] Therefore,
design review activities are defined at related milestones throughout the process. With the
RACI matrix, contributors’ responsibilities for these reviews are stated. Besides, design
review content is defined and a standard design review presentation template is
provided to design engineers. This ensures that vital information and risks are reviewed,
design review entry &amp; exit criteria are met and related decisions/mitigation plans are
approved by the authorities before continuing with the next steps in design. Review
meetings are being audited to ensure that the design review content complies with the
provided template and meeting objective is achieved.
2.3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Tailored Process:</title>
        <p>Technical specifications differ a lot from project to project. Therefore, following the
same, rigid, step by step defined process for all projects is not reasonable. In the
planning phase of a project, related parties decide on which parts should be tailored. This
decision is made through a review and approval cycle defined in the RACI matrix.
2.4</p>
      </sec>
      <sec id="sec-2-4">
        <title>Lessons Learned:</title>
        <p>Capturing important lessons learned to prevent future failures and improve the
processes is crucial for all businesses. With increasing number of projects and employees,
this is also essential for FNSS. To ensure capturing and transfer of the lessons learned
in one project to the others, specific process activities are defined at several stages
throughout the process. Furthermore, weekly meetings are held where technical leaders
share the lessons learned with functional managers and other technical leaders. These
lessons learned items are then documented in the Lessons Learned Database and shared
with the rest of the organization.
2.5</p>
      </sec>
      <sec id="sec-2-5">
        <title>Earned Value Management.</title>
        <p>
          Another concept introduced was Earned Value Management (EVM), which provides
greater visibility and control of activities, enables proactive decision-making, and raises
awareness of time, cost and performance among project team members. [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]
        </p>
        <p>
          For this purpose, a heat map report is designed and deployed (Please see Fig. 2) [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ].
In this report, schedule and cost performance indicators are calculated for each work
package and the status is visualized using a color scheme. Using heat map, related
parties analyze the status, identify possible bottlenecks, and decide on schedule and/or
budget updates when necessary.
Apart from aforementioned specific improvements on D&amp;D process, we set a thorough
system based on PDCA (Plan-Do-Check-Act) approach for the management and
execution of this new D&amp;D process.
        </p>
      </sec>
      <sec id="sec-2-6">
        <title>Plan.</title>
        <p>In the planning phase, required resources are determined and the standard D&amp;D
process is tailored in accordance with the projects’ technical requirements and approved
by the related authorities.</p>
        <p>To manage the design plans for different projects, a task management platform
“Enovia” is used. Design schedules, responsibilities are defined and monitored with the help
of this platform.</p>
        <p>To support resource planning, a master engineering schedule (MES) where main
phases of all projects are seen on the same schedule is prepared and maintained. Based
on this schedule, monthly resource requirements of projects are determined and updated
when necessary.</p>
        <p>Do.
“Do” consists of the documented processes and procedures which define how we do
what we do. Our RACI matrix is an important element of the “Do” part.</p>
      </sec>
      <sec id="sec-2-7">
        <title>Check.</title>
        <p>“Check” is the part which provides a snapshot of the essential information required to
review the current status by making use of KPIs and some pre-defined reports. Also,
based on stakeholders’ expectations additional reports can be generated and reported to
the related parties.</p>
        <p>Four KPIs are used in order to provide a snapshot of the essential information
required to review the current status:
KPI #1: Process adherence is measured for each project at different milestones, by using
a set of questions, and improvement areas are determined.</p>
        <p>KPI #2: Compliance to the contractual requirements is measured to ensure quality of
the process.</p>
        <p>KPI #3 &amp; KPI #4: Engineering hour utilization rate and on time completion rate of the
process are also measured, which provides information on efficiency of the process in
terms of time and cost.</p>
        <p>In addition to the process KPIs defined above, automatic performance reports are
generated and sent to related parties with different frequencies depending on the
organizational levels. These reports include;
 Percentage of tasks completed on time in the previous period
 Number and list of late activities
 Work package level schedule and engineering hours status</p>
        <p>These reports support management of the design tasks and facilitate proactive
decision making at different hierarchical levels.</p>
        <p>Act.</p>
        <p>In regular meetings, process KPIs are reviewed and required actions are planned.
Actions are tracked regularly. Besides, if any retrogression is observed in the performance
reports, this is escalated to the superior manager through automatic escalation reports.
For instance, if any task is late more than 15 days, department manager receives an
escalation report regarding this situation. If the task is late more than 30 days, then the
escalation report is sent to the R&amp;D division director. Based on the escalation reports,
managers are expected to take action.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Deployment</title>
      <p>In this section, we discuss the deployment phase of the new D&amp;D process.</p>
      <p>As a first step, several meetings were held where the details of the new process and
improvements made were shared. Most of the participants had already attended the
workshop sessions made throughout the project. The last sessions were more of a
summary/reminder of what had been done during the deployment phase. Giving the
stakeholders the chance to contribute to what is being done in the early stages of the project
increases the sense of ownership and hence eases deployment.</p>
      <p>Another important decision in the deployment phase is the implementation of the
new D&amp;D process on the ongoing projects. For that, a deployment plan is made together
with the related technical leader and functional managers. Current status of each project
is evaluated and the closest upcoming D&amp;D process activity is determined. From that
activity on, new D&amp;D process is implemented.</p>
      <p>To deploy and improve the D&amp;D process, adherence is measured within certain
intervals through audits. These audits include a set of questions that measures adherence
to the process plan tailored in the planning phase. D&amp;D process adherence audit is
performed in two parts: concept design phase and detail design phase.</p>
      <p>In the concept design phase audit, technical leader answers four questions listed
below for each task completed in the concept design phase.
 Is the task completed as per plan (on time)?
 Is the task done as per RACI?
 Are all inputs completely taken into consideration and collected in standard format?
 Are expected outputs completely delivered and accessible?</p>
      <p>In the detail design phase audit, engineers who designed subsystems are audited by
the technical leader. This audit questions whether tasks in the D&amp;D process flow are
completed as required and on time for that specific subsystem or not.</p>
      <p>Audit results are then processed and improvement areas are reported. Reported
issues provide considerable feedback for future projects and hence promote
improvement. This improvement can be seen quantitatively in the audit results presented in the
Fig. 4 and Fig. 5. Our overall process adherence maturity level rose to 80% from 69%
from one project to the next one within one year period. Our aim was to achieve 90%
adherence level within 2 years period; currently we have scores above 85% on the
newest projects and we are very close to reach this objective.
PROCESS ADHERENCE MATURITY - PROCESS STEP LEVEL - CDP
100%</p>
      <p>100%
92%
64%
59%
71%
55%</p>
      <p>37%
74%</p>
      <p>81%
PROCESS ADHERENCE MATURITY - PROCESS STEP LEVEL - CDP
96%</p>
      <p>100%
91%
87%
83%
53%
PROCESS ADHERENCE AUDIT DASHBOARD</p>
      <sec id="sec-3-1">
        <title>PROCESS ADHERENCE MATURITY - PROJECT LEVEL</title>
        <p>69%</p>
      </sec>
      <sec id="sec-3-2">
        <title>PROCESS ADHERENCE MATURITY - PHASE LEVEL</title>
        <p>CDP MATURITY
66%
DDP MATURITY
72%
PROCESS ADHERENCE AUDIT DASHBOARD</p>
      </sec>
      <sec id="sec-3-3">
        <title>PROCESS ADHERENCE MATURITY - PROJECT LEVEL</title>
        <p>80%</p>
      </sec>
      <sec id="sec-3-4">
        <title>PROCESS ADHERENCE MATURITY - PHASE LEVEL</title>
        <p>CDP MATURITY
82%
New practices contributed to the output quality significantly. After deployment of the
new D&amp;D Process, number of Corrective and Preventive Action Requests (CPARs)
from other departments decreased (Please see Fig. 6). This is a good sign of how this
new process increased quality of work done and produce outputs that add value.</p>
        <p>As in all multi-stakeholder environments, interface management was a problematic
issue for FNSS as well, even within the same department, it was troublesome.
Feedbacks gathered from supporting units after deployment of the new process
improvements indicate that interfaces are now managed more effectively and collaboratively.
Additionally, external stakeholder satisfaction is measured through periodical surveys.
As survey results show, new D&amp;D process boosted external stakeholder satisfaction
also.</p>
        <p>Total # of CPARs
2017-10
2017-11
2017-12
2018-01
2018-02
2018-03</p>
        <p>Introduction of Earned Value Management approach to the D&amp;D process
contributed to engineering hour budget and schedule adherence significantly and hence makes
it possible to reach project timelines within budget.
5</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In this paper, we discussed FNSS’s journey on D&amp;D process in the significantly
growing environment. Through all this effort, FNSS obtained a streamlined but also flexible
D&amp;D process. Output quality and throughput time improved significantly. Increased
involvement of stakeholders resulted in better management of interfaces. Last but not
least, as the process improvement team, we are continuously working to maintain and
improve our processes based on the standards &amp;guidelines like CMMI-DEV, IpX etc.
and adapt new practices when necessary.
6</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>[1] https://turbinehq.com/2017/importance-of-process/</mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Role &amp; Responsibility</given-names>
            <surname>Charting</surname>
          </string-name>
          (RACI), Michael L Smith, James Erwin, https://pmicie.starchapter.com/images/downloads/raci_r_web3_
          <fpage>1</fpage>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <article-title>[3] Earned value management systems (EVMS)</article-title>
          , https://www.pmi.org/learning/library/earned
          <article-title>-value-management-systems-analysis-8026</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Engineering</given-names>
            <surname>Management through M-PDCA in Defense</surname>
          </string-name>
          <article-title>Industry: The Case of FNSS, Pınar Bakal</article-title>
          , Zeynep Öztürk, Ari Bostan, http://ceur-ws.
          <source>org/</source>
          Vol-1985
          <source>/BPM17industry09.pdf [5]. MIL-STD-499A</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>