=Paper=
{{Paper
|id=Vol-2470/p19
|storemode=property
|title=Comparative analysis of enterprise architecture frameworks
|pdfUrl=https://ceur-ws.org/Vol-2470/p19.pdf
|volume=Vol-2470
|authors=Jovita Bankauskaite
|dblpUrl=https://dblp.org/rec/conf/ivus/Bankauskaite19
}}
==Comparative analysis of enterprise architecture frameworks==
https://ceur-ws.org/Vol-2470/p19.pdf
Comparative analysis of enterprise architecture
frameworks
Jovita Bankauskaite
Department of Information Systems
Kaunas University of Technology
Kaunas, Lithuania
jovita.bankauskaite@ktu.lt
Abstract— Complex, critical systems require to apply model- According to the [3] “the framework successfully
based system engineering (MBSE) practices and use combines people, data and technology to show a
standardized methodologies and frameworks that help define comprehensive view of the inter-relationships within an
the system in a commonly recognized way. The enterprise information technology organization”. Framework helps to
architecture framework helps determine how information, develop a complex, integrated, cohesive and comprehensive
business, and technology work together. It brings more solution and can speed up the architecture development
discipline to the organization by standardizing and process.
consolidating processes to ensure better consistency. This has
become a necessity for companies seeking to organize various The framework structure the architecture description into
architectural perspectives into a holistic and unified view. There domains, layers or images, and suggests using views -
are several frameworks that help companies implement diagrams and matrices - to document each concept. The
architecture efficiently. This opens up the question of what set structured description of architecture allows to make systemic
of criteria based on a system of systems principles can be used decisions on all system components and make long-term
for comparative analysis of enterprise architecture framework decisions about new design requirements, sustainability and
in order to select the best one. This paper proposes five criteria support. Organization architecture framework (EAF) defines
that include weights and presents the results of a comparison of principles and practices how to design an enterprise or system
six enterprise architecture frameworks.
of systems architecture.
Keywords— Comparative analysis, Enterprise architecture
framework, Unified Architecture Framework
I. INTRODUCTION
In the age of innovation, people are surrounded by many
systems designed to facilitate everyday life, accelerate
processes, or even save human life. The growing complexity
of the problems requires the problem-solving to be transferred
to the systemic level. Nowadays, there are problems that need
to be taken into account through a system thinking in order to
address new challenges such as the internet of things,
autonomous traffic management and so on.
Model-Based Systems Engineering (MBSE) is systems
engineering methodology which emphasizes the application Fig. 1. The Zachman framework for Enterprise Architecture [4]
of rigorous visual modeling principles. Models are created to
deal with complexity, they allow to understand an area of In this paper, we focus on the criteria for comparing
interest, encourage reuse and improve quality [1]. Complex enterprise architecture frameworks. The question is how to
real-life problems require to apply MBSE practices in the level evaluate different enterprise architecture frameworks: what
where independently from one another evolving in time set of criteria based on a system of systems principles to use
systems communicate to achieve a common goal. This is the in order to select the best framework.
level of system of systems (SoS). The Department of Defense
(DoD) Defense Acquisition Guidebook defines the SoS as a In this paper, we propose a new set of criteria including
“set or arrangement of systems that results when independent weights and criteria rating which can be used for comparative
and useful systems are integrated into a larger system that analysis of enterprise architecture frameworks.
delivers unique capabilities” [2]. SoS is a large complex The rest of this paper is structured as follows: in Section
system that needs to be defined accurately and consistently. 2, the related works are analyzed; in Section 3, the overview
Any complex system can be viewed from several different of enterprise architecture is provided; in Section 4, the set of
angles, each of which can be depicted in various architectural criteria with weight are provided to perform a comparison; in
perspectives. In order to organize these diverse architectural Section 5, the achieved results, conclusions, and future work
perspectives into a holistic and unified view, it is necessary to directions are indicated.
use an enterprise architecture framework that was originally
designed by John Zachman. Fig. 1 provides the Zachman II. RELATED WORKS
framework. There is a large number of research papers on the
comparison of enterprise architecture frameworks. Most of
© 2019 for this paper by its authors. Use permitted under Creative them are proposing are criteria how to compare EAF, other
Commons License Attribution 4.0 International (CC BY 4.0)
61
ones propose criteria on how to compare EAF in the specific comparison criteria with weights to compare EAF. This will
area like SOA, EAF implementation etc. help to make a more accurate comparison that is specifically
based on the SoS domain and will provide the appropriate
A number of authors compare organization architecture EAF selection that will be applied to complex system
frameworks to offer a more comprehensive and accurate EAFs modeling.
comparison approach, these studies has been defined in [5],
[6], [7], [8]. Paper [5] investigates the concept of architecture III. OVERVIEW OF ENTERPRISE ARCHITECTURE FRAMEWORKS
by examining six AF: ZF, 4+1 Views, FEAF, RM-ODP,
TOGAF, DoDAF. Authors of this paper proposed to compare Below is provided a brief description of six enterprise
EAF by fundamental elements such as their goals, inputs and architecture frameworks that are used in this study.
outcomes. The proposed criteria were evaluated on the basis
of three estimates: „Y“ – explicitly supports an element, „N“ Department of Defense Architecture Framework
– does not support an element, „P“ – partially supports or (DoDAF). This framework is developed for the United States
eludes to support an element. In [6] article is compared and Department of Defense (DoD) that provides visualization
contrasted four distinct approaches to the representation and infrastructure for specific stakeholders concerns through
management of models relating to enterprise complexity, ZF, viewpoints organized by different views. It helps to ensure
ISO 15704, ISO/CEN 19439 and ISO/IEC 15288. Approaches that architectural artefacts are defined and characterized
compare has been performed by archetype dimension, consistently according to the specific project or mission needs,
prototype models, purposive dimension, life history, in order to be “fit-to-purpose”. DoDAF organization
populating with artifacts, profile of change and managing framework assists managers to make critical decisions more
change. Paper [7] provides a guidance in the selection of an effectively by organizing information sharing across the
EAF that meets the needed criteria. In this paper is performed Department, Joint Capability Areas (JCAs), Mission,
a comparison of five frameworks: ZF, DoDAF, FEAF, Component, and Program boundaries [11]. DoDAF focuses
Treasury Enterprise Architecture Framework (TEAF) and on architectural data rather than architecture artifacts. The
TOGAF. The authors of this paper proposed to compare EAFs
framework defines how to specify systems of system using the
by tree criteria: (i) views/perspectives - planner, owner,
architectural terms within DoD [12]. The development and
designer, builder, subcontractor, user; (ii) abstractions - what,
how, where, who, when, why; (iii) the systems development documentation of weapons and IT systems in USA must be
life cycle – planning, analysis, design, implementation, conducted in accordance with the DoDAF guidelines.
maintenance. In [8] article author compares following four
leading EAF: ZF, TOGAF, FEAF and GEAF. A comparative NATO Architecture Framework (NAF). NAF is developed
analysis is performed by ten criteria: taxonomy completeness, by the North Atlantic Threaty Organization (NATO) and
process completeness, reference-model guidance, practice derived from DoDAF Enterprise Architecture. The goal of
guidance, maturity model, business focus, governance NAF is to provide a standard for developing and describing
guidance, partitioning guidance, prescriptive catalog, vendor architectures for both military and business use [13]. The
neutrality, information availability, time to value. Each EAF NAF is designed to ensure that architectures developed
is ranked in each of ten criteria and the rating from 1 (very adhering to it can be understood, compared, justified and
poor) to 4 (very good) is assigned. related across many organizations, including NATO and
Comparative analysis of enterprise architecture other National Defense initiatives. NAF defines:
frameworks has been performed in other studies to compare methodology, viewpoints, stakeholder viewpoints and meta-
EAF in various areas than the framework definition, these model [13].
study has been defined in [9], [10]. In paper [9], a comparison
of EAF has been designed based on the identifies parameters. Ministry of Defense Architecture Framework (MODAF).
These parameters identify the gaps in the maturity model. In This framework is developed for the British Ministry of
[10] publication is proposed three major aspects to compare Defense to support defense planning and change management
enterprise architecture framework implementation methods: activities. MODAF ensures accurate, comprehensive and
(i) concepts – definition of EA, alignment between IT and consistent collection and presentation of information, helping
business, the association and communication among artifacts; to understand complex issues [14]. The main benefits of
(ii) modeling - notation, syntax and semantics; (iii) process - MODAF are the improvement of interoperability and
activities and steps for enterprise architect and business implementation between Systems. The framework supports a
analyzer in EA implementation. variety of MOD processes, such as: capability management,
In conclusion, all the analyzed papers and articles to acquisition and sustainment. MODAF architectures are
compare enterprise architecture frameworks encounter several designed as consistent, adjacent models that provide a
common issues: (i) unified architecture framework (UAF) is comprehensive view of the enterprise. MODAF defines set of
not included in the comparison, (ii) unsupported weight of the various relationships that can be used to integrate the
comparison criteria, (iii) it is difficult to interpret the results of architectural elements [14].
EAF comparison, there is not provided the formal result of a
comparison. Unified Architecture Framework (UAF). UAF was initially
Overall, researches carried out in this area mainly provide created as UPDM 3.0, responding to the needs of UML /
a set of criteria for a general EAF comparison, regardless of SysML and military communities to create a standardized and
the area where that EAF will be applied. I am proposing a consistent enterprise architecture based on the U.S.
more specific, easy to apply set of EAF comparison criteria, Department of Defense Architecture Framework (DoDAF)
applicable to the majority of EAF. The proposed approach in and the UK Ministry of Defense Architecture Framework
combination with SoS principles will provide a set of (MODAF) [15]. UAF consists of three main components: (i)
62
framework – a collection of domains, model kinds, and Tool support (TS) - level of framework support
viewpoints, (ii) metamodel – a collection of types, tuples, and by modeling tools. The criterion identifies the
individuals used to construct views according to the specific availability to use the framework in practice
viewpoints, (iii) profile – SysML based implementation through a modeling tool.
of the metamodel to apply model-based systems engineering Prevalence by researchers (PR) - level of
principles and best practices while building the views. UAF framework prevalence by the research’s
provides a set of rules to allow users to create a consistent community. The criterion helps to evaluate
enterprise architecture (as models) based on common whether the framework is being investigated or
enterprise and system concepts with rich semantics. These elaborated in scientific works.
models then become the repositories from which various
views can be extracted [16]. In order to more accurately compare EAF, the set of
criteria which are provided above should be ranked. TABLE
Federal Enterprise Architecture Framework (FEAF). I provides the rating definitions.
This framework is developed for the U.S. federal
government. It provides a common approach for the TABLE I. CRITERIA RATINGS
integration of strategic, business and technology management Scale Rating Definitions
as part of organization design and performance improvement 4 Very Good Very good or fully criteria
[17]. The government through organizations practice to Full Support support.
define the enterprise architecture, used the EAF to assist the 3 Good More than weak criteria
development of large, complex systems development Acceptable support.
2 Weak Inadequate or very poor criteria
processes. Architectural segments are created individually, Less than Acceptable support.
according to the structural guidelines, each segment is 1 Very Poor No criteria are met.
considered to be its own enterprise within the Federal Unacceptable Very poor criteria support.
Enterprise.
To determine the importance of the criteria, it is proposed
The Open Group Architectural Framework (TOGAF). to assign a weight for each criterion. The total number of
This framework is based on the Department of Defense’s assigned weights should be 1. TABLE II provides the
Technical Architecture Framework for Information weighted rating of criteria.
Management [18]. TOGAF focuses on mission-critical
business applications that use open systems building blocks. TABLE II. QUANTITIVELY CRITERIA AND WEIGHTS
TOGAF provides and explains the rules, creating good Criteria Weight Justification
principles for system architecture development. TOGAF Tool support 0.3 The criterion refers to the practical
includes three levels of principles: (i) support decision- application of the framework.
making throughout the enterprise, (ii) provide guidance of IT Domain 0.3 The criterion refers to the application of the
support framework in different domains, which
resources; (iii) support architecture principles for allows the company to define various areas
development and implementation. using the same framework.
Modeling 0.2 The criterion refers to modifications to the
IV. COMPARISON OF ENTERPRISE ARCHITECTURE languages modeling language.
FRAMEWORKS openness
Information 0.1 The criterion refers to the level of
Currently there is a wide selection of enterprise availability dissemination of the framework
architecture frameworks. Comparison analysis is required to information.
select the most appropriate framework. In order to more Prevalence by 0.1 The criterion refers to the level of
researchers framework popularity by researcher’s
accurately compare the EAF, we suggest using the community. It shows whether there are
comparison criteria including ratings and weights. The ongoing studies in this area.
criteria for the comparative analysis of the enterprise
architecture frameworks are as follows: When each criterion is ranked, it is necessary to calculate
Domain support (DS) – level of domain support a weighted average that helps to show the best framework
by EAF. The criterion identifies the universality from the others. Below is provided the comparison formula
of the framework. (1).
Modeling languages openness (MLO) – level
of modeling languages openness. The criterion ∑ 𝑛
𝜔𝑖 𝑥𝑖
helps to evaluate whether the modeling language 𝑋̅ = ∑𝑖=1
𝑛 (1)
𝑖=1 𝜔𝑖
used by the EAF can be modified. Indicates
whether the organization that manages the 𝑋̅- weighted average
modeling language is open or private. 𝜔𝑖 – weighted criteria
Information availability (IA) – level of 𝑥𝑖 – rate criteria
information availability of EAF. The criterion
specifies how easily a user can find additional TABLE III provides the results of compared six enterprise
information, material, presentations that help to architecture frameworks which are briefly introduced in
improve a user knowledge of certain EAF. section III. The comparison has been performed using the
proposed set of criteria.
63
TABLE III. Comparison of enterprise architecture frameworks REFERENCES
EAF/
Criteria
[1] J. Bankauskaite, A. Morkevicius, "An Approach: SysML-based
TOGAF
MoDAF
Automated Completeness Evaluation of the System Requirements
DoDAF
FEAF
Specification," in International Conference on Information
NAF
UAF
Technologies (IVUS), Kaunas, Lithuania, 2018.
1 1 1 3 1 2 [2] "Defense Acquisition Guidebook," 26 February 2017. [Online].
Domain support
Available: https://contractingacademy.gatech.edu/wp-
Modeling Language openness 1 1 1 4 1 1
content/uploads/2014/06/Defense-Acquisition-Guidebook-
Information availability 3 2 3 1 1 4
%e2%80%93-Feb.-26-2017.pdf.
Tool support 3 3 3 2 2 3
Prevalence by researchers 4 2 3 1 1 4 [3] T. E. Consortium, "Enterprise Architecture Body of Knowledge,"
[Online]. Available: http://eabok.org/about.html. [Accessed 10 02
TOTAL 1.9 1.6 1.8 2.8 1.2 2.3 2019].
[4] J. A. Zachman, "The Concise Definition of The Zachman Framework
by: John A. Zachman," 2008. [Online]. Available:
According to the results of the comparison, the best https://www.zachman.com/about-the-zachman-framework.
frameworks according to the criteria are listed below. [Accessed 5 January 2019].
Domain support – UAF [5] A. Tang, J. Han and P. Chen, "A comparative analysis of architecture
Modeling Language Openness – UAF frameworks," in 1th Asia-Pacific Software Engineering Conference,
Busan, South Korea, 2004.
Information Availability – TOGAF
[6] R. Martin, E. Robertson, "A Comparison of Frameworks for
Tool Support – DoDAF, NAF, MoDAF, Enterprise Architecture Modeling," Conceptual Modeling - ER 2003,
TOGAF vol. 2813, pp. 562-564, 2003.
Prevalence by researchers - DoDAF, TOGAF [7] L. Urbaczewski, S. Mrdalj, "A comparison of enterprise architecture
frameworks," no. Inform Syst. 7, 2006.
However, the Unified Architecture Framework according [8] R. Sessions, "Comparison of the Top Four Enterprise Architecture
to the comparison result has been identified as best Methodologies," 2007.
framework from other. [9] S. Pulparambil and Y. Baghdadi, "A Comparison Framework for
SOA Maturity Models," in 2015 IEEE International Conference on
CONCLUSIONS Smart City/SocialCom/SustainCom (SmartCity), Chengdu, 2015.
[10] B. D. Rouhani, M. N. Mahrin, F. Nikpay and P. Nikfard, "A
In this paper, we have analyzed the set of criteria which Comparison Enterprise Architecture Implementation
are used to perform a comparative analysis of enterprise Methodologies," in 2013 International Conference on Informatics
architecture framework. The analysis disclosed that a wide and Creative Multimedia, Kuala Lumpur, 2013.
variety of different sets of criteria are used which help to select [11] Department of DefenseOffice of the Assistant Secretary of Defense
the best framework. However, most of the criteria do not (OASD) for Network Infrastructure and Integration, "The DoDAF
include weights that help determine the priorities of the Architecture Framework Version 2.02," 2010.
criteria. The lack of criteria weights and ratings make it [12] Department of Defense, "DoD Architecture Framework Version
difficult to interpret the results of the comparison. Also, none 2.02, Manager's Guide," 2015.
of the proposed set of criteria is used to compare the newest [13] North Atlanic Treaty Organization, "NATO Architecture
framework – unified architecture framework. We have Framework, Version 4," 1 August 2018. [Online]. Available:
https://www.nato.int/cps/en/natohq/topics_157575.htm. [Accessed 9
determined the need for criteria with weights and ratings. January 2019].
In this paper, we propose a new set of criteria including [14] Minestery of Defense, "Guidance MOD Architecture Framework,"
weights and criteria rating which can be used to carry out an 12 December 2012. [Online]. Available:
https://www.gov.uk/guidance/mod-architecture-framework.
accurate and detailed comparative analysis of enterprise [Accessed 02 02 2019].
architecture frameworks. The set of criteria includes five
[15] OMG Group, "Unified Architecture Framework Profile (UAFP)
criteria: domain support, modeling language openness, version 1.0," 2017.
information availability, tool support and prevalence by
[16] OMG Group, "UAF specification at OMG," 2017.
researchers. For each criterion is assigned a weight indicating
the importance and priority. Also, the criteria have a rating that [17] Executive office of the president of the united states, "FEA
Consolidated Reference Model Document Version 2.3," October
determines the framework support under certain criteria, a 2017. [Online]. Available:
rating of 1 (very poor) to 4 (very good). https://web.archive.org/web/20090202182509/http://www.whitehou
se.gov/omb/assets/fea_docs/FEA_CRM_v23_Final_Oct_2007_Revi
Currently, this paper is oriented to the set of criteria which sed.pdf. [Accessed 14 January 2019].
helps to evaluate different enterprise architecture frameworks [18] The Open Group, "The Open Group Architectural Framework," 2015.
in order to select the best framework. In the near future, we [Online]. Available: www.opengroup. org /architecture/togaf7-
are planning to expand our research on enterprise architecture doc/arch/. [Accessed 02 02 2019].
frameworks, especially on Unified Architecture Framework,
to explore the possibility of performing an engineering
analysis and behavioral modeling using a standard-based
method.
64