<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Research on Software Quality Characteristics based on MBSE System</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jiangtao Che</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yangyang Zhang</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Wenpeng Li</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jianxun Guo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>China Electronics Standardization Institute</institution>
          ,
          <addr-line>Beijing</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
      </contrib-group>
      <fpage>29</fpage>
      <lpage>33</lpage>
      <abstract>
        <p>MBSE (Model-based Systems Engineering) is an engineering method that uses graphical models to describe and design complex systems, which has the advantages of unambiguous knowledge representation, reusability of models and integration of system design. Based on MBSE, through modeling and simulation, the quality characteristics of product quality such as functionality, reliability and testability are improved. The important significance of MBSE is that it provides new ideas and methods for the software engineering field, helps to improve the quality and development efficiency of software products, and has broad development prospects in the software engineering field.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;MBSE</kwd>
        <kwd>software quality</kwd>
        <kwd>product quality mode</kwd>
        <kwd>quality standard 1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1. Introduction</p>
      <p>
        In the early stage of system engineering, the
information generated by the system is described and
recorded in the form of documents. However, with the
continuous improvement of the scale and complexity
of the system, the shortcomings and deficiencies of the
traditional document-based system design method are
becoming more and more prominent, such as
inaccurate information representation, easy to
generate ambiguity, difficult to find the required
information from massive documents, and unable to
connect with other engineering designs[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>With the rapid development of computer and
information technology and engineering technology in
various fields, it is becoming easier and easier to
describe the system with object-oriented, graphical
and visual system modeling language, and the
application proportion of model in the system
development work is also increasing. Model based
systems engineering (MBSE) came into being. MBSE
method can effectively solve the problems of
document-based system engineering methods in
parameter acquisition and technical state
management, and is a powerful tool to effectively deal
with system complexity.</p>
      <p>In 2007, the International Council on Systems
Engineering (INCOSE) defined MBSE in its Systems
5th International Workshop on Experience with SQuaRE Series andits
Future Direction, December 04, 2023, Seoul, Korea
chejt@cesi.cn (J. Che); zhangyy@cesi.cn (Y. Zhang)
0000-0002-5456-1538 (J. Che); 0009-0006-4940-8527(Y. Zhang)
© 2023 Copyright for this paper by its authors. The use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).</p>
      <p>CEUR Workshop Proceedings (CEUR-WS.org)</p>
      <p>
        Engineering Vision 2020 as "Model-based Systems
Engineering [MBSE] is a paradigm that uses formalized
representations of systems, known as models, to
support and facilitate the performance of Systems
Engineering [SE] tasks throughout a system’s life
cycle."[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] INCOSE stressed that MBSE is the
development trend of future systems engineering
methods and technologies, and a change in the field of
systems engineering, and proposed the MBSE vision
plan for the first time at the conference, and planned to
realize the gradual maturity of MBSE theory and
practice system from 2007 to 2020, which represents
that MBSE will become an important development
direction of systems engineering in the future.
      </p>
      <p>MBSE has been recognized by many experts in the
field of systems engineering, and is becoming the
foundation of complex system design. Compared with
traditional document-based system engineering
methods, MBSE models become the core of complex
system design from the requirements analysis stage to
the evaluation stage. MBSE uses digital modeling
instead of writing documents for system scheme
design, and converts all the nouns, verbs, adjectives
and parameters describing system structure, function,
performance and specification requirements in design
documents into digital model expressions. The system
design of complex system is realized through the
continuous evolution and iterative increase of the
model, which has the advantages of unambiguous
knowledge expression, reusability of the model,
integration of system design, etc., and can well solve
the problems and challenges brought by the increase
of system complexity.</p>
      <p>Compared with TSE(Traditional Systems
Engineering), the characteristics of MBSE are reflected
in three aspects: modeling language, modeling ideas
and modeling tools. The main difference at the system
modeling level is that the integration degree and
executable degree of the system model are greatly
improved, as shown in Table 1.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Quality Characteristics of MBSE Systems</title>
      <p>Compared with traditional software systems, the
most important difference between MBSE based
software systems is the formal modeling of the
technical process throughout the whole life cycle,
focusing on the formalization rather than the existence
of modeling. Formal modeling has the following
advantages:
⚫</p>
      <p>Unambiguous knowledge expression: MBSE
describes the structure and behavior of the
system using digital models that are based on
clear rules and standardized symbols and
terms, avoiding the semantic ambiguity or
misunderstanding that can occur in
traditional documents. Through digital
models, MBSE can provide clear, consistent
and accurate information that enables the
design and functionality of the system to be
understood and shared by all concerned,
thereby improving the functional
correctness of the system design.</p>
      <p>Reusability: The model in MBSE is
independent of a specific project or system
and can be reused in different projects or
systems, which can not only improve work
efficiency and reduce duplication of labor,
⚫
but also reduce development costs and
improve the quality and reliability of the
system.</p>
      <p>Reliability: By building digital models, MBSE
can conduct comprehensive simulation and
testing of the system to identify and resolve
potential problems and risks. This
simulation can be carried out before the
actual system is built, thus avoiding
problems in actual operation and improving
the reliability and stability of the system.</p>
      <sec id="sec-2-1">
        <title>Security: MBSE uses a modeling approach to</title>
        <p>design and analyze the system, which can
more comprehensively consider the security
requirements of the system, integrate the
security concept from the beginning of the
design, and reduce potential security risks.
At the same time, MBSE can detect and solve
potential security problems in advance
through simulation and testing. Compared
with traditional system testing methods,
MBSE can test system security more
comprehensively and systematically.</p>
        <p>
          Combined with the characteristics of MBSE system,
the mapping relationship between MSBE system and
product quality characteristics can be established, as
shown in Fig. 1.[
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. MBSE System and</title>
      <p>Software Quality Model</p>
      <p>The model quality measurement includes two
parts: the quality model and the quality measurement.
The quality model gives the quality characteristics
from which the quality of the model should be
considered, and the quality measurement gives the
quantification way of each quality characteristic.
Based on the software product quality model in Fig. 1,
combined with the characteristics of MBSE system, the
model-based quality measurement m is formed after
tailoring, as shown in Fig. 2.</p>
      <p>Model-based quality</p>
      <p>measurement</p>
      <p>The main purpose of this work is to verify the
consistency of the model with standards or modeling
specifications. The model-based software test model is
consistent with the rules of the formal description
(modeling language, modeling guide), so that test
cases or test data can be generated according to the
model-based software test model without problems
due to incorrect syntax.</p>
      <p>The quality measure of correctness is divided into
average component error rate and individual
component error rate. The average component error
rate can be used to assess the overall situation quality
of the entire software system by the number of
modeling requirements that are wrong/the number of
all requirements in the model; The error rate of a
single component can be measured by the number of
incorrect modeling requirements in the concerned
software configuration item/the number of all
requirements in the concerned software configuration
item, which is mainly to assess the model correctness
of a single component in the software system.</p>
      <sec id="sec-3-1">
        <title>B. Effectiveness</title>
        <p>The main purpose of this work is to confirm the
consistency between the model and user requirements
and construction objectives. The content of the model
is correct and expresses what needs to be expressed.
The resulting product is "useful", the test script can be
executed, the test case can be executed by the test
engineer, and no errors can occur due to incorrect test
cases.</p>
        <p>Quality measures of effectiveness are to include:
The proportion of requirements in the model = the
number of requirements in the model to complete
modeling/the total number of requirements in the
requirement specification;</p>
        <p>Test cases/scripts generated by model = Number
of test cases or scripts generated by the
model/number of requirements modeled in the model.</p>
      </sec>
      <sec id="sec-3-2">
        <title>C. Applicability</title>
        <p>The main purpose of this work is to verify the
consistency of the model with the test objectives and
confirm the consistency with the test generation
mechanism. Only when the model-based software test
model is appropriate for the specified test objectives
and the specified test generation mechanism can the
products derived from the model-based software test
model fully meet the expectations.</p>
        <p>The quality measures of applicability would
include:</p>
        <p>The number of modeling languages used mainly
evaluates the applicability of military software in
model selection;</p>
        <p>Model complexity is mainly measured by the
number of nodes/elements in the model, the number
of links in the model, the number of inbound nodes and
the number of outbound nodes.</p>
      </sec>
      <sec id="sec-3-3">
        <title>D. Security</title>
        <p>To build a complete model system, first of all, we
need to analyze the needs of users, establish the
original demand and demand model, and establish the
traceability relationship between them; Then the
functional model and architecture model are modeled
according to the requirements, and the traceability
relationship between requirements and design is
established. Finally, the system model after iteration is
verified and evaluated.</p>
        <p>
          In the system development based on MBSE,
requirement analysis starts from the top-level
requirement to model the requirements layer by layer,
and establishes the requirement traceability
relationship through the requirement model. The
purpose of requirements analysis is to obtain the
system requirements from the original requirements,
so as to support the system architecture design.[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]
        </p>
        <p>After completing the design of the requirement
model, it is necessary to carry out functional analysis
in the top-level design process. Analyze and model
each functional component, design the realization
method of the system use case through the use case
model, build the functional architecture, and establish
the traceability relationship between requirements
and design. Function analysis reflects the system's
activity and activity execution process by drawing
activity diagram, and reflects the system's
requirements. Moreover, through the corresponding
relationship between functions and system
requirements in the activity diagram, the functional
model can also be linked to its corresponding
requirements to complete the establishment of the
traceability relationship between requirements and
design.</p>
        <p>Finally, on the basis of the functional model, the
overall route and technical framework of the system
are analyzed, and the system architecture model is
designed. Architecture design is the transition from
the top layer of the system to the software
implementation layer. Through module definition, the
relationship between modules is shown, the
components and characteristics of the system are
described, and the design and development of the
system model is guided. The architecture design
facilitates the refinement of the black box model and
thus the conversion to the white box model of the
module. Through architecture design, the
requirements and functions of the system are assigned
to components, ensuring the consistency of
information transmission in the design process and
realizing the accurate expression of the top-level
framework of the system.</p>
      </sec>
      <sec id="sec-3-4">
        <title>E. Reliability</title>
        <p>
          Complex engineering systems are generally costly
and high risk systems. If a large number of system
reliability design problems can only be found after the
physical construction integration, its change costs and
expenses are inevitably unacceptable. Therefore,
reliability design verification before construction is
necessary for complex systems. However, at the same
time, the reliability design verification of complex
systems is very difficult, which is more difficult than
the functional performance verification of the system.
The reliability verification of the system should
consider the impact of many variables such as the
system's use scenario, environmental conditions,
functional requirements, physical composition and
personnel operation, which has long been a difficult
problem in engineering.[
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]
        </p>
        <p>In the component/system integration verification
stage, the reliability level of components and systems
is virtual verified by means of component level and
system functional reliability simulation analysis to
determine whether they meet the requirements. This
technical link needs a set of system reliability
simulation verification method based on
multiphysical model support, comprehensive use of all
levels of the system, multi-domain physical simulation
model, high fidelity simulation verification of
reliability.</p>
        <p>Relying on the high-precision integrated
simulation model provided by MBSE, the
multiphysical simulation model close to the real use
scenario and environmental conditions is built early,
and the system reliability is fully verified before the
physical construction, and the weak link of the system
reliability design is improved.</p>
        <p>The key technical aspects of system reliability
simulation and verification process based on
multiphysical model include:
(1) Fault modeling of system components</p>
        <p>Based on the multi-physical regional energy model
of the system, various types of component fault
simulation modeling are carried out, including
mutation fault modeling, performance degradation
fault modeling, logic error fault modeling, etc.</p>
        <p>(2) Formalized requirement definition and
verification</p>
        <p>This paper mainly uses linear temporal logic and
other formal languages to define reliability
requirements by strict predicate and combinatorial
logic, and uses model simulation to automatically
output counterexamples of violating requirements, so
as to verify whether the qualitative requirements of
reliability are met.</p>
        <p>(3) Reliability quantitative simulation evaluation
In the system reliability simulation evaluation,
there are usually two technical approaches. One is
based on the fault mode related data of the system
components, using Monte Carlo sampling to evaluate
the reliability. One is to use scenario model, operation
model, fault mechanism model and multi-physical
model to achieve quantitative evaluation of key
component reliability and system functional reliability
by task scheduling simulation.</p>
      </sec>
      <sec id="sec-3-5">
        <title>F. Testability</title>
        <p>The opportunities MBSE brings to system
testability are mainly reflected in the modeling and
sustainable simulation verification of the system
design itself, which enables the virtual injection of
faults into the system model to investigate their impact
and evaluate the pros and cons of the test scheme, thus
achieving a more objective, comprehensive and
accurate testability application.</p>
        <p>
          Test requirement is the basic basis for designing
in-machine test and automatic test equipment, which
is conducive to achieving the consistency of testability
analysis, automatic test and fault diagnosis.[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]
        </p>
        <p>Automating the testability analysis and design
process based on MBSE requires solving the following
key technologies.</p>
        <p>⚫</p>
        <p>Complex system multi-level co-simulation
verification technology. This is not only the
core of future testability technology, but also
a prerequisite for high-quality MBSE. The
hardware and software mixed simulation
implementation and cooperation and other
contents support the simulation verification
of system functions and performance.</p>
      </sec>
      <sec id="sec-3-6">
        <title>Fault data acquisition technology based on</title>
        <p>
          automatic fault injection and simulation.
Automatic batch injection of faults in
simulable models is used to ensure the
coverage of real underlying faults. One of the
key technical points is the transformation of
low-level physical faults to high-level fault
behavior descriptions, which makes it
possible to implement credible fault
behavior simulation at a higher level of
abstraction (such as behavior level), reduce
the dependence on design details, and
improve simulation performance and
operability.[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]
Data-driven testability modeling, analysis
and design techniques. Based on the above
fault simulation data, feature extraction is
carried out to obtain fault samples, and then
the intelligent classification algorithm is
studied according to the characteristics of
the samples. Ideally, if the sample size is
sufficient and balanced, a cross-validated
testability analysis method can be used to
quantitatively predict key testability
indicators. Testability design is to optimize
fault features according to optimization
objectives such as the number of test points
or test cost among many candidate
features.[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]
        </p>
        <p>Metrics and key performance indicators that may
be monitored include:
⚫</p>
      </sec>
      <sec id="sec-3-7">
        <title>Manages and tracks the number of requirements in the MBT (Model-Based Testing)model and the percentage of requirements covered by the test cases.</title>
        <p>Size and complexity of the MBT model.
⚫
⚫
⚫
⚫
⚫</p>
      </sec>
      <sec id="sec-3-8">
        <title>The number of test cases and scripts generated, and the number of test cases/scripts produced per person per day.</title>
      </sec>
      <sec id="sec-3-9">
        <title>Number of requirement defects found in MBT modeling activities.</title>
      </sec>
      <sec id="sec-3-10">
        <title>The reusability of MBT model elements from one project to another.</title>
      </sec>
      <sec id="sec-3-11">
        <title>The extent to which the MBT model is used by the project stakeholders (business/development/test).</title>
      </sec>
      <sec id="sec-3-12">
        <title>Percentage increase in efficiency versus productivity of previous test design methods (lower cost testing).</title>
      </sec>
      <sec id="sec-3-13">
        <title>Percentage improvement in efficiency, defect finding rate compared to previous test design methods (better testing).</title>
        <p>4. Conclusion</p>
        <p>MBSE has a broad vision for improving the quality
of software products. As the technology continues to
evolve, MBSE methods and tools will continue to be
refined to more accurately describe and simulate
complex systems, further improving the functionality,
reliability and maintainability of software products. At
the same time, MBSE will be combined with new
technologies such as artificial intelligence and big data
to achieve more intelligent software design and quality
management, and improve the quality and
development efficiency of software products. In the
future, MBSE is expected to become an important
development trend in the field of software engineering
and make greater contributions to the improvement of
software product quality.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Thomas</surname>
            <given-names>A J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jonathan</surname>
            <given-names>M J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paredis C J J.</surname>
          </string-name>
          et al.
          <article-title>Modeling Continuous System Dynamics in SysML [C]. Proceeding of the International Mechanics Conference</article-title>
          and Exhibition. Seattle:
          <year>2007</year>
          :
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>International</given-names>
            <surname>Council on Systems</surname>
          </string-name>
          <article-title>Engineering (INCOSE)</article-title>
          .
          <source>Systems engineering vision</source>
          <year>2020</year>
          [R]. Seattle, WA:
          <source>International Council on Systems Engineering</source>
          ,
          <year>2007</year>
          :
          <fpage>5</fpage>
          -
          <lpage>32</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3] ISO/IEC 25010:
          <year>2023</year>
          .
          <article-title>Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Product quality model</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>BAJAJ</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>BACKHAUS</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>WALDEN</surname>
            <given-names>T</given-names>
          </string-name>
          , et al.
          <article-title>Graphbased digital blueprint for model based engineering of complex systems</article-title>
          [J].
          <source>INCOSE International Symposium</source>
          ,
          <year>2017</year>
          ,
          <volume>27</volume>
          (
          <issue>1</issue>
          ):
          <fpage>151</fpage>
          -
          <lpage>169</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>WU</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>YAN</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>ZUO M J.</surname>
          </string-name>
          <article-title>Evaluating the reliability of multi-body mechanisms: A method considering the uncertainties of dynamic performance[J]</article-title>
          .
          <source>Reliability Engineering &amp; System Safety</source>
          ,
          <year>2016</year>
          ,
          <volume>149</volume>
          :
          <fpage>96</fpage>
          -
          <lpage>106</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Cook</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schindel W D. Utilizing</surname>
          </string-name>
          <article-title>MBSE patterns to accelerate system verification[J]</article-title>
          .
          <source>Insight</source>
          ,
          <year>2017</year>
          ,
          <volume>20</volume>
          (
          <issue>1</issue>
          ):
          <fpage>32</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>TANG X F</surname>
          </string-name>
          ,
          <article-title>XU A Q, LI Ｒ F</article-title>
          , et al．
          <article-title>Simulationbased diagnostic model for automatic testability analysis of analog circuits[J]</article-title>
          .
          <source>IEEE Transactions on Computer-Aided Design of Integrated Circuits and System</source>
          ,
          <year>2018</year>
          ,
          <volume>37</volume>
          (
          <issue>7</issue>
          ) :
          <fpage>1483</fpage>
          -
          <lpage>1493</lpage>
          ．
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>TANG X F</surname>
          </string-name>
          ,
          <article-title>XU A Q, NIU S C. KKCV-GA-based method for optimal analog test point selection[J]</article-title>
          .
          <source>IEEE Transactions on Instrumentation and Measurement</source>
          ,
          <year>2017</year>
          ,
          <volume>66</volume>
          (
          <issue>1</issue>
          ) :
          <fpage>24</fpage>
          -
          <lpage>32</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>