<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Methodology for the Synthesis of Information Technologies for Ignorance Modeling: the Key Concepts</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Petro Mohyla Black Sea National University</institution>
          ,
          <addr-line>Mykolaiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>The analysis of the most studied types of ignorance, such as imprecision, uncertainty, inconsistency, conflict, fuzziness, etc., with the aim of their identification, systematization and formalization was carried out. Methods of modeling various types of ignorance on the basis of modern theories have been considered: the fuzzy set theory, the theory of evidence, the theory of plausible and paradoxical reasoning, the rough set theory. In the framework of the study, the methodology for the synthesis of information decision support technologies for modeling different types of ignorance through the systematic application of artificial intelligence methods has been proposed. These concepts are based on a systematic approach to the identification of different types of ignorance, which creates the conditions for the correct selection and application of methods of analysis of the initial data. This, in turn, provides effective results when modeling relevant subject and problem areas of knowledge. An important task in this context is the reasonable choice of a mathematical apparatus capable of detecting, exploring and modeling various types of ignorance correctly.</p>
      </abstract>
      <kwd-group>
        <kwd>Information Technology</kwd>
        <kwd>Decision-making</kwd>
        <kwd>Expert Evidences</kwd>
        <kwd>Ignorance</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Information technologies (IT), which are a tool for implementing systems analysis
methods, have been intensively developing in the last two decades within the
framework of a scientific field called “knowledge engineering”. The basis of this scientific
field is the results of development and research related to artificial intelligence (AI):
knowledge representation and reasoning, and knowledge inference; artificial
intelligence systems (expert systems, pattern recognition systems, decision support systems,
etc.).</p>
      <p>
        In the AI the analysis and management of various types of ignorance have a
paramount importance, due to the creative nature of the tasks of creating intelligent
technologies, which are always solved under conditions of inconsistency, incompleteness,
inaccuracy, uncertainty of the source data, relations between them, processing
operations (algorithms, processes solutions). The term “non-factors” is used in [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1-3</xref>
        ] to
describe various types of ignorance.
      </p>
      <p>
        Such types of ignorance (non-factors) as “fuzziness” and “inaccuracy”, were
identified and studied in the framework of fuzzy mathematics, founded by Lotfi Zadeh [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
Purposeful studies of non-factors began with research works of Narin`yani, which
introduced the concept and defined the interpretation of non-factors [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. Works of
Vagin, Ry`bina, Borisov, Val`kman, and etc., Burrus and Lesage reflect other
approaches for the determination of non-factors [
        <xref ref-type="bibr" rid="ref10 ref11 ref5 ref6 ref7 ref8 ref9">5-11</xref>
        ].
      </p>
      <p>
        Paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] identifies five basic types of ignorance (non-factors): contradiction,
nonmonotony, imprecision, uncertainty, fuzziness; [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] highlights: unknown, unreliability
(falsity) and ambiguity.
      </p>
      <p>
        At the same time, Smithson distinguishes two main types of ignorance: error and
irrelevance [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Bonissone and Tong argue that there are three main types of
ignorance: uncertainty, incompleteness and imprecision [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Bosc and Prade highlight four
main types of ignorance that can penetrate information, namely: uncertainty,
imprecision, vagueness, and inconsistency [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>Thus, the study of them leads to the conclusion that despite a meaningful analysis of
types of ignorance, they do not set out the principles of their unification and
formalization.</p>
      <p>But, it’s often modern methods of fuzzy mathematics, probabilistic-statistical
inference, Bayesian and neural networks, genetic algorithms, etc., are used without proper
analysis of the nature of the types of ignorance present. This fact can lead to inadequate
models and conclusions.</p>
      <p>The purpose of the article is to research the most studied types of ignorance and
methods for their modeling, and to develop methodology for the synthesis of
information technologies to support decision-making process under various types of
ignorance.
2</p>
      <p>Ignorance Handling Theories
Probability Theory deals with the chances of random events, while it is assumed that
all events are well-defined concepts. In this case uncertainty is connected only with
what chances each random event from the full group of such events can occur.</p>
      <p>
        It should be pointed out that there are two main approaches for estimating the
probabilities of events: objective probabilities based on the frequency method and experts,
which are the sources of subjective probabilities. In the framework of probability theory
for uncertainty modeling, analytical methods of probabilistic inference (probability
trees, decision trees, Bayesian networks), methods of mathematical statistics, etc., can
be used [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        Fuzzy Set Theory is used to operate with fuzzy concepts that underlie the formation
of sets of elements [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Elements are supposed to be well defined concepts. Uncertainty
(fuzziness) here arises when trying to attribute elements to some classes (sets), since
these classes (sets) are fuzzy, therefore, poorly defined.
      </p>
      <p>
        In real conditions, there may also exist specific forms of non-factors (ignorance) that
arise in the process of interaction between expert judgments. The forms of such
interactions can have a different character – they can be consistent, compatible; can
arbitrarily unite and intersect. To simulate these forms of interactions, the mathematical
apparatus of the Dempster-Shafer Theory (DST, evidence) can be used. DST considers
the frame of discernment (set of hypotheses) as a set of exclusive and exhaustive
elements [
        <xref ref-type="bibr" rid="ref16 ref17 ref18">16-18</xref>
        ].
      </p>
      <p>
        The Dezert-Smarandache Theory (DSmT) of plausible and paradoxical reasoning
can be considered as a more in-depth version of the DST in the sense that it can operate
with more complex forms of ignorance that can simultaneously be present in the formal
system [
        <xref ref-type="bibr" rid="ref19 ref20">19, 20</xref>
        ]. The DSmT deals correctly with uncertain, highly conflicting and
imprecise sources of evidence (set of hypotheses, expert data). Within the framework of
this theory, elements of the frame of discernment (set of hypotheses) can reflect vague,
imprecise concepts, and as a result can overlap each other. Thus, only the limitation of
the mutual exhaustibility of elements of the frame of discernment is supported.
      </p>
      <p>
        The methods proposed in the framework of Rough Set Theory (RST) allow to
process large amounts of disordered data and obtain new knowledge based on the results
of such processing [
        <xref ref-type="bibr" rid="ref21 ref22 ref23">21-23</xref>
        ]. This approach allows to correctly process the inaccurate
expert information.
      </p>
      <p>
        A number of approaches based on the integrated application of the mathematical
apparatus of the considered theories to solve typical decision-making problems under
complex forms of ignorance (e.g., fuzziness and uncertainty; height conflict, ambiguity
and uncertainty; imprecision, incompleteness and uncertainty, etc.) have been proposed
in [
        <xref ref-type="bibr" rid="ref24 ref25 ref26 ref27 ref28 ref29">24-29</xref>
        ].
3
      </p>
      <p>Synthesis of Information Decision Support Technologies
Under Various Types of Ignorance
The systematic methodology for the synthesis of IT for modeling non-factors allows to
generate information decision support technologies on the basis of the generated set of
rules and a set of parameters for the synthesis of IT, such as the type of data analysis
task, data structure, identified types of ignorance (non-factors), or combinations
thereof, etc.</p>
      <p>The methodology for the synthesis of IT can formally be presented in the form of
the following successive stages:</p>
      <p>Stage 1. Determining the goals of analysis (evaluation).</p>
      <p>There are two types of goals in system analysis: qualitative and quantitative. The
form of obtaining the evaluation result depends on determining the purpose of the
assessment.</p>
      <p>Stage 2. Determining the composition and structure of the analysis task.</p>
      <p>There are five basic data mining tasks: classification; 2) clustering; 3) association
rule mining; 4) sequence data mining; 5) forecasting. In the practice of decision making,
there are three main tasks: ordering of alternatives (ranking); distribution of alternatives
to decision classes (clustering); choosing the best alternative.</p>
      <p>The type of analysis task determines the type of data structuring procedure, in order
to forming a final solution. So, for example, to solve the problem of choosing the best
alternative, the ranking procedure of the initial set of alternatives can be used.</p>
      <p>Stage 3. Determining the method of obtaining initial data (information).</p>
      <p>The methods for obtaining information can conditionally be divided into next
groups: empirical and theoretical. The most widespread are empirical methods of
obtaining information, among which are the description, comparison, measurement,
observation, experiment, analysis, etc. Examples of empirical data are research results,
respondents' answers, experts’ assessments, results of observations, measurements, etc.
One of the most common empirical methods is the expert judgment. The obtained
information can be both qualitative and quantitative, and represents estimates in one of
four basic data measurement scales (ordinal, interval, ratio, nominal).</p>
      <p>The choice of the method of obtaining the source information affects the structure
of the source data.</p>
      <p>Stage 4. Formation of a set of source data.</p>
      <p>The procedure for generating a set of source data largely depends on the selected
method of obtaining source information. At this stage, the source data takes the form
of numbers, rankings, paired comparisons, intervals, etc., depending on the selected
measurement scale. Thus, the structure of the source data is formed.</p>
      <p>Stage 5. Identification and selection of methods for ignorance (non-factors)
modeling.</p>
      <p>The choice of modeling methods depends on the structure of the source data and the
types of ignorance that influenced the process of extracting information and forming a
set of source data, or contained in the received information (data set).</p>
      <p>Stage 6. Synthesis of information decision support technologies under identified
types of ignorance (non-factors).</p>
      <p>The basis of the methodology for synthesis of IT for ignorance (non-factors)
modeling is a model as follows:</p>
      <p>SIT=&lt;D, N, P, M, SGR, IP&gt;,
(1)
where D  {di | i  1, r} is a set of initial data; N is a ignorance identification procedure;
P are the IT synthesis parameters (criteria); M is procedure for selection of the
mathematical apparatus used to solve the problem of structuring of the initial information
(data); SGR is rule system for information decision support technologies generation; IP
are information processes.</p>
      <p>The procedure for identifying the type of ignorance is a set of rules for identifying
types of ignorance that analyzed in the system, based on a given set of criteria for their
identification.</p>
      <p>M may be represented by a method or group of methods that allow to correctly
process data under identified type of ignorance, or a group thereof.</p>
      <p>The IT generation rule is an algorithm for solving the stated analysis problem based
on the mathematical apparatus used, taking into account the specifics of the source data.
It is proposed to use the type of data structuring procedure, data structure, the method
of obtaining initial information (data), form of result presenting, etc., as parameters
(criteria) K  {K i | i  1, m} for IT generation rules construction. It can be used one K i
, or more criteria K i , i  m , for rules generation.</p>
      <p>The IT generation rules can be represented as follows:
─ one criteria is highlighted for the synthesis of IT:
─ several criteria are highlighted for the synthesis of IT:</p>
      <p>PIT j : K i  IT j .</p>
      <p>PIT j1 :  K i  IT j1 .
(2)
(3)
As an antecedent, one or a combination of criteria for the synthesis of IT is used, in the
role of a consequent, the information technology generated, taking into account the
formed criteria, is used.</p>
      <p>IP is a set of algorithms for the implementation of information processes for
obtaining, processing, exchanging, displaying data and knowledge generation.</p>
      <p>The basic principles of the synthesis of IT invariant to the type of problem being
solved and the method for identifying and presenting initial data (information).</p>
      <p>Let us consider an example of the generation of IT for structuring of expert
assessments under different types of non-factors based on the proposed concept (Fig. 1).</p>
      <p>It was used one criterion (K1 is a method of expert judgment as a method of obtaining
initial information) for construction of IT generation rule.</p>
      <p>The rule for IT generating will take the next form:</p>
      <p>PIT : K1  IT .</p>
      <p>Let us consider the structure and key steps of the information technology for structuring
of expert assessments.</p>
      <p>In general, the procedure for identifying and processing expert information consists
of the following steps:
1. Identification of the goal of assessment. At this stage, the composition of the
evaluation task, the type of procedure for structuring expert assessments, the form of
presentation of the expected results are determined.
2. Development of a scenario for the examination. Within the framework of this stage,
the technical issues of the examination and the method of presenting expert
assessments (for example, numbers, rankings, partitions, etc.) are solved.
3. Expert group formation in accordance the level of competence for each expert.
4. Collection of expert information, its structuring.
5. Identification of types of ignorance (non-factors) that may occur in the information
received.
6. Selection of a mathematical apparatus that allows to operate correctly with the
identified types of ignorance.
7. Analysis of expert information based on the selected method.
8. Analysis of the results and synthesis of the final solution.
The complex analysis of the most studied types of ignorance (non-factors) was carried
out. Methods of modeling various types of ignorance on the basis of modern theories
have been considered: the fuzzy set theory, the theory of evidence, the theory of
plausible and paradoxical reasoning, the rough set theory. The mathematical apparatus of
the considered theories allows to operate correctly with various specific types of
ignorance and their combinations. The performed analysis puts forward the conditions for
a detailed analysis of non-factors, that ensures the correct choice of methods their
modeling represented by the considered theories.</p>
      <p>The methodology for the synthesis of information decision support technologies for
ignorance modeling has been proposed. These concepts could be implemented as part
of the tools of the automated expert support systems to ensure the choice of optimal
solutions for the planning and implementation of projects for various purposes.
Especially for solving ill-structured problems under imprecision, uncertainty, inconsistency
and conflict.</p>
      <p>Acknowledgment. This research was partially supported by the state research project
“Development of information and communication decision support technologies for
strategic decision-making with multiple criteria and uncertainty for military-civilian
use” (research project no. 0117U007144, financed by the Government of Ukraine).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Narin</surname>
          </string-name>
          <article-title>`yani, A. S.: Netochnost` kak NE-faktor. Popy`tka doformal`nogo analiza [in Russian]</article-title>
          .
          <source>Preprint RosNII II 2</source>
          (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Narin</surname>
          </string-name>
          <article-title>`yani, A. S.: Nedoopredelenny`e modeli i operacii c nedoopredelenny`mi znacheniyami [in Russian]</article-title>
          .
          <source>Novosibirsk</source>
          (
          <year>1982</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Dushkin</surname>
            ,
            <given-names>R. V.</given-names>
          </string-name>
          :
          <article-title>Metody` poluchiniya, predstavleniya i obrabotki znanij s NE-faktorami [in Russian]</article-title>
          .
          <source>Vebov i Knigin</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Zadeh</surname>
            ,
            <given-names>L. A.</given-names>
          </string-name>
          :
          <article-title>Outline of a new approach to the analysis of complex systems and decision processes</article-title>
          ,
          <source>IEEE Transactions on Systems, Man and Cybernetics</source>
          SMC-
          <volume>3</volume>
          (
          <issue>1</issue>
          ),
          <fpage>28</fpage>
          -
          <lpage>44</lpage>
          (
          <year>1973</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Vagin</surname>
            ,
            <given-names>V. N.</given-names>
          </string-name>
          :
          <article-title>Znanie v intellectual`ny`x sistemax [in Russian]</article-title>
          .
          <source>Novosti iskusstvennogo intellekta 6</source>
          ,
          <fpage>8</fpage>
          -
          <lpage>18</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Dushkin</surname>
            ,
            <given-names>R. V.</given-names>
          </string-name>
          , Ry`bina, G. V.:
          <article-title>Ob odnom podxode k avtomatizirovannomu izvlecheniyu, predstavleniyu i obrabotke znanij s NE-faktorami [in Russian]</article-title>
          .
          <source>Izvestiya RAN. Teoriya i Sistemy` Upravleniya</source>
          <volume>5</volume>
          ,
          <fpage>84</fpage>
          -
          <lpage>96</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. Ry`bina, G. V.:
          <article-title>Modeli, metody` i programmny`e sredstva dlya postroeniya integrirovanny`x e`kspertny`x system [in Russian]</article-title>
          .
          <source>Avtoreferat dissertacii na soiskanie uchenoj stepeni doktora texnicheskix nauk: 05.13.11</source>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Borisov</surname>
            ,
            <given-names>A. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krumberg</surname>
            ,
            <given-names>O. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fedorov</surname>
            ,
            <given-names>I. P.</given-names>
          </string-name>
          :
          <article-title>Prinyatie resheniy` no osnove nechetkix modeley` [in Russian]</article-title>
          .
          <source>Zinatne</source>
          , Riga (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. Val`kman, Yu. R. By`kov, V. S., Ry`xal`skij,
          <string-name>
            <given-names>A.</given-names>
            <surname>Yu</surname>
          </string-name>
          .:
          <string-name>
            <surname>Modelirovanie</surname>
          </string-name>
          NE-faktorov
          <article-title>- osnova intellektualizacii komp`yuterny`x texnologiy` [in Russian]</article-title>
          .
          <source>Sy`stemni Doslidzhennya ta Informaciy`ni Texnologii</source>
          <volume>1</volume>
          ,
          <fpage>39</fpage>
          -
          <lpage>61</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Burrus</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lesage</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Theory of evidence (DRAFT) (Technical report no</article-title>
          .
          <fpage>0307</fpage>
          -
          <issue>07</issue>
          /07/03). Laboratorie de Reserche et Developpment de l`Epita,
          <string-name>
            <surname>Le</surname>
          </string-name>
          Kremlin-Bicetre
          <string-name>
            <surname>cedex</surname>
          </string-name>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Bradley</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mareile</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Types of uncertainty</article-title>
          .
          <source>Erkenntnis</source>
          ,
          <volume>79</volume>
          ,
          <fpage>1225</fpage>
          -
          <lpage>1248</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Smithson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Ignorance and uncertainty: emerging paradigms</article-title>
          . Springer, New York (
          <year>1989</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Bonissone</surname>
            ,
            <given-names>P. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tong</surname>
            ,
            <given-names>R. M.:</given-names>
          </string-name>
          <article-title>Editorial: reasoning with uncertainty in expert systems</article-title>
          .
          <source>International Journal of Man-Machine Studies</source>
          ,
          <volume>22</volume>
          ,
          <fpage>241</fpage>
          -
          <lpage>250</lpage>
          (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Bosc</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prade</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          :
          <article-title>An introduction to the fuzzy set and possibility theory-based treatment of flexible queries and uncertain or imprecise databases</article-title>
          . In: Motro,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Smets</surname>
          </string-name>
          , P. (eds) Uncertainty
          <source>Management in Information Systems</source>
          . Springer, Boston,
          <fpage>285</fpage>
          -
          <lpage>324</lpage>
          (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Uzga-Rebrovs</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Modern concepts and applications of probability theory [in Russian]</article-title>
          .
          <source>RA Izdevnieciba</source>
          ,
          <string-name>
            <surname>Rezekne</surname>
          </string-name>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Shafer</surname>
            ,
            <given-names>G. A.</given-names>
          </string-name>
          :
          <article-title>A mathematical theory of evidence</article-title>
          . Princeton University Press, Princeton (
          <year>1976</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Dempster</surname>
            ,
            <given-names>A. P.:</given-names>
          </string-name>
          <article-title>A generalization of Bayesian inference</article-title>
          .
          <source>Journal of the Royal Statistical Society B(30)</source>
          ,
          <fpage>205</fpage>
          -
          <lpage>247</lpage>
          (
          <year>1968</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yager</surname>
            ,
            <given-names>R. R.</given-names>
          </string-name>
          :
          <article-title>Classic works of the Dempster-Shafer theory of belief functions: an introduction</article-title>
          .
          <source>Studies in Fuzziness and Soft Computing</source>
          ,
          <volume>219</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>34</lpage>
          (
          <year>2008</year>
          ). doi:
          <volume>10</volume>
          .1007/978- 3-
          <fpage>540</fpage>
          -44792-
          <issue>4</issue>
          _
          <fpage>1</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Smarandache</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dezert</surname>
          </string-name>
          , J.:
          <article-title>Advances and applications of DSmT for information fusion</article-title>
          .
          <source>Collected works, 2</source>
          . American Research Press, Rehoboth (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Smarandache</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dezert</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tacnet</surname>
            <given-names>J</given-names>
          </string-name>
          .:
          <article-title>Fusion of sources of evidence with different importances and reliabilities</article-title>
          .
          <source>In 13th International Conference on Information Fusion</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          . IEEE,
          <string-name>
            <surname>Edinburgh</surname>
          </string-name>
          (
          <year>2010</year>
          ). doi:
          <volume>10</volume>
          .1109/icif.
          <year>2010</year>
          .5712071
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Pawlak</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          :
          <article-title>Rough sets theoretical aspects of reasoning about data</article-title>
          . Kluwer Academic Publishers, Boston; London (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Uzga-Rebrovs</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Knowledge representing features in rough sets</article-title>
          .
          <source>In: 7th International Scientific and Practical Conference: Environment. Technology. Resources</source>
          , vol.
          <volume>2</volume>
          , pp.
          <fpage>169</fpage>
          -
          <lpage>175</lpage>
          . RA Izdevnieciba,
          <string-name>
            <surname>Rezekne</surname>
          </string-name>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Skowron</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dutta</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Rough sets: past, present, and future</article-title>
          .
          <source>Natural Computing</source>
          ,
          <volume>17</volume>
          ,
          <issue>4</issue>
          ,
          <fpage>855</fpage>
          -
          <lpage>876</lpage>
          (
          <year>2018</year>
          ).
          <source>doi: 10.1007/s11047-018-9700-3</source>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Kovalenko</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , Davydenko, Ye.,
          <string-name>
            <surname>Shved</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Development of the procedure for integrated application of scenario prediction methods</article-title>
          .
          <source>Eastern-European Journal of Enterprise Technologies</source>
          ,
          <volume>2</volume>
          /4(
          <issue>98</issue>
          ),
          <fpage>31</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2019</year>
          ). doi:
          <volume>10</volume>
          .15587/
          <fpage>1729</fpage>
          -
          <lpage>4061</lpage>
          .
          <year>2019</year>
          .163871
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Kovalenko</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , Davydenko, Ye.,
          <string-name>
            <surname>Shved</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Formation of consistent groups of expert evidences based on dissimilarity measures in evidence theory</article-title>
          .
          <source>In: 14th International conference on Computer sciences and Information technologies (CSIT</source>
          <year>2019</year>
          ), pp.
          <fpage>113</fpage>
          -
          <lpage>116</lpage>
          . IEEE Press, Lviv (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Shved</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davydenko</surname>
          </string-name>
          , Ye.:
          <article-title>The analysis of uncertainty measures with various types of evidence</article-title>
          .
          <source>In: 1st International Conference on Data Stream Mining &amp; Processing</source>
          , pp.
          <fpage>61</fpage>
          -
          <lpage>64</lpage>
          . IEEE Press, Lviv (
          <year>2016</year>
          ). doi:
          <volume>10</volume>
          .1109/dsmp.
          <year>2016</year>
          .7583508
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Kovalenko</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , Davydenko, Ye.,
          <string-name>
            <surname>Shved</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Searching for Pareto-optimal solutions</article-title>
          . In: Shakhovska,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Medykovskyy</surname>
          </string-name>
          , M. O. (eds) Advances
          <source>in Intelligent Systems and Computing IV. Selected Papers from the International Conference on Computer Science and Information Technologies (CSIT</source>
          <year>2019</year>
          ). Springer International Publishing (
          <year>2020</year>
          ). doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -33695-0_
          <fpage>10</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Dezert</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tacnet</surname>
          </string-name>
          , J.-M.:
          <article-title>Evidential reasoning for multi-criteria analysis based on DSmTAHP. Advances and Applications of DSmT for Information Fusion</article-title>
          .
          <source>Collected Works</source>
          ,
          <volume>4</volume>
          ,
          <fpage>95</fpage>
          -
          <lpage>100</lpage>
          (
          <year>2015</year>
          ). doi:
          <volume>10</volume>
          .5281/zenodo.22462
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Beynon</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          : Reflections on
          <string-name>
            <surname>DS</surname>
          </string-name>
          /AHP: Lessons to Be
          <source>Learnt. Lecture Notes in Computer Science</source>
          ,
          <volume>95</volume>
          -
          <fpage>104</fpage>
          (
          <year>2014</year>
          ). doi:
          <volume>10</volume>
          .1007/ 978-3-
          <fpage>319</fpage>
          -11191-9_
          <fpage>11</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>