<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The use of Hybrid Computational Methods for Creating Intelligent Decision-Making Systems in Medicine</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Engineering and Technical Institute, Baltic Federal University of Immanuel Kant</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Kaliningrad</institution>
          ,
          <addr-line>st. Nevsky 14</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0009</lpage>
      <abstract>
        <p>The problem of providing computer support for decision making in medicine is relevant due to the increasing information load on the doctor, the development of computer technologies. When making medical decisions, there is a lack of time, high dynamics of the course of diseases, a high cost of medical error, etc. This paper describes basic design principles of the first version of next-generation decision support system for providing personalized patients care based on patients' clinical and treatment data with the use of authors synergetic collective decision-making model and the methods of hybrid computational intelligence which allows us to increase significantly the quality of the results of solutions to complex medical problems in information variety and heterogeneity as well as to enhance decision-making by reducing losses from erroneous and irrelevant to the problem complexity individual solutions. The result of the implementation should be breakthrough successes in solving many epidemiological, diagnostic, therapeutic, prophylactic, social and economic problems.</p>
      </abstract>
      <kwd-group>
        <kwd>hybrid computational intelligence</kwd>
        <kwd>mathematical modeling</kwd>
        <kwd>system analysis</kwd>
        <kwd>decision support system</kwd>
        <kwd>problem-system</kwd>
        <kwd>providing personalized patients</kwd>
        <kwd>solutions to complex medical problems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        In work [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] three concepts - "a synergetic model of collective decision-making
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]", "a decision support system [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]" and "a hybrid computational
intelligence" - are considered together. The idea of such material presentation arose
nine years ago [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. But it was not possible to implement it in full before this edition.
Now it turned out to be possible and relevant. Here is the reason why.
      </p>
      <p>
        The synergetic model [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] of collective decision-making simulates the
multilingual character [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] of solving complex applied problem-systems in medicine
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] on the one hand, and the social collective nature of decisions on the other.
Thus, a right team interaction, partnership and cooperation in solving complex applied
problems in medicine "increase efficiency by at least 10%" [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], which generates a
synergistic effect when the inability of one is compensated by the skills and abilities
of another member of the team.
      </p>
      <p>
        Perhaps this is due to the knowledge and experience of experts solving certain
parts of a complex problem in medicine [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]; knowledge and experience of the
decision-maker who is able to combine individual solutions into one collective solution,
interacting with experts.
      </p>
      <p>
        Hybrid computational intelligence (HCI) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] — is an instrument of
synergetic artificial intelligence [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] designed to simulate the effects of interaction,
self-organization and adaptation observed in systems where the nature, people and
technology are closely intertwined.
      </p>
      <p>
        Joint consideration of three mentioned complex concepts opens the way to a
promising engineering technology (the basics of which are presented in this article)
in the field of creating applied intellectual decision-making systems in medicine of
the new generation able to integrate diverse knowledge models (in the following –
the heterogeneous model field [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]), and thus solving the problem of
increasing the quality of the results of solutions to complex medical problems in the context
of information variety as well as enhancing decision-making by reducing losses
from erroneous and irrelevant to the problem complexity individual solutions.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Methods of research.</title>
      <p>
        According to the law of requisite variety [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], only a various coordinated
analytical activity, which elements in combination solve one problem, will make the
result of decision-making qualitatively better. The specific nature of this work is
consistent with the collective work of experts in small groups – the councils. Fig. 1 shows
the conceptual model of collective decision-making by a small experts group (SEG).
ternal environment - decision maker", "expert - decision maker", "expert - expert",
respectively; S RLPR _ VS – is the cooperative relationship "decision maker - expert".
      </p>
      <p>
        Advantages of SEG are focused on the implementation of ideas that are not
feasible for individual decision-making, because the individual decision maker (DM) has
no opportunity to go beyond his immediate activities. Professional duties in SEG are
distributed in accordance with the abilities and competencies of performers,
depending on the activity complexity. Synergetic effect in SEG is achieved by "the group
compensation of individual disabilities [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]". The team interaction, partnership and
cooperation in solving complex applied problems "increase efficiency by at least
10%" [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], which generates a synergistic effect in SEG when the inability of one is
compensated by the skills and abilities of another member of the team. Hence the
methods of providing SEG collective solution on the basis of private expert advice are
relevant [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]: Delphi method [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], hierarchy analysis method [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], brainstorming method
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], method of brain record pool [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], etc.
      </p>
      <p>
        SEG simulation and the resulting synergy are encouraged to implement using
HIMAS [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], which are hybrid intelligent systems (HIS), practicing multi-agent
approach [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Elements of such HIS are realized in the form of agents having the
property of autonomy [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Like multi-agent systems (MAS), they simulate the interactions of
autonomous agents with each other and with the external environment, as a result of
which the system architecture can be dynamically reconfigured in accordance with the
specific functions (roles) of agents and the relationships established between them. As
a result, HIMAS combines the positive aspects of HIS and MAS: because of the
combination of several methods of artificial intelligence, they are relevant to problems
with high simulation complexity [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ],[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]; due to the simulation of the interaction of
experts and the resulting collective processes, they are able to change their
architecture to achieve a synergistic effect. For computer realization of the SEG model, the
HIMAS functional structure is developed (Fig. 2) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        The functional structure shown in Fig. 2. can be used in the design of HIMAS for
a wide range of applied problems, because:
(1) a general multi-agent model of reality is used;
(2) a list of solver agents covers five classes of basic methods of artificial
intelligence used in HIS [
        <xref ref-type="bibr" rid="ref2 ref3">2,3</xref>
        ];
      </p>
      <p>
        (3) an order of agent interaction is determined by the subject domain model
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        Let us consider the purpose of agents of the HIMAS functional structure shown in
(see Fig1):
(1) the interface agent requests input data and returns the result;
(2) the decision-making agent distributes the problem specification to the
findingsolution agents and determines the order of their interaction;
(3) the finding-solution agents perform generation and evaluation of solutions based on
the subject domain knowledge.
(4) the proxy agent monitors the capabilities of registered agents of intellectual
technologies (solvers). Agents refer to proxy agent to find out which of the solvers can help
in solving the subproblem set before them;
(5) the solvers together with the converter agent implement the hybrid component of
HIMAS, combining diverse knowledge, simulating the multilingual nature of the
solution of complex applied problem-system;
(6) the subject domain model is the semantic network [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], the basis of agent
interaction, built on the base of the conceptual model of the current problem [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        The central element of HIMAS shown in (see Fig.1) is a subsystem of "Hybrid
computational intelligence (Decision-making agent, see Fig. 1)". The concept of the
hybrid computational intelligence occurs when the decision maker in the Decision
Support System (DSS) breaks up a single whole (see Fig. 1), i.e. the initial problem
into its constituent parts, and entrusts the solution of subproblems to the experts. In the
fig. 3 the model of the problem has a two-level representation: at the macrolevel - the
problem as a whole and its properties; at the microlevel - a system of subproblems
(light circles) and a coordinating problem (dark circle). A complex problem is a
problem-system [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], which includes interrelated domains of var parameters [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]:
determinated, stochastic, linguistic, genetic ones, in which the cause-effect relationships of
the experts arguments are specified by representations — analytical, statistical, expert,
fuzzy, neural, genetic ones.
      </p>
      <p>
        Macro- and microlevels are connected by reduction relations. If we consider the
DSS model and the problem-system model together in (see Fig. 3), then a
correspondence shown by dotted horizontal lines appears. DM solves the problem entirely and a
coordinating problem, while the experts solve sub-problems grouped in the area of
homogeneous parameters of the system-problem [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. After receiving a part of the
problem, the expert must understand it. One of the understanding stages is a
realization of the reasoning technique that is the most suitable for solving the subproblem.
To make a choice the expert should know the pros and cons of the reasoning
techniques. Then the expert builds a model for solving the subproblem using the
advantages of the technique. Cut and try, the choice of other methods and repeated
reasoning are possible.
      </p>
      <p>
        Fig. 4. shows the synergetic model of hybrid computational intelligence [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],
which is characteristic of the collective decision-making model of SEG (see Fig. 1).
      </p>
      <p>
        Experts who solve parts of the general problem-system (Fig. 3), create the parent
models (see Fig. 4,a): Model1P ,..., ModelкP , ..., Model Pf ,..., ModelNP , and the variety of
team work structures used in DSS (sequential, simultaneous, formation of subgroups,
coalitions, etc.), i.e. the usage procedure of parent models for joint reasoning,
determines the variety of descendant models: Model1П , ..., ModelNП . These models relate to
the general problem-system. The descendant models are the hybrids obtained on a
heterogeneous model field [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] by combining according to a functional feature, and
inheriting the positive aspects of the reasoning methods applied by experts to solve
parts of the original problem. We call such hybridization, obtained within the
synergetic model of hybrid computational intelligence, a coarse-grained one [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Fig. 4, b shows another pattern: the expert's sensation that none of the known
prototype methods are suitable for solving the subproblem. This sensation arises when
the expert is not satisfied with certain aspects of the methods. For example, one of
them leads to models with intolerable error, but with good computational capabilities,
and the other gives the opposite picture. The expert starts to consider the tool for
solving the problem at different detail levels.</p>
      <p>Fig. 5 shows a two-level representation of methods: at the macrolevel — the
method as a whole; at the microlevel - the method decomposition using the "language
— model — procedure" triad in combination with instrumental heterogeneity
(decomposition of the procedure component into separate parts-grains).</p>
      <p>At the macrolevel, the expert assesses the capabilities of the method as a single
whole, and at the microlevel the method is represented as an entity consisting of
separate parts. Macro- and microlevel aspects of the method are interdependent, their
cause-effect relationships exist. It is important to know which modifications of the
method parts at the microlevel lead to its desired properties at the macrolevel. And
vice versa, how to combine and modify the method parts to obtain the desired
properties.</p>
      <p>Fig. 5 shows the classification of the cause-effect relationships of macrolevel
properties of simulation methods and features of their microlevel construction. It uses
the component parts of the method: "model", "description language", "solution
procedure". Model — is representations (conceptual description of the subject domain),
within which the method "works". Change of representations is a qualitative leap of
the method properties from one class to another. The description language — is an
alternative means to record a model, the form of its existence. The procedure — is an
ordered set of actions (calculations) for finding solutions on the model. In a variety of
methods of performing actions, a variety of their properties at the macrolevel is
hidden.</p>
      <p>Decomposition of the procedure component allows us to create sets of typical
tools — grains, from which a tool for solving the problem is built during the
hybridization.</p>
      <p>
        This approach to the representation of the method allowed us to introduce the
evolutionary model "the world of simulation methods" [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The methods of a certain
class, defined by the model and the description language, form a niche in this world.
Within that niche, there is a variety, determined by the variety of procedures for
finding solutions. Change of model – is a change of a niche, and an occurrence of a new
model, representation – is an occurrence of a niche. More often there is an
accumulation of quantitative changes in the procedure part of the methods and their "drift"
within one niche.
      </p>
      <p>In (see Fig. 4,b) the methods are depicted on the microlevel, what is shown by the
variety of their parts with different hatching. In order to achieve the desired
macrolevel properties (hybridization chain), it is possible to combine the parts and obtain
the descendant methods: Method1П ,..., MethodNП . The descendant methods are hybrids
obtained by combining according to the instrumental feature and inheriting the
positive aspects of the reasoning methods used by the experts. We call the hybridization
shown in (see Fig. 4,b), a fine-grained hybridization.</p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] the concept of "hybridization direction", consisting of two levels: 1)"from
the problem"; 2) "from the method" is introduced. The point of the direction "from the
problem" is that the problem should be considered at macro and microlevels.
Macrolevel (problem phenotype) — defines the problem entirely as a complex entity, a
system. The microlevel (complex problem genotype) is a set of subproblems, related
in decomposition by the relation classes. Macro- and microlevel representations of the
problem are interrelated and should be considered in unity. Hybridization "from the
problem" requires: 1) research and extraction of knowledge about the macrolevel and
microlevel representations of the problem; 2) research and extraction of knowledge
about the interdependencies of macro- and microlevel representations.
      </p>
      <p>The point of the direction "from the method" is that each method of a limited set
should be considered at macro- and microlevel. The macrolevel (method phenotype)
is a method entirely as a complex entity, a system. Microlevel (method genotype) is a
set of grains "model", "description language", "solution procedure" or grains of a
more detailed level as components of the decision procedure. Macro- and microlevel
representations of the problem are interrelated and should be considered in unity.
Hybridization "from the method" requires: 1) research and extraction of knowledge
about the possibilities of methods; 2) research and extraction of knowledge about
macrolevel and microlevel representations of methods; 3) research and extraction of
knowledge about the interdependencies of macro- and microlevel method
representations.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Approbation</title>
      <p>
        To approbate the proposed solutions, the diagnostics problem of arterial hypertension
(AH) was chosen - one of the most widespread diseases of the cardiovascular system.
It is established that 20-30% of the world’s adult population suffer from arterial
hypertension (WHO data). To study diagnostics problem of arterial hypertension (DPAH)
the method of mixed reduction [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] was applied, based on the recommendations of the
committee of experts of the Society of cardiology of Russian Federation (SCRF) and
extraction of expert knowledge. Decomposition of DPAH including 12 diagnostics and
9 technological subproblems is constructed. Diagnostics subproblems grouped and
indexed into nine areas of homogeneous parameters: target lesions, 11 risk factors of
cerebrovascular diseases, metabolic syndrome and diabetes, diseases of the peripheral
arteries, ischaemic heart disease, endocrine AH, parenchymal nephropathy and
renovascular AH.
      </p>
      <p>
        The method choice for computer-aided solution of diagnostics subproblems and
analysis of instrumental heterogeneity of the hypertension diagnostics problems is
made on three-quadrant matrix data model that contains "method–characteristics",
"problem–characteristics" and "problem–method" knowledge [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], what allowed us
to set and explore the correspondence on sets of diagnostics subproblems and basic
methods. The general, qualitative characteristics of the methods were taken into
account to ensure the required functionality of the system entirely. As a result, the
developed heterogeneous model field consists of 14 functional models: two artificial neural
networks, nine fuzzy systems, two expert systems and technological models: nine
genetic algorithms.
Notation: X1m2181 – is a 1281 matrix of input vector of the modular artificial neural
network model of ECG recognition; Y7m11  (Y0 ,..., Y6 )tr – is a 71 matrix of output
vector modРЭКГ ;– f1, f2 , f3 operators of the logistic function of the input, hidden
and output layers activation; W1,W2 ,W3 – are the synaptic weights matrices of the
input, hidden and output layers; ДАГ6 – is an interface for information exchange
between models that solve the subproblem of ECG recognition and ischaemic heart
disease diagnostics; TRANS – is a conversion procedure;
( x1k  A1  ...  xnk  An )  yi   – is a fuzzy rule; k – is the rule number in the
k k
knowledge base;  – is the logical operation AND;  – is the logical value (1 - true, 0
- false); j  1, NY ; wkj – is the result of aggregation with min-conjunction;  A (x) – the
membership functions.
      </p>
      <p>
        Laboratory experiments with the HIMAS-AH prototype (a hybrid intellectual
multi-agent system for arterial hypertension diagnostics developed within the grant of the
Russian Foundation for Basic Research (RFBR project No. 16-07-00272)) produced
the following results:
1. With the use of HIMAS-AH, the total time of the examination and result processing
is approximately 30 seconds, which is seven times less than the diagnostics time when
experienced doctors work together with a nurse;
2. A standard deviation in the diagnosis, based on the use of HIMAS-AH, was f =
0,0837, i.e. HIMAS-AH gives a reliable diagnosis in 92% of cases. Thus, the use of
HIMAS-AH on the basis of fine-grained hybridization (see Fig. 4. b) gives better
results than with a homogeneous approach, for example, the well-known "Diagnosis"
project [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] - a system with a knowledge base to support decision making on AH
diagnostics using logical-linguistic methods with the R. Carnap confidence factors method,
which only in 60% of cases formed a right detailed differential diagnosis.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        The tradition of complex problem solving by expert teams led by the DM, has old
roots: military councils, collegium of Ministry, all kinds of meetings, briefings,
concilia, think tanks etc. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ],[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ],[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The urgency of the collective problem solving is
due to the advantages over the individual manager's work: improving the quality of
decisions by taking into account the variety of opinions and integrating the knowledge
of various specialists; increasing confidence of all collective members in the results of
its work and motivation to implement such decisions; compliance with ethical
standards. Experienced decision-makers provide conditions for the emergence of positive
group effects and minimize negative ones, rearranging the composition and structure
of the control system, adapting to changes in the external environment. The problem
is that most of modern computer technology is the medium for implementing
methods, and not an instrument for their synthesis. Hence, similar to computer expert
systems [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ],[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], arguing "no worse" than one person, the information technologies
are not worse than the collective of specialists for management in the conditions of
complex problems. The paper consider a promising approach in creating applied
intellectual decision-making systems in medicine of the new generation, based on the
authors synergetic collective decision-making model and the methods of hybrid
computational intelligence, which allows us to increase significantly the quality of the
results of computer-aided solutions to complex applied problems in information
variety and heterogeneity as well as to enhance decision-making by reducing losses from
erroneous and irrelevant to the problem complexity individual solutions, that is
confirmed by the results of laboratory experiments with the hybrid intellectual
multiagent system for arterial hypertension diagnostics developed within the grant of the
Russian Foundation for Basic Research (RFBR project No. 16-07-00272). The work
in this direction continues intensively.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Klachek</surname>
            ,
            <given-names>P</given-names>
          </string-name>
          , Polupan,
          <string-name>
            <surname>K</surname>
          </string-name>
          , Koryagin,
          <string-name>
            <surname>S</surname>
          </string-name>
          , Lieberman,
          <string-name>
            <surname>I:</surname>
          </string-name>
          <article-title>Hybrid Computing Intelligence. Part 1. Fundamentals of the theory and technology of creating applied systems</article-title>
          . Publishing house of the Baltic Federal University of Immanuel Kant,
          <string-name>
            <surname>Kaliningrad</surname>
          </string-name>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Klachek</surname>
            ,
            <given-names>P</given-names>
          </string-name>
          , Koryagin,
          <string-name>
            <surname>S</surname>
          </string-name>
          , Lizorkina,
          <string-name>
            <given-names>O</given-names>
            : Intellectual Systems Engineering. Publishing house of the Baltic Federal University of Immanuel Kant,
            <surname>Kaliningrad</surname>
          </string-name>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Klachek</surname>
            ,
            <given-names>P</given-names>
          </string-name>
          , Koryagin,
          <string-name>
            <surname>S</surname>
          </string-name>
          , Kolesnikov,
          <string-name>
            <given-names>A</given-names>
            ,
            <surname>Minkova</surname>
          </string-name>
          ,
          <string-name>
            <surname>E:</surname>
          </string-name>
          <article-title>Hybrid Adaptive Intelligent Systems. Theory and development technology</article-title>
          .
          <source>Publishing house of the Baltic</source>
          Federal University of Immanuel Kant,
          <string-name>
            <surname>Kaliningrad</surname>
          </string-name>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kolesnikov</surname>
            ,
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kirikov</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          :
          <article-title>Methodology and Technology of Complex Tasks Solution by Methods of Hybrid Intellectual Systems</article-title>
          .
          <source>Publishing house of the Institute of Applied Informatics of the Russian Academy of Sciences, Moscow</source>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Quaglini</surname>
            ,
            <given-names>S</given-names>
          </string-name>
          , Barahona,
          <string-name>
            <surname>P</surname>
          </string-name>
          , Andreassen,
          <string-name>
            <surname>S</surname>
          </string-name>
          : Artificial Intelligence in Medicine. Springer Publishers, Berlin (
          <year>2001</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Koryagin</surname>
            ,
            <given-names>S</given-names>
          </string-name>
          , Klachek,
          <string-name>
            <surname>P:</surname>
          </string-name>
          <article-title>The Development of Hybrid Intelligent Systems on the Basis of Neurophysiological Methods And Methods of Multi-Agent Systems</article-title>
          .
          <source>In: IEEE First International Conference on Data Stream Mining &amp; Processing</source>
          ,
          <string-name>
            <surname>Lviv</surname>
          </string-name>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Agah</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          : Medical Applications of Artificial Intelligence. CRC Press, Florida (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Rumovskaya</surname>
            <given-names>S</given-names>
          </string-name>
          :
          <article-title>Knowledge-based system for decision making support at diagnosing of the arterial hypertension</article-title>
          .
          <source>In: 9th Joint Conference on Knowledge-based Software Engineering</source>
          , Kaunas, (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Medsker</surname>
            ,
            <given-names>L</given-names>
          </string-name>
          :
          <article-title>Hybrid Intelligent Systems</article-title>
          . Kluwer Academic Publishers, Boston (
          <year>1995</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Wermter</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          : Hybrid
          <source>Neural Systems</source>
          . Springer-Verlag Publishers, Berlin (
          <year>2000</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Rodrigues</surname>
            ,
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Teixeira</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          : Advanced
          <source>Applications of Natural Language Processing for Performing Information Extraction</source>
          . Springer-Verlag Publishers, Berlin (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Castillo</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mellin</surname>
            ,
            <given-names>P</given-names>
          </string-name>
          : Hybrid Intelligent Systems. Springer-Verlag Publishers, Berlin, (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Daniel</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <article-title>Knowledge-Management Systems: Converting and Connecting</article-title>
          .
          <source>Journal IEEE Intelligent systems (3)</source>
          ,
          <fpage>30</fpage>
          -
          <lpage>33</lpage>
          (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Negnevitsky</surname>
            ,
            <given-names>M: Artificial</given-names>
          </string-name>
          <string-name>
            <surname>Intelligence</surname>
          </string-name>
          .
          <article-title>A guide to intelligent systems</article-title>
          . Addison-Wesley Publishers, Harlow (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Carlsson</surname>
            ,
            <given-names>G</given-names>
          </string-name>
          , FACP,
          <string-name>
            <surname>Campion</surname>
            <given-names>F</given-names>
          </string-name>
          :
          <article-title>Machine Intelligence for Healthcare</article-title>
          . CreateSpace Independent Publishing Platform, California (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>