<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>International Journal of Computer Science and Information Security (IJCSIS)</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.1016/j.bbe.2020.02.007</article-id>
      <title-group>
        <article-title>The Use of Neural Network Methods and Atomic Functions in the Problem of Biometric Authentication by ECG</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Natalia Konnova</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Albina Safina</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Bauman Moscow State Technical University</institution>
          ,
          <addr-line>5/1 2nd Baymanskay st., Moscow, 105005</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <volume>40</volume>
      <issue>2</issue>
      <fpage>803</fpage>
      <lpage>814</lpage>
      <abstract>
        <p>The most widespread methods of biometric authentication are not resistant to falsification today. So other more secure individualized features are sought for the biometric authentication problem. One alternative is the heartbeat signal and the electrocardiogram (ECG) signal, in particular. It is individual-specific in the sense of amplitude, peak and other characteristics, and thus difficult to be faked. This article discusses an algorithm for biometric ECG authentication system based on convolutional neural networks. The use of the atomic activation function will also be considered in comparison with the ReLU, which is often used in this type of neural networks. To evaluate the results obtained, metrics are introduced, a numerical experiment is set up using the developed software, within the framework in which the convolutional neural networks have been implemented. To compare the efficiency of classifiers, the estimates of Accuracy, Recall, Specificity, Precision, F1-measure are given. Loss functions and ROC curves have been plotted for each algorithm and dataset.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Neural network</kwd>
        <kwd>Convolutional neural network</kwd>
        <kwd>Activation function</kwd>
        <kwd>atomic function</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Nowadays password-based authentication is the main identification tool, but it is insecure for a
number of reasons [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. The main reason is insufficiently complex passwords, despite the emergence
of password storage services. Therefore, biometric authentication is now increasingly used, which
utilizes distinctive characteristics that can be used to recognize and verify the legitimacy of users. The
ECG signal has great potential to become a powerful authentication tool due to its properties. Moreover,
recently, heart rate variability has been deeply studied and it has been proven that due to the
characteristics of human anatomy, the ECG cannot be faked [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. It is also worth noting that this
characteristic cannot be removed without special sensors, which prevents information leakage. Its
further use as biometrics, in addition to diagnostics in medicine, is due to the factors described in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>In general, two types of errors are considered in biometric systems: false positive (type I error),
which leads to denial of access to a legitimate user, and omission of events (type II error), which leads
to access to the system by an illegitimate user. These errors are inversely related and are regulated by
the decision threshold by the classifier in favor of convenience (reduction of type I errors), or in favor
of safety (minimization of type II errors).</p>
    </sec>
    <sec id="sec-2">
      <title>2. Materials and Methods</title>
      <p>For the experiment, the international PhysioBank ATM database of measurements of normal heart
rate MIT-BIH nsrdb was used2. This database includes 18 long term ECG records of subjects. The
subjects included in this database did not have significant deviations from the norm; these include 5
men between the ages of 26 and 45 and 13 women between the ages of 20 and 50. For a randomly
selected legitimate user, 18 signals of 10 seconds each were collected from the total recording, for the
rest, 2-3 segments were selected, also 10 seconds each.
2.1.</p>
    </sec>
    <sec id="sec-3">
      <title>Preprocessing of ECG signals</title>
      <p>
        The original data requires preliminary processing, as it contains noise and various distortions. The
signal was filtered using a Butterworth bandpass filter (BFB) of 0.5–45 Hz [
        <xref ref-type="bibr" rid="ref5">5, 18</xref>
        ], which allows one
to reduce the frequency and remove signal distortions while retaining significant components.
      </p>
      <p>
        After filtering, it is necessary to highlight the signs of the ECG signal, mainly the QRS complex, P
and T waves [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The features were extracted according to the following algorithm:
Detect R waves in the general ECG signal.
      </p>
      <p>Divide into ECG cycles between adjacent R waves.
1.
2.
4.
5.</p>
      <p>
        3. Interpolate ECG cycles (since templates can have different lengths and frequencies, it is
necessary to interpolate each cycle before normalization; in this work, interpolation was carried
out using the cubic spline algorithm [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]).
      </p>
      <p>
        Normalize ECG cycles using the algorithm [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>Next, you need to select a single template, for this the average value at each point is calculated,
i.e.</p>
      <p>for
each
  ∈ [0 ∶ 0,01 ∶ 1]
calculate
the
mean
value
 (  ) =
  (  ) , where   ∈ [0 ∶ 0,01 ∶ 1] and  ∈ [0 ∶ 1 ∶ 10]; display the ECG cycle
=  (  ), where   ∈ [0 ∶ 0,01 ∶ 1].
2.2.</p>
    </sec>
    <sec id="sec-4">
      <title>Overview of Neuron Network Architecture</title>
      <p>
        In deep learning, a convolutional neural network (CNN or ConvNet) is a class of deep neural
networks most commonly used to analyze visual images [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The essence of convolution is to create
another set of values, which is called a kernel or filter. Today, there are other layers in the traditional
convolutional neural network that are interspersed with convolutional layers. Activation layer is a layer
that is a kind of non-linear function (usually ReLU and its modifications), often logically combined
with a convolution layer. The pooling layer is a layer that is a non-linear compaction of the feature map.
The maximum function (or Softmax) is usually used. The last layer of the network is the fully connected
layer. Each neuron in this layer is a perceptron with a nonlinear activation function.
      </p>
      <p>A schematic diagram of the convolutional neural network used in this study is shown in Fig. 1.</p>
      <p>The unique approximation properties of artificial neural networks are largely achieved due
to activation functions that determine the dependence of the output signal on the weighted sum
of signals at the input of the neuron. Thus, the artificial neuron is characterized by its activation
function. Non-linear activation functions allow neural networks to solve non-trivial problems
with a small number of nodes. Let's consider the used activation functions.</p>
      <p>ReLU is a rectified activation function, its idea is that the excitation of biological neurons
cannot be expressed with a negative value (1). Neurons introduce nonlinearity at zero that can
be used to make decisions.</p>
      <p>( ) = max {0,  }.
(1)
2 Open access databases on PhysioNet, 2021. URL: https://physionet.org/about/database/.</p>
      <p>
        Sigmoidal functions based on finite infinitely smooth solutions of functional differential equations
with deviating argument are often called atomic functions (AF); they were first introduced in the works
of V.L. Rvachev and V.A. Rvachev [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ]. Atomic functions are a convenient tool for numerical
analysis, approximation theory, digital signal processing [
        <xref ref-type="bibr" rid="ref11 ref12 ref13">11-13</xref>
        ]. Despite the fact that AF 
an entire function and has an infinite spectrum, expansion (2) provides a satisfactory quality of
( ) is not
approximation in the interval [
        <xref ref-type="bibr" rid="ref1">-1,1</xref>
        ]. The appearance of the function, as well as its derivative, is shown
in Fig. 2.
      </p>
      <p>( ) =</p>
      <p>2 −1
 =−2 +1
(−1 ≤  ≤ 1).</p>
      <p>Let's consider the capabilities of AF for the presentation of activation functions. We will choose the
simplest AF  ( ) as the basic one.</p>
      <p>( ) =</p>
      <p>( )

−1
= 
1 ,
1
2
1
2
 −
, при  ≤ 1</p>
      <p>.</p>
      <p>при  ≤ 1</p>
      <p>Then, by virtue of the main functional differential equation for the AF  ( ), we obtain a simple
expression for the derivative:
 ( ) =  ( ) =  (2 + 1) −  (2 − 1).
(4)</p>
      <p>Based on the properties described above, it can be assumed that using these functions, the result of
neural network classification can be expected at least no worse than using the rectified activation
function ReLU [17]. To test this hypothesis, a numerical experiment was carried out, described below.</p>
    </sec>
    <sec id="sec-5">
      <title>3. Numerical experiment</title>
      <p>After preliminary preprocessing of the ECG signal and the stage of feature extraction, a vector of
122 coefficients representing the signal template was obtained for each signal. Figure 3 shows a view
of several templates from the general sample, superimposed for clarity of data variability.
3.1.</p>
    </sec>
    <sec id="sec-6">
      <title>Performance evaluation strategies</title>
      <p>The neural network parameters were selected empirically. CNN consists of two convolutional layers,
between which are pooling layers and two fully connected layers of 125 neurons each, with FA ReLU,
or atomic FA; there are two neurons with Softmax FA on the output layer. During training, the
crossvalidation coefficient was zero, since in biometrics tasks it is necessary to achieve overfitting of the
neural network for better recognition of a legitimate user.</p>
      <p>
        In the NN model, a binary classification is used to recognize ECG signals: class "1" defines a
legitimate user, and class "0" is an illegitimate user. To assess the effectiveness of the binary classifier,
the following assessment metrics are calculated: the proportion of correct answers (accuracy);
precision; recall; sensitivity; specificity, F-measure [
        <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
        ] and ROC-curve [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
    </sec>
    <sec id="sec-7">
      <title>4. Results</title>
      <p>Further in Fig. 4 there are shown the ROC curves for assessing the quality of binary classification,
graphs of recognition accuracy, graphs of loss functions, and a graph of changes in the number of type
II errors (FP) during training.</p>
      <p>For testing, samples were selected that did not participate in training the neural network model. In
total, 20 samples were used for testing, 10 of which belong to a legitimate user.</p>
      <p>When using a ReLU activation function, the probability of a legitimate user's samples belonging to
class "1" is on average 0.9979, and of samples of other users to class "0" - ~ 1.0000. This indicates both
that the model is well trained and type II errors are minimized, and that the probability of false positives
is small.</p>
      <p>When using Atomic AF, the probability of a legitimate user's samples belonging to class "1" is on
average 0.9667, and of samples of other users to class "0" - 0.9758. Slightly worse than using ReLU.</p>
      <p>Metrics</p>
      <sec id="sec-7-1">
        <title>Accuracy</title>
      </sec>
      <sec id="sec-7-2">
        <title>Recall</title>
      </sec>
      <sec id="sec-7-3">
        <title>Precision ROC-AUC FN FP</title>
      </sec>
      <sec id="sec-7-4">
        <title>Loss</title>
      </sec>
      <sec id="sec-7-5">
        <title>Specificity</title>
        <p>F-мера</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>5. Conclusions</title>
      <p>This paper describes the results of using a convolutional neural network in combination with the use
of an atomic activation function in the task of biometric authentication.</p>
      <p>When comparing the two activation functions, we notice that for the submitted model of the neural
network, ReLU and atomic AF, which is often used in similar architectures, the atomic AF showed
itself better during training (1% of skipping events during training, F-measure equal to 0.9681). But in
testing, ReLU performed better, which shows its suitability for the authentication task. However, taking
into account the specifics of the operation of neural networks in authentication systems, the indicator
of efficiency during training is of decisive importance, since when a new user is added to the system,
the template of this user of the neural network will be presented. And in the future, during the operation
of the network, it deals with those objects of marked data that have already been presented to it. Since
within the framework of the authentication procedure, only the verification of the data presented by the
user is carried out for the possibility of issuing rights to access limited resources.</p>
      <p>As we can see, convolutional neural networks show high results in training and testing in biometric
authentication tasks, which indicates that they can be effectively used to implement these information
security systems, including to check the user's access rights by heart rate. Research shows that such
authentication methods are quite promising [19]. A number of products are already on the market and
are becoming widespread (e.g. Nymi Workplace Wearables3 and ECG/EKG algorithms4), and many
more will appear in the near future. Questions of practical implementation and directions for improving
the software and mathematical part of such systems will be relevant for quite a long time.
3 Nymi Workplace Wearables, 2021. URL: https://www.nymi.com/nymi-band.
4 A suite of powerful ECG/EKG algorithms and analytics for user identification, 2021. URL:
https://www.bsecur.com/heartkey/.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Ivanov</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sulavko</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Draft of the Third National Standard of Russia for Fast Automatic Learning of Large Correlation Neural Networks on Small Training Samples Of Biometric Data</article-title>
          .
          <source>Voprosy kiberbezopasnosti</source>
          .
          <source>2021. No</source>
          <volume>3</volume>
          (
          <issue>43</issue>
          ), pp.
          <fpage>84</fpage>
          -
          <lpage>93</lpage>
          . DOI:
          <volume>10</volume>
          .21681/
          <fpage>2311</fpage>
          -3456-2021-3-
          <fpage>84</fpage>
          -
          <lpage>93</lpage>
          . (in Russ.).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>K.</given-names>
            <surname>Sidek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Sufi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            <surname>Khalil</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Al-Shammary</surname>
          </string-name>
          ,
          <article-title>"An efficient method of biometric matching using interpolated ECG data,"</article-title>
          <source>2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES)</source>
          ,
          <year>2010</year>
          , pp.
          <fpage>330</fpage>
          -
          <lpage>335</lpage>
          , doi: 10.1109/IECBES.
          <year>2010</year>
          .
          <volume>5742255</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agrafioti</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hatzinakos</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Plataniotis</surname>
            ,
            <given-names>K.N.</given-names>
          </string-name>
          ,
          <article-title>“Analysis of Human Electrocardiogram for Biometric Recognition”</article-title>
          .
          <source>EURASIP J. Adv. Signal Process</source>
          .
          <year>2008</year>
          ,
          <volume>148658</volume>
          (
          <year>2007</year>
          ), doi: 10.1155/
          <year>2008</year>
          /148658.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Plácido</surname>
            <given-names>da Silva</given-names>
          </string-name>
          , Hugo, Fred, Ana, Lourenco, Andre and Jain, Anil, “
          <article-title>Finger ECG signal for user authentication: Usability and performance</article-title>
          .
          <source>” IEEE 6th International Conference on Biometrics: Theory, Applications and Systems, BTAS</source>
          <year>2013</year>
          , (
          <year>2013</year>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          , doi: 10.1109/BTAS.
          <year>2013</year>
          .
          <volume>6712689</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Butterworth</surname>
          </string-name>
          , “
          <article-title>On the Theory of Filter Amplifiers,” Experimental Wireless and the Wireless Engineer</article-title>
          , Vol.
          <volume>7</volume>
          ,
          <issue>1930</issue>
          , pp.
          <fpage>536</fpage>
          -
          <lpage>541</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Meixue</given-names>
            <surname>Yang</surname>
          </string-name>
          , Bin Liu,
          <string-name>
            <given-names>Miaomiao</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Fan</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Guoqing</given-names>
            <surname>Wang</surname>
          </string-name>
          , Fengfeng Zhou, “
          <article-title>Normalizing electrocardiograms of both healthy persons and cardiovascular disease patients for biometric authentication</article-title>
          .”
          <source>PLoS One</source>
          .
          <source>2013 Aug</source>
          <volume>20</volume>
          ;
          <issue>8</issue>
          (
          <issue>8</issue>
          ): e71523, pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          , doi: 10.1371/journal.pone.
          <volume>0071523</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Felipe</given-names>
            <surname>Gustavo Silva Teodoro</surname>
          </string-name>
          ,
          <string-name>
            <surname>Sarajane M. Peres</surname>
          </string-name>
          , and
          <string-name>
            <surname>Clodoaldo A. M. Lima</surname>
          </string-name>
          ,
          <article-title>"Feature selection for biometric recognition based on electrocardiogram signals,"</article-title>
          <source>2017 International Joint Conference on Neural Networks (IJCNN)</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>2911</fpage>
          -
          <lpage>2920</lpage>
          , doi: 10.1109/IJCNN.
          <year>2017</year>
          .
          <volume>7966216</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Valueva</surname>
            ,
            <given-names>M.V.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Nagornov</surname>
            ,
            <given-names>N.N.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Lyakhov</surname>
            ,
            <given-names>P.A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Valuev</surname>
            ,
            <given-names>G.V.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Chervyakov</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <article-title>"Application of the residual number system to reduce equipment costs for the implementation of a convolutional neural network." Matematika i komp'yutery v modelirovanii, Elsevier BV (</article-title>
          <year>2020</year>
          ), Vol.
          <volume>177</volume>
          , pp.
          <fpage>232</fpage>
          -
          <lpage>243</lpage>
          , doi: 10.1016/j.matcom.
          <year>2020</year>
          .
          <volume>04</volume>
          .
          <fpage>031</fpage>
          . (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>V. L.</given-names>
            <surname>Rvachev</surname>
          </string-name>
          and
          <string-name>
            <given-names>V. A.</given-names>
            <surname>Rvachev</surname>
          </string-name>
          , “
          <article-title>A certain finite function,” Dokl</article-title>
          . Akad. Nauk UkrSSR,
          <source>Ser. A, No. 8</source>
          ,
          <issue>1971</issue>
          , pp.
          <fpage>705</fpage>
          -
          <lpage>707</lpage>
          . (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>V. L.</given-names>
            <surname>Rvachev</surname>
          </string-name>
          and
          <string-name>
            <given-names>V. A.</given-names>
            <surname>Rvachev</surname>
          </string-name>
          , “
          <article-title>Nonclassical Methods of Approximation Theory in Boundary-Value Problems”</article-title>
          ,
          <string-name>
            <surname>Naukova</surname>
            <given-names>Dumka</given-names>
          </string-name>
          , Kiev,
          <year>1979</year>
          . (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Basarab</surname>
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zelkin</surname>
            <given-names>E.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kravchenko</surname>
            <given-names>V.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yakovlev</surname>
            <given-names>V.P.</given-names>
          </string-name>
          , “
          <article-title>Digital signal processing based on the Whittaker - Kotelnikov - Shannon theorem”</article-title>
          ,
          <source>М.: Radiotekhnika</source>
          ,
          <year>2004</year>
          , ISBN:
          <fpage>5</fpage>
          -
          <lpage>93108</lpage>
          -064-3. (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Kravchenko</surname>
            <given-names>V.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rvachev</surname>
            <given-names>V.L.</given-names>
          </string-name>
          , “
          <article-title>Algebra of logic, atomic functions and wavelets in physical applications”</article-title>
          ,
          <source>М.: Fizmatlit</source>
          ,
          <year>2006</year>
          , ISBN 5-9221-0752-6. (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Soldatenkov</surname>
            <given-names>V.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Achildiev</surname>
            <given-names>V.M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Gruzevich</given-names>
            <surname>Yu</surname>
          </string-name>
          .K., et al.,
          <article-title>“Human internal organs diagnostics based on heart biophysical signals”, XXVII St</article-title>
          .
          <source>Petersburg International Conference on Integrated Navigation Systems Collection of materials</source>
          ,
          <year>2021</year>
          , in press.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Konnova</surname>
            <given-names>N.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khaperskaya</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
          </string-name>
          ., “
          <article-title>Application of machine learning algorithms and neural networks for SCG signal classification”</article-title>
          , Biomeditsinskaya radioelektronika,
          <year>2020</year>
          , Vol.
          <volume>23</volume>
          , Issue 1, pp.
          <fpage>5</fpage>
          -
          <lpage>20</lpage>
          , doi: 10.18127/j15604136-202001-
          <fpage>01</fpage>
          . (in Russ.)
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Konnova</surname>
            <given-names>N.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Basarab</surname>
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khaperskaya</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
          </string-name>
          ., “
          <article-title>Application of machine learning algorithms for SCG signal classification”</article-title>
          ,
          <source>Proc. of 3rd International conference on Image, Video Processing and Artificial Intelligence (IVPAI-2020)</source>
          , Shanghai, China,
          <year>2020</year>
          , 115841L, doi: 10.1117/12.2579578.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Kohavi</surname>
            <given-names>R</given-names>
          </string-name>
          , “
          <article-title>A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection”</article-title>
          ,
          <source>14th International Joint Conference on Artificial Intelligence</source>
          , Palais de Congres Montreal, Quebec, Canada,
          <year>1995</year>
          , pp.
          <fpage>1137</fpage>
          -
          <lpage>1145</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>