<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>X (A. Pal);</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Denoising of ECG signals using artificial neural network based gradient descent method</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aditya Pal</string-name>
          <email>aditya.16202@gnindia.dronacharya.info</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hari Mohan Rai</string-name>
          <email>drhmrai@gachonac.ac.kr</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Abdul Razaque</string-name>
          <email>arazaque@iitu.edu.kz</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Saule Amanzholova</string-name>
          <email>s.amanzholova@astanait.edu.kz</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tamiris</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Astana IT University</institution>
          ,
          <addr-line>Astana</addr-line>
          ,
          <country country="KZ">Kazakhstan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Information Technology, Dronacharya Group of Institutions</institution>
          ,
          <addr-line>Greater Noida</addr-line>
          ,
          <country country="IN">India</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>International Information Technology University</institution>
          ,
          <addr-line>34/1 Manas St. Almaty, 050000</addr-line>
          ,
          <country country="KZ">Kazakhstan</country>
        </aff>
      </contrib-group>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>In the evaluation of heart conditions, the Electrocardiogram (ECG) is a tool cannot be done without by the physicians. It is also vital to achieve excellent signal quality free from noise for greater accuracy in diagnostics. This paper also proposes a new ANN infrastructure for implementing the ECG signal denoising by designing a multilayer ANN that has not been developed earlier in the literature. In contrast, our approach hereby detailed does not require extreme measures of minimizing noise because the ANNs are inherently suited for detecting signal patterns from noise. We train our ANN using a noisy ECG signal as input and using a reference to the denoised signal as the desired output. The performance and evaluation of our presented model is calculated through (RMSE), with gradient descent method (GDM) used to optimize the network weights to achieve the minimum RMSE. This process determines the precise MMSE configuration that can minimize the mean-squared error in noise elimination. Therefore, from our experiments, it can be concluded that presented model provides more reliable approach, as compared to conventional technique like genetic optimize wavelet thresholding (GOWT), for preserving the integrity of the signal. Our proposed method outshines the existing methods in performance terms, as indicated by the key performance metrics which includes, (RMSE) of 0.0031, smoothness index (R) of 0.6070, and (SNR) of 35.8188. When compared and validated against the MIT-BIH ECG dataset, it is clear that our presented model offers better denoising capabilities and is easily implementable for real-world ECG signal analysis. This novel approach creates new opportunities for furthering the diagnostic capacity of ECGs and has the potential to become a groundbreaking tool in the biomedical signal processing field, providing a quantum leap in healthcare technology in the future.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;ECG signal denoising</kwd>
        <kwd>ANN</kwd>
        <kwd>gradient descent</kwd>
        <kwd>noise reduction</kwd>
        <kwd>MIT- BIH arrhythmia dataset</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The ECG signal recording is produced every time the heart beats and is associated with the electrical
activity in cardiac muscles. This electrical action is measured by electrodes that are attached to the
skin and which pick up the changes in electrical potential of skin with each beat [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The abnormal
ECG waveform is actual voltage manifestation of depolarization and repolarization of atrial and
ventricular musculature linking the electrodes sited on the left and right chest. These signals similar
in type are dissimilar in nature in the case of different patients and therefore require unique
comparison signals for precise medical diagnosis [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. However, the presence of noise – usually
caused by interference from a number of electrical devices- makes the diagnostic process difficult.
ECG signal and muscle noise, which often occupies nearby frequency range, makes the task even
more challenging, as simple digital filtering may have an impact, for instance, on the ST-segment. To
address this challenge, two primary approaches have emerged: It is specifically based on the
structural feature-based methods and template matching techniques. The former is heuristic and
specific to some components such as the QRS complex while the later implies reconstructing a signal
from other known part by part or by correlation-matched filter or some other methods of pattern
recognition. These approaches have gone further each to advance diagnostic for many forms of heart
disease [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The most used techniques for noise elimination involve using filters and wavelet
transforms, the later being however challenged with problems such as slow convergence rate and
higher mean square error. For noise reduction other techniques such as the Empirical Mode
Decomposition (EMD) have been used and are also flawed[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. But the weakness of the convergence
rate and the mean square error often discourages the use of wavelet transforms. As discussed above,
there are several techniques, including Empirical Mode Decomposition (EMD) methods, which try to
reduce the level of ECG noise but which have some drawbacks. The aim of this paper lies in
presenting the new method to filtering the signals of ECG Poincare plot using ANN trained with GD.
In contrast to most filters out there, our approach maintains the diagnostic quality of ECG signal
while at the same time getting rid of most of the noise. Examples also indicate that signal quality
increases when using our proposed technique by a factor that could benefit medical analysis.
      </p>
      <sec id="sec-1-1">
        <title>Key Findings</title>
        <sec id="sec-1-1-1">
          <title>Demonstrated significant</title>
          <p>improvement in noise
reduction and feature
preservation, especially in
highly noisy environments</p>
        </sec>
        <sec id="sec-1-1-2">
          <title>Achieved superior performance by combining deep learning accuracy with traditional filtering reliability</title>
        </sec>
      </sec>
      <sec id="sec-1-2">
        <title>Challenges</title>
        <sec id="sec-1-2-1">
          <title>High computational cost, potential model complexity increases overfitting risks</title>
          <p>Increased computational
load and complexity
MeAc htCtaeNnnNitsismons in oInemncphrriatonivccaeildnasgtichgcnenuoarmilaseoccyodrmeedl’pusocfntoieconuntss, oCivneotrmefnidpstautitvitanaesgt,eirotiinsnskasmlolyfall
EDmecpoirmicpaol sMitioodne I mcopfmriolptvaeerrdiendngtootiestcerharndeidiqtuiuocentsiaoln periCnnfoootreimsmnypsaiucnvotceane,tdilioiinmtniohaitlnielgysdhly
MaCtMcToheraermtdeclphaFlitianlittogeen,r,ing isdpeIenncctifirfeiycaisnEegCdaGanccdcoudmreapncooynisieninngts Rgeeqnuceirrreaeanlsitozipoeisrnewe,ctemiysllpeateytosenmvoaptrliaetde
StBruacsMetuderHathleoFudersaistutirce- cEofmfepctoinveenintsdliekneoQisRinSgcsopmecpilfeixc comSpefoolernceodtinvevtneesro,atilolselissnsspiggeencffiaeflcitcive
NCeuorn(avCloNNluNettsiwo)noarkls redHuicgthioEanCc,cGpurfreeasacetyruvirenedsncoriisteical copmoRtpeeunqtttruaiaiatirlineooisnnveagexlrdtrfeeainsttatsoiiunvrgecetos,
Wavelet Transform Enhanced noise reduction and Complex implementation,
+ Support Vector signal preservation compared increased computational</p>
          <p>Machines (SVM) to individual methods requirements</p>
          <p>Table 1 reveals that a variety of techniques have been used as methods to filter out noises in the
ECG signal. The wavelet transform method used for the noise reduction yielded some improvement
in attenuation of noise and retention of signal details but some problems such as low convergence
rate and high mean square errors were realized. The empirical mode decomposition method
improved the noise reduction more than the simple filtering methods, but it was slow and its
efficiency was low only in high noise conditions. Feature-based methods for dealing with noise
improved the accuracy of identifying and noise reduction of certain ECG parts, which depended on
the creation of a template and did not allow for variability in the noise. As for the heuristic methods
based on structural features, they are with a high capability of denoising specific components such as
the QRS complex, but they only have this capability for specific components and cannot offer a good
signal denoising solution in overall. CNNs received high mean accuracies for noise reduction and
well-maintained features of ECG signals but it consumed more time, computational power and was
prone to overfitting. Application of wavelet transform in combination with support vector machines
(SVM) proved to be superior to solely applying wavelet transform or SVM at the same time, but the
application was more complicated as well as required more computational power.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2. Materials and methods</title>
      <p>
        Artificial Neural Network (ANN) – an artificial system, which emulates the function of biological
neural networks, that is a network of Artificial Neurons, interconnected with one another[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. This
research applies a neural network to filter ECG signals to remove the noise that is present in the
signal. In this approach the input unit is the noisy ECG signal while the output unit represents the
clean noise free signal. The first layer performs an input layer taking all the input vectors, and for
each of them, the calculation is performed in the hidden layer taking a dot product of elements of the
input vector in question and weights assigned to concrete nodes of the hidden level [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The model
presented uses three random inputs which are produced from the initial ECG signals through shifting
and forms a matrix with several samples from these three independent inputs [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. The weights that
are incorporated to the network are tuned in the Gradient Descent Method. To update the weights of
the neural network, the back propagation algorithm is used which computes the first order derivative
of the quadratic non-linear error function with respect to each of the network weights with the help
of Chain rule [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. This process is very time consuming and requires the use of tangent sigmoid
functions at each node to carry out the number of different computations. In order to combine
experiences from the field of solution of the problem related to the determination of the number of
hidden layer nodes and the computational complexity of the Multilayer Perceptron (MLP), the article
presents the dynamic neural network in which the number of nodes in the hidden layer and the
network weights are optimized [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. After several iterations the proposed system adds more nodes to
the hidden layer while the weights adjusting the connection between the input and the hidden layers
remain estimated at initiation [19].
2.1. MIT-BIH ECG dataset
In this research, the employed dataset is obtained from the MIT-BIH Arrhythmia Database, which is a
detailed and well-known database for studying ECG signals. There are 48 half-hour long recordings
of two-channel ambulatory ECG samples used in this database which consists of important cases for
investigation of the efficiency of the applied noise reduction procedures. In total, the database
contains about 230 different ECG samples, which have been recorded at the highest possible
resolution of 360 samples per second per channel [20]. The recordings are digitized with 11 bits at a
range of 10 mV, making it possible to be accurately rendered. In this regard, for the purpose of this
study, only the first 60 seconds segment of the ECG signal was selected out of each 30 minutes record
[21]. This segmentation was made in order to draw a representative sample of the data for the offline
denoising evaluation, while not to burden the method with too much data. In this way, we confine
sampled data for analysis to the first one minute of every recording so as to include a variety of heart
rhythms and noise patterns that might exist in the whole recording. It enables us to have a consistent
assessment of the noise removal process while at the same time generalizing our results to the rest of
the set [22]. Hence, the structure of the choice of a segment of 60 seconds makes it possible to carry
out a detailed analysis while keeping the computational complexity reasonably low – this testifies to
the fact that the choice of the, indeed, allows carrying out quite a rigorous testing and validation of
our proposed methodology.
2.2. Data preprocessing
The ECG signals used in the present work are taken from the MIT-BIH Arrhythmia Database and
they go through the following preprocessing steps before the denoising process is implemented. One
of the steps into this preprocessing phase is to partition the raw ECG data into 60-second portions.
This segmentation is useful to isolate reasonable portions of the data, record different types of heart
rhythm and most importantly different noise pattern that exist within the recording, patterns that are
fundamental in a comprehensive and impartial assessment.
      </p>
      <p>Next phase after segmentation is amplification normalization of the ECG signals to a standard
amplitude. This normalization process ensures that all signals have the same magnitude which
eradicates the problem of variable strength of signals at certain times hence variable levels of
interference [23]. The normalization is performed using the equation:</p>
      <p>Normalized Signal= ECG Signal− Mean</p>
      <p>Standard Deviation
where the mean, standard deviation are computed within the signal segment.</p>
      <p>As a result of high frequency noise and baseline wander, preliminary filtering is conducted to the
above signals. A low pass filter negates high frequency noise for example muscle noise and a high
pass filter deals with Baseline wander[24]. The filtering is performed using:</p>
      <p>Filtered Signal= ECG Signal ∙ H ( f )
where H ( f )is frequency response of filter.</p>
      <p>
        This is followed by removal where certain artifacts such as motion or electrical interference ones
are noted and then eliminated [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. This step employs artifact correction algorithms to either
completely eliminate or minimize those artifacts so that signal quality enhances. The artifact removal
process can be modeled as:
      </p>
      <p>Clean Signal= ECG Signal− Artifact Component
Last of all, through resampling there is a preservation of sampling rates, which is crucial in training of
the neural network and assessments. Originally recorded at non-integers such as 360 samples per
second, resampling normalizes the data to a constant value if required. The resampling process
involves:</p>
      <p>Resampled Signal= ECG SignalOriginal ↓ Resampling Rate</p>
      <p>All these steps of preprocessing help in improving the quality of the ECG signals so that it is more
appropriate for denoising. Normalizing the data, filtering, artifact removing and resampling make the
data suitable for the artificial neural network to perform noise removal in a perfect manner.
2.3. Model design and description</p>
      <p>The model that is primarily to propose is the Artificial Neural Network (ANN) that will eliminate
noise on the ECG signals. The architecture of the network allows the receiving, processing, and
denoising of the ECG data through of layers of the multilayer structure and specific weights and
update systems.</p>
      <p>Inputs: These inputs consist of three noisy input signals designated as X 1, X 2,⋯ , X n and are
simply shifted versions of the three ECGs as previously discussed. Each of the input signals is
matrices containing numerous samples, thus offering the network a range of noisy data to work on.</p>
      <p>Weights: First, the model employs weights at three levels, that is W ji , U kj ,∧V lk. Specifically:


</p>
      <p>W ji denote the input weights connecting the input layer with hidden layer pixels.
U kj is the weights inside hidden layer of the artificial neural network.</p>
      <p>V lk stands for the weights that interconnect the hidden as well as the output layer.</p>
      <p>Neuron Nodes: For the aggregation function in the network, a simple perceptron is used while an
activation function used is the tangent sigmoid function ( tanh ( x )). These domains collectively
enable abrupt change and learning within the network of the system.</p>
      <p>Weight Update Mechanism: Weights of the network are modified by using the techniques of
Gradient Descent Method. As it has been said this adjustment is performed by delta rule under which
it is necessary to compute the derivative of the error with relation to each weight in the network. This
tends to be rather processing demanding since there is a need to calculate tangent sigmoid functions
and use the chain rule when computing for gradients. The weight update rules for different layers are
as follows:
</p>
      <p>Input Layer Weight Update: The weight update rule for the input layer is given by:
dE</p>
      <p>=
d ( ydp− yap) ×
which simplifies to:
∆ w ji=η ×
1 ∑P [( ydp− yap) ×(1− yap2)×(1− zap2)× V lk ×(1−t ap2)× U kj × xi ]</p>
      <p>P p=1
</p>
      <p>Hidden Layer Weight Update: The weight update rule for hidden layer is:
dduEkj = d ( yddpE− yap) × × d ( ndettapY ) ×
which simplifies to:
∆ ukj=η × 1 ∑P [( ydp− yap) ×(1− yap2)×(1− zap2)× V lk × z j ]</p>
      <p>P p=1</p>
      <p>d yap
d ( net Y )
dE =
d vlk</p>
      <p>dE
d ( ydp− yap)</p>
      <p>×
which simplifies to:
d ( ydp− ya )</p>
      <p>p ×
d yap
wnjiew=wojild + ∆ w ji
unkjew=ukojld + ∆ ukj
vlnkew=vlokld + ∆ vlk
where η is the learning rate. The updated weights are calculated as follows:</p>
      <p>Training persists to the level of MMSE. At this stage, the weights of the network are fixed and
these parameters are employed for the purpose of removing noise from ECG signals.</p>
      <p>Algorithm 1: ECG Denoising with Multilayer Neural Network
1: Input: D= X i , Y i , η , T , B , N
2: Initialize:
3: Network Weights {W ji , U kj , V lk }
4: For epoch=1 ¿ T do :
5: For epoch=1 ¿ NB do :</p>
      <p>Extract Batch:
Dbatch=( X batch , Y batch)</p>
      <p>Forward Pass:
Input Layer: Compute activations using X batch and weights W ji
Hidden Layer: Compute activations using X batch, W ji and weights U kj
Output Layer: Compute denoised signal using activations using activations from hidden
layer and weights V lk</p>
      <p>Compute Loss:
E= P1 ∑p=P1 ( ydp− yap)2</p>
      <p>Backpropagation:
Update weights for input layer: ∆ w ji=η ×
Update weights: wnjiew=wojild + ∆ w ji
Update weights for hidden layer: ∆ ukj=η ×
Update weights: unkjew=ukojld + ∆ ukj
Update weights for output layer: ∆ vlk=η ×
dE
d vlk
 Update weights: vlnkew=vlokld + ∆ vlk
12: End for
13: End for
14: Output: Trained neural network model with updated weights {W ji , U kj , V lk }</p>
      <p>The algorithm describes a flowchart for utilization of a neural network for denoising of ECG
signals. It begins by setting essential parameters, such as the learning rate, number of epochs, batch
size, and initializing the network weights across three levels: and an input layer, one or more hidden
layers and an output layer. In each epoch, the algorithm takes batches of noisy ECG signals as input
and input into the layer of the neural network. The hidden nodes provide net activations of the given
inputs which are summations of weighted inputs, and then put it through the tanh sigmoid activation
function because the hidden layer is supposed to respond to non-linear inputs. However, an
important aspect of the algorithm is with the weights managed by the Gradient Descent Method. This
optimization is done in order to minimize the (Mean Squared Error) between the output of the
network and the clean ECG signal. The changes in weights for each layer are calculated by back
propagation wherein the chain rule is used so as to incorporate the contributions of each layer. The
process goes on until the network reach the (MMSE) which means that the network has optimized its
performance. The last output is an Enhanced Neural Network Model with well-tuned weights for the
actual work of removing noise from ECGs for diagnosis.
2.4. Evaluation metrics
For the evaluation of the performance of the presented denoising model, several metrics have been
used for evaluation such (SNR), (RMSE) and the smoothness index (r).</p>
      <p>Signal-to-Noise Ratio (SNR): The SNR is a very important indicator of the signal strength after
denoising, but with reference to the background noise. It determines the amount of enhancement that
has been provided to the signal, that is, amount of noise rejection [25]. The SNR is calculated using
the following formula:</p>
      <p>SNR=10 log10 N
∑ ⃓
i=1</p>
      <p>N
∑ Ŝ ² ( i )
i=1
Ŝ (i )−Ŝ ( i )⃓
²
RMSE: RMSE is one of the measures of variability that tell about the deviations of actual values from
the model predicted values. It gives a measure in terms of the quantitative extent of the error that
exists in the denoised signal [26]. The RMSE is computed as follows:</p>
      <p>RMSE=√ N i=1</p>
      <p>1 ∑n−1 [ S (i )−Ŝ ( i )] ²
Smoothness Indes (r): The smoothness index (r) is a measure that is used to compare the smoothness
of the signal that has been denoised with the original signal. It is a useful measure to check that the
denoising process does distort the useful signal in undesirable ways, with regard to fluctuations[27].
The smoothness index is defined as:
r = ni=−11
n−1
∑ [ Ŝ (i +1)−Ŝ ( i )] ²
∑ [ S (i +1)−S ( i )] ²
i=1</p>
      <p>By examining these measures, one can assess comprehensively how our suggested denoising
model works out on ECG signal quality enhancement task with least possible distortions to the
integrity and purity of the ECG signal.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Experimental result</title>
      <p>Our study findings show that the developed neural network, which applies gradient descent for
signal conditioning, affords better signal denoising in ECG signals than conventional methods like
hard and soft thresholding or Genetic Optimize Wavelet Thresholding (GOWT). The RMSE is a
measure of the amount of filtering distortion which is a very important factor. A lower RMSE will
mean that the processed signal, denoised signal will be nearer to the original signal and therefore
minimizing deformation. From the present scenario of RMSE 0.0031 proposed method is
comparatively better than the hard thresholding 14.5143, soft thresholding 25.0662, GOWT 19.9805
hence it is clear that there is less distortion is introduced in the signal by the proposed method.
Another important measure is known as the smoothness index (r). The parameter r gives the size of
the matrix and smaller r value gives the signal that is denoised to a greater extent, however, if the r
value is too small then too much of the signal is distorted. In the proposed method, 0.6070 is the value
of r that provides smoothness in spectra without losing the signal structure proposed in the method.
This value is also similar to that of GOWT 0.6422 and soft thresholding 0.5166 and far superior to hard
thresholding 0.8681. Last but not the least, the (SNR) calculate strength of the signal when compared
with the noise level. SNR is reported as the result and a higher value of this result implies improved
noise reduction. From the obtained results in terms of SNR the proposed method obtains 35.8188,
which is higher compared to hard thresholding 28.2976, soft thresholding 25.0662, and GOWT
27.1066, and hence showing the proposed method in improving on the signal clearness. Therefore,
the gradient descent neural network-based method records a better RMSE and r and higher SNR than
the other denoising styles recorded in Table 2. This points to the possibility of high efficiency of the
algorithm with the aim of ECG signal denoising.</p>
      <p>From Figure 2, we can see that indeed through the usage of various denoising techniques it is
possible to extract the ECG signal from the overall signal. For easier comparison, the original ECG
signal and all the outcomes of hard- and soft-thresholding, GOWT, as well as the results of the
proposed method are reviewed. From the denoised signals, one is able to compare the different
techniques, depending on how much noise was filtered out at the same time as filtering out relevant
features of ECG signal.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Discussion</title>
      <p>This study further shows that the use of neural network-based gradient descent method for denoising
ECG signals yields improved results compared to conventional methods. The used criteria of RMSE,
the smoothness index (r), and SNR also show the qualitative enhancement of the signal and the
reduction of noise, confirming the effectiveness of the proposed approach. The RMSE is a measure of
the amount of filtering distortion which is a very important factor. A lower RMSE will mean that the
processed signal, denoised signal will be nearer to the original signal and therefore minimizing
deformation. From the present scenario of RMSE 0.0031 proposed method is comparatively better
than the hard thresholding 14.5143, soft thresholding 25.0662, GOWT 19.9805 hence it is clear that
there is less distortion is introduced in the signal by the proposed method. Another important
measure is known as the smoothness index (r). The parameter r gives the size of the matrix and
smaller r value gives the signal that is denoised to a greater extent, however, if the r value is too small
then too much of the signal is distorted. In the proposed method, 0.6070 is the value of r that provides
smoothness in spectra without losing the signal structure proposed in the method. This value is also
similar to that of GOWT 0.6422 and soft thresholding 0.5166 and far superior to hard thresholding
0.8681. Last but not the least, (SNR) calculate the strength of the signal which compared with the
noise level. SNR is reported as the result and a higher value of this result implies improved noise
reduction. From the obtained results in terms of SNR the proposed method obtains 35.8188, which is
higher compared to hard thresholding 28.2976, soft thresholding 25.0662, and GOWT 27.1066, and
hence showing the effectiveness of the proposed method in improving on the signal clearness. One of
the main benefits of the proposed method is the possibility of its effective functioning in the presence
of different kinds of noise and signal distortions. The structure of the neural network enables it to
learn and apply it in case of various inputs which makes the method usable in many types ECG
signals. This flexibility coupled with good performance measurements depict the ‘derivation’ method
for its effectiveness in removal of noise from ECG. However, one drawback might be a large number
of parameters in the neural network structure, and demanding computations for the model’s training.
Further research might be focused on the idea of how to minimize the computational load which is
required for the method while preserving its efficiency. Thus, it might be useful to extend the set of
used ECG signals and noise conditions to improve the performance of the method in terms of
generalization. All in all, the gradient descent optimization for neural network enhances the ECG
signal denoising in comparison with traditional methods, as presented in terms of several
parameters. This capability to have a clean line of signal transfer and with minimal interference
improves the reading of ECG thus improving the chances of accurate diagnosis.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>In this research, we introduced a new gradient descent method for eliminating noise from the ECG
signals based on a proposed model, we compared the results with the hard thresholding, soft
thresholding and genetic optimize wavelet thresholding algorithms (GOWT). Our proposed method
significantly outperforms these conventional approaches, as evidenced by its superior performance
metrics: a remarkably low RMSE of 0.0031, an optimized smoothness index (r) of 0.6070, and a high
SNR of 35.8188. The design of the neural network including the capacity to vary the weight matrix
with the aid of the Gradient Descent Method enables high accuracy denoising of the ECG signal while
the signal features will remain distinct. This balance between noise reduction and signal integrity is
critical in medical diagnosis applications to ensure the denoised signals are more reliable and
applicable for diagnosis. The fact that our method is encumbered with few types of noise and various
changes in the signal strength also underlines the approach’s general versatility and its potential use
across multiple ECG datasets. However, care must be taken to note the computational process of
training of the neural network. Future work can also consider investigations on how the training
process can be brought to the most efficient form of computation while maintaining or enhancing the
performance. Therefore, we have proposed the neural network-based gradient descent approach that
put together represents a breakthrough in the area of ECG signals denoising. Its advantage includes
better performance, flexibility and prospects for enhancing diagnostics of diseases it makes this tool
relevant for clinicians and researchers. Such work opens the way for the development and further
research in more complex architectures of the neural networks for biomedical signal analysis.</p>
    </sec>
    <sec id="sec-6">
      <title>Declaration on Generative AI</title>
      <p>The authors have not employed any Generative AI tools.
ink data using t-SNE,” Forensic Sci. Int., vol. 311, p. 110194, Jun. 2020, doi:
10.1016/j.forsciint.2020.110194.
[19] M. Karthiga, V. Santhi, and S. Sountharrajan, “Hybrid optimized convolutional neural network
for efficient classification of ECG signals in healthcare monitoring,” Biomed. Signal Process.</p>
      <p>Control, vol. 76, p. 103731, Jul. 2022, doi: 10.1016/j.bspc.2022.103731.
[20] G. B. Moody and R. G. Mark, “The impact of the MIT-BIH Arrhythmia Database,” IEEE Eng. Med.</p>
      <p>Biol. Mag., vol. 20, no. 3, pp. 45–50, 2001, doi: 10.1109/51.932724.
[21] A. L. Goldberger et al., “PhysioBank, PhysioToolkit, and PhysioNet,” Circulation, vol. 101, no. 23,</p>
      <p>Jun. 2000, doi: 10.1161/01.CIR.101.23.e215.
[22] M. Sraitih and Y. Jabrane, “A denoising performance comparison based on ECG Signal
Decomposition and local means filtering,”Biomed. Signal Process. Control, vol. 69, p. 102903, Aug.
2021, doi: 10.1016/j.bspc.2021.102903.
[23] Cuiwei Li, Chongxun Zheng, and Changfeng Tai, “Detection of ECG characteristic points
using wavelet transforms,” IEEE Trans. Biomed. Eng., vol. 42, no. 1, pp. 21–28, 1995, doi:
10.1109/10.362922.
[24] J. S. Sahambi, S. N. Tandon, and R. K. P. Bhatt, “Using wavelet transforms for ECG
characterization. An on-line digital signal processing system,” IEEE Eng. Med. Biol. Mag., vol. 16,
no. 1, pp. 77–83, 1997, doi: 10.1109/51.566158.
[25] M. Khan, F. Aslam, T. Zaidi, and S. A. Khan, “Wavelet Based ECG Denoising Using
SignalNoise Residue Method,” in 2011 5th International Conference on Bioinformatics and Biomedical
Engineering, IEEE, May 2011, pp. 1–4. doi: 10.1109/icbbe.2011.5780263.
[26] X. Wang, Y. Zhou, M. Shu, Y. Wang, and A. Dong, “ECG Baseline Wander Correction and
Denoising Based on Sparsity,” IEEE Access, vol. 7, pp. 31573–31585, 2019, doi:
10.1109/ACCESS.2019.2902616.
[27] M. A. Awal, S. S. Mostafa, M. Ahmad, and M. A. Rashid, “An adaptive level dependent wavelet
thresholding for ECG denoising,” Biocybern. Biomed. Eng., vol. 34, no. 4, pp. 238–249, 2014, doi:
10.1016/j.bbe.2014.03.002.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Valentinuzzi</surname>
          </string-name>
          , “
          <article-title>Bioelectrical signal processing in cardiac and neurological applications and electromyography: physiology, engineering</article-title>
          , and noninvasive applications,” Biomed. Eng. Online, vol.
          <volume>6</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>27</fpage>
          ,
          <year>2007</year>
          , doi: 10.1186/
          <fpage>1475</fpage>
          -925X-
          <fpage>6</fpage>
          -27.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>I. Dotsinsky</surname>
          </string-name>
          , “
          <article-title>Review of 'Advanced Methods and Tools for ECG Data Analysis'</article-title>
          , by Gari D. Clifford, Francisco Azuaje and Patrick E. McSharry (Editors),
          <source>” Biomed. Eng. Online</source>
          , vol.
          <volume>6</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>18</fpage>
          ,
          <year>2007</year>
          , doi: 10.1186/
          <fpage>1475</fpage>
          -925X-
          <fpage>6</fpage>
          -18.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R. M.</given-names>
            <surname>Rangayyan</surname>
          </string-name>
          ,
          <article-title>Biomedical Signal Analysis</article-title>
          . IEEE,
          <year>2001</year>
          . doi:
          <volume>10</volume>
          .1109/9780470544204.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P. S.</given-names>
            <surname>Addison</surname>
          </string-name>
          , “
          <article-title>Wavelet transforms and the ECG: a review,” Physiol</article-title>
          . Meas., vol.
          <volume>26</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>R155</fpage>
          -
          <lpage>R199</lpage>
          , Oct.
          <year>2005</year>
          , doi: 10.1088/
          <fpage>0967</fpage>
          -3334/26/5/R01.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Donoho</surname>
          </string-name>
          and
          <string-name>
            <given-names>I. M.</given-names>
            <surname>Johnstone</surname>
          </string-name>
          , “
          <article-title>Ideal spatial adaptation by wavelet shrinkage</article-title>
          ,
          <source>” Biometrika</source>
          , vol.
          <volume>81</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>425</fpage>
          -
          <lpage>455</lpage>
          , Sep.
          <year>1994</year>
          , doi: 10.1093/biomet/81.3.425.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>N. E.</given-names>
            <surname>Huang</surname>
          </string-name>
          et al., “
          <article-title>The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis</article-title>
          ,
          <source>” Proc. R. Soc. London. Ser. A Math. Phys. Eng. Sci.</source>
          , vol.
          <volume>454</volume>
          , no.
          <year>1971</year>
          , pp.
          <fpage>903</fpage>
          -
          <lpage>995</lpage>
          , Mar.
          <year>1998</year>
          , doi: 10.1098/rspa.
          <year>1998</year>
          .
          <volume>0193</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Xia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Xiong</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Wang</surname>
          </string-name>
          , “
          <article-title>A transformer model blended with CNN and denoising autoencoder for inter-patient ECG arrhythmia classification</article-title>
          ,
          <source>” Biomed. Signal Process. Control</source>
          , vol.
          <volume>86</volume>
          , p.
          <fpage>105271</fpage>
          ,
          <string-name>
            <surname>Sep</surname>
          </string-name>
          .
          <year>2023</year>
          , doi: 10.1016/j.bspc.
          <year>2023</year>
          .
          <volume>105271</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P.</given-names>
            <surname>Bing</surname>
          </string-name>
          et al.,
          <article-title>“A novel approach for denoising electrocardiogram signals to detect cardiovascular diseases using an efficient hybrid scheme</article-title>
          ,
          <source>” Front. Cardiovasc. Med</source>
          ., vol.
          <volume>11</volume>
          ,
          <string-name>
            <surname>Apr</surname>
          </string-name>
          .
          <year>2024</year>
          , doi: 10.3389/fcvm.
          <year>2024</year>
          .
          <volume>1277123</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>S.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Fang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ren</surname>
          </string-name>
          , “
          <article-title>ECG autoencoder based on low-rank attention</article-title>
          ,
          <source>” Sci. Rep</source>
          ., vol.
          <volume>14</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>12823</fpage>
          ,
          <string-name>
            <surname>Jun</surname>
          </string-name>
          .
          <year>2024</year>
          , doi: 10.1038/s41598-024-63378-0.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>N. P.</given-names>
            <surname>Reddy</surname>
          </string-name>
          , “BOOK REVIEW:
          <article-title>Biomedical Signal Analysis: A Case-Study Approach</article-title>
          , by Rangaraja M. Rangayyan,” Ann. Biomed. Eng., vol.
          <volume>30</volume>
          , no.
          <issue>7</issue>
          , p.
          <fpage>983</fpage>
          ,
          <string-name>
            <surname>Jul</surname>
          </string-name>
          .
          <year>2002</year>
          , doi: 10.1114/1.1509766.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>N. V.</given-names>
            <surname>Thakor</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.-S.</given-names>
            <surname>Zhu</surname>
          </string-name>
          , “
          <article-title>Applications of adaptive filtering to ECG analysis: noise cancellation and arrhythmia detection,”</article-title>
          <source>IEEE Trans. Biomed</source>
          . Eng., vol.
          <volume>38</volume>
          , no.
          <issue>8</issue>
          , pp.
          <fpage>785</fpage>
          -
          <lpage>794</lpage>
          ,
          <year>1991</year>
          , doi: 10.1109/10.83591.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>U. R.</given-names>
            <surname>Acharya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Fujita</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. S.</given-names>
            <surname>Lih</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Hagiwara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Tan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Adam</surname>
          </string-name>
          , “
          <article-title>Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network,” Inf</article-title>
          . Sci. (Ny)., vol.
          <volume>405</volume>
          , pp.
          <fpage>81</fpage>
          -
          <lpage>90</lpage>
          , Sep.
          <year>2017</year>
          , doi: 10.1016/j.ins.
          <year>2017</year>
          .
          <volume>04</volume>
          .012.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Martinez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Almeida</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Olmos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. P.</given-names>
            <surname>Rocha</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Laguna</surname>
          </string-name>
          , “
          <article-title>A Wavelet-Based ECG Delineator: Evaluation on Standard Databases,”</article-title>
          <source>IEEE Trans. Biomed</source>
          . Eng., vol.
          <volume>51</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>570</fpage>
          -
          <lpage>581</lpage>
          , Apr.
          <year>2004</year>
          , doi: 10.1109/TBME.
          <year>2003</year>
          .
          <volume>821031</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>C. T. C. Arsene</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Hankins</surname>
            , and
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Yin</surname>
          </string-name>
          , “
          <article-title>Deep Learning Models for Denoising ECG Signals,”</article-title>
          <source>in 2019 27th European Signal Processing Conference (EUSIPCO)</source>
          , IEEE, Sep.
          <year>2019</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          . doi:
          <volume>10</volume>
          .23919/EUSIPCO.
          <year>2019</year>
          .
          <volume>8902833</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15] R. Lippmann, “Book Review:
          <article-title>'Neural Networks, A Comprehensive Foundation', by Simon Haykin,”</article-title>
          <string-name>
            <given-names>Int. J. Neural</given-names>
            <surname>Syst</surname>
          </string-name>
          ., vol.
          <volume>05</volume>
          , no.
          <issue>04</issue>
          , pp.
          <fpage>363</fpage>
          -
          <lpage>364</lpage>
          , Dec.
          <year>1994</year>
          , doi: 10.1142/S0129065794000372.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>H.</given-names>
            <surname>Lin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Liu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Liu</surname>
          </string-name>
          , “
          <source>ECG Signal Denoising Method Based on Disentangled Autoencoder,” Electronics</source>
          , vol.
          <volume>12</volume>
          , no.
          <issue>7</issue>
          , p.
          <fpage>1606</fpage>
          ,
          <string-name>
            <surname>Mar</surname>
          </string-name>
          .
          <year>2023</year>
          , doi: 10.3390/electronics12071606.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rasti-Meymandi</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Ghaffari</surname>
          </string-name>
          , “
          <article-title>A deep learning-based framework For ECG signal denoising based on stacked cardiac cycle tensor,”</article-title>
          <string-name>
            <given-names>Biomed. Signal</given-names>
            <surname>Process</surname>
          </string-name>
          .
          <source>Control</source>
          , vol.
          <volume>71</volume>
          , p.
          <fpage>103275</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2022</year>
          , doi: 10.1016/j.bspc.
          <year>2021</year>
          .
          <volume>103275</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>B. Melit</given-names>
            <surname>Devassy</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>George</surname>
          </string-name>
          , “
          <article-title>Dimensionality reduction and visualisation of hyperspectral</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>