<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>NARX NEUROMORPHIC SOFTWARE FOR ECG WAVE PREDICTION</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>T. Dima</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>S. Pitina</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Univ. of Bucharest</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bucharest</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Romania</string-name>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Mihai-Tiberiu Dima, Svetlana Pitina</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <fpage>5</fpage>
      <lpage>9</lpage>
      <abstract>
        <p>ECG wave prediction with non-linear autoregressive exogenous neuromorphic (NARX) software is a novel method aimed at Holter monitoring and early warning. Such predictions are important in comparing the underlying QRS complex of the ECG-wave with the slowly deteriorating waves (or arrythmia) in cardiac patients. A deep Q-wave for instance (such as 1/4 of the R-wave) is a typical sign of (inferior wall) myocardial necrosis - associated in most cases with vascular dysfunction. It is important to have a rolling predictor - slow ECG wave degradation being normal. A real-time predictor takes into account a suite of influencing parameters (body temperature, effort, current medication, sugar levels, stress, etc), being much better suited in making a call for "normal" vs. "anomalous" ECG waves, rather than some outdated reference waves. Although this research is in its begining, it shows encouraging results, which clinical studies can conclude as to how effective the approach may be.</p>
      </abstract>
      <kwd-group>
        <kwd>ECG</kwd>
        <kwd>NARX neuromorphic software</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Increasingly, over the past two decades, new electronics [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and neuromorphic data processing
solutions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] have become part of standard ECG signal processing. This was made possible by the
portation of ECG wave databases – such as [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ], in digital format.
      </p>
      <p>
        The introduction of artificial intelligence in clinical practice makes it possible to automate
analysis and reveal, hidden or non-obvious patterns [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Whereas cardiologists can only build up experience on waveform printout, neural networks
can make correlations in high dimensionality spaces and can measure features that are beyond the
resolution of the human eye.</p>
      <p>
        Currently, methods are being developed using artificial intelligence for the diagnosis of
arrhythmias (using Holter monitoring data), myocardial infarction and left ventricular systolic
dysfunction [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7, 8</xref>
        ].
      </p>
      <p>As a result of fast and accurate diagnosis and choice of therapy, treatment will become in the
years to come more effective, convenient and personalized.</p>
      <p>
        Neuromorphic software is a learning algorithm inspired from biological neurons, consisting of
a set of connected S-threshold units, or artificial neurons. A neuron receives a set of signals from
previous neurons, takes the sum and enters it into a threshold function (such as arctan). This is
essentially the McCulloch-Pitts neuron [
        <xref ref-type="bibr" rid="ref8">9</xref>
        ] of 1943. Versions thereof fine tune the slope of the
threshold function and the offset. The biggest improvements thereafter were two fold: on one hand
higher computational speeds owing to hardware progress and on the other more performant optimiser
algorithms which determine the weights of the inter-neuron links - a well performing example thereof
being the Nelder-Mead optimiser [
        <xref ref-type="bibr" rid="ref9">10</xref>
        ].
      </p>
      <p>
        Present day neural software, with layered neuron design, was first investigated by Ivakhnenko
and Grigorevich [
        <xref ref-type="bibr" rid="ref10">11</xref>
        ] at CCM Information Corporation. A good review on the subject is by
Schmidhuber [
        <xref ref-type="bibr" rid="ref11">12</xref>
        ] and developments on the training of neural software is given in [
        <xref ref-type="bibr" rid="ref12">13</xref>
        ].
      </p>
      <p>
        Nonlinear autoregressive exogenous [
        <xref ref-type="bibr" rid="ref13">14</xref>
        ] models are a class of artificial neural networks
graphed along a temporal sequence, allowing them to exhibit temporal dynamic behavior. They derive
from feed-forward neural networks and use internal buffers to predict the outcome desired.
      </p>
      <p>The networks come as finite impulse recurrent networks (as directed acyclic graphs unfoldable
into a traditional feed-forward neural network) and infinite impulse networks (in which the graph
cannot be unfolded).</p>
      <p>The weights of the network increase or decrease during the training of the network and
neurons have a threshold such that a signal is sent only if the sum of signals crosses the threshold.</p>
      <p>Typically, neurons are aggregated into layers, with different layers performing different
classes of transformations on the inputs. Signals travel from the first layer (the input layer), to the final
layer (the output layer).</p>
      <p>A schematic example of a NARX cell is shown in figure 1, the network trained to learn a
repetitive sequence (such as the Fibonacci numbers for instance), but also to learn to respond to
nonendogenous stimuli, that change in time (such as the case of ECG waveforms).</p>
    </sec>
    <sec id="sec-2">
      <title>2. Savitzky-Golay filter</title>
      <p>To overcome unwanted artefacts in the ECG waveform, we need first a smooth, analytical
version of the waveform – impossible in general, but achievable locally, piece-wise connected with
smooth boundary conditions.</p>
      <p>Further more, we can relax to a small extent the smooth boundary conditions and replace this
with an almost-smooth function that we obtain from a Savitzky-Golay filter on  k bins around the
current bin. For this we used a OIII spline function with coefficients C, A, D, Y to optimise the position
of the current bin:
where xi are the time bins and yi the ECG waveform amplitude at bin-i. We take the derivatives with
respect to the 4 parameters and find the solution.</p>
      <p>The coefficient Y will give the position of the current bin. The number of bins we
determined such as to keep waveform flexibility, while at the same time eliminate noise – k = 5. The
result of the filter on a section of ECG wave is shown in figure 2.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Performance of the NARX software</title>
      <p>
        We used the NARXsim package [
        <xref ref-type="bibr" rid="ref15">16</xref>
        ] from them Facultat d’Informàtica de Barcelona
Universitat Polytecnica de Catalunya.
      </p>
      <p>The learning patterns were offseted a time elapse t = -5 s, the amount of time in advance that
we want to predict the ECG-waveform.</p>
      <p>The exogenous parameters are the 4 coefficients of the Savitzky-Golay filter, plus the residual
noise difference Y-yi.</p>
      <p>
        We trained the network on a wave 300 s long from CARDIODAT [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>It can be noticed still that the software has a latency in the prediction upon encountering a rise
in signal. We are currently investigating to what cause this is due, and how to address this issue. The
QRS complex of the ECG-wave is for the rest well recovered, which is marked interest for Q-wave
parameter-integrity. The reconstruction of the Q-wave is very important, because the appearance of a
deep Q-wave (such as 1/4 of the R-wave) is a typical sign of myocardial necrosis – associated in most
cases with vascular dysfunction.</p>
      <p>
        Our ability to predict “steady-state” ECG wave can be compared by the Holter with actual
measurement and signal “unexpected wave degradation”. This is valuable in classifying myocardial
infarction and early warning. Clear signal expression, in the case of multi-lead ECG recordings, allows
the localization [
        <xref ref-type="bibr" rid="ref14">15</xref>
        ] of the necrosis focus.
      </p>
      <p>Concluding, our NARX-software shows very promising prospects in variable aforetime
prediction of ECG waves. This is particularly valuable for Holter devices, in comparing “steady state”
predicted rhythm to actual measurement and signaling “unexpected wave degradation”. This impacts
patient management tactics, offering precious advance warning. In this respect our NARX-software
performance - and subsequent improvements expected, is an important contribution.
[8] D. Adedinsewo, R.E. Carter, Z. Attia, P. Johnson, A.H. Kashou, J.L. Dugan, M. Albus, J.M.
Sheele, F. Bellolio, P.A. Friedman, F. Lopez-Jimenez, P.A. Noseworthy, Artificial
IntelligenceEnabled ECG Algorithm to Identify Patients With Left Ventricular Systolic Dysfunction Presenting to
the Emergency Department With Dyspnea, Circ Arrhythm Electrophysiol. 13 (2020).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.K.</given-names>
            <surname>Jain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Bhaumik</surname>
          </string-name>
          ,
          <article-title>An Energy efficient application specific integrated circuit for electrocardiogram feature detection and its potential for ambulatory cardiovascular disease detection</article-title>
          ,
          <source>Healthcare Technology Letters 3</source>
          , pp.
          <fpage>77</fpage>
          -
          <lpage>84</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.H.</given-names>
            <surname>Ribeiro</surname>
          </string-name>
          et al.,
          <article-title>Automatic diagnosis of the 12-lead ECG using a deep neural network</article-title>
          ,
          <source>Nature Communications 11</source>
          , article #
          <volume>1760</volume>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>H.</given-names>
            <surname>Moeinzadeh</surname>
          </string-name>
          , G. Gargiulo,
          <source>Wilson Central Terminal ECG Database (v1.0.1)</source>
          ,
          <source>PhysioNet</source>
          (
          <year>2019</year>
          ): https://doi.org/10.13026/f73z-an96.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>R.</given-names>
            <surname>Bousseljot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kreiseler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schnabel</surname>
          </string-name>
          ,
          <article-title>Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet</article-title>
          ,
          <source>Biomedizinische Technik, Band</source>
          <volume>40</volume>
          , Ergänzungsband 1,
          <string-name>
            <surname>S 317</surname>
          </string-name>
          (
          <year>1995</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>K.W.</given-names>
            <surname>Johnson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. Torres</given-names>
            <surname>Soto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.S.</given-names>
            <surname>Glicksberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Shameer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Miotto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ali</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Ashley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.T.</given-names>
            <surname>Dudley</surname>
          </string-name>
          , Artificial Intelligence in Cardiology,
          <source>J Am Coll Cardiol</source>
          .
          <volume>71</volume>
          (
          <issue>23</issue>
          ),
          <fpage>2668</fpage>
          -
          <lpage>2679</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Taniguchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Takata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Takechi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Furukawa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Iwasawa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kawamura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Taniguchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Tamura</surname>
          </string-name>
          ,
          <article-title>Explainable Artificial Intelligence Model for Diagnosis of Atrial Fibrillation Using Holter Electrocardiogram Waveforms</article-title>
          ,
          <source>Int Heart J</source>
          .
          <volume>62</volume>
          (
          <issue>3</issue>
          ),
          <fpage>534</fpage>
          -
          <lpage>539</lpage>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Cho</surname>
          </string-name>
          , et al.,
          <article-title>Artificial intelligence algorithm for detecting myocardial infarction using six-lead electrocardiography</article-title>
          .
          <source>Sci. Rep</source>
          .
          <volume>10</volume>
          ,
          <issue>20495</issue>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>W.</given-names>
            <surname>McCulloch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Pitts</surname>
          </string-name>
          ,
          <article-title>A Logical Calculus of Ideas Immanent in Nervous Activity</article-title>
          ,
          <source>Bulletin of Mathematical Biophysics</source>
          <volume>5</volume>
          ,
          <fpage>115</fpage>
          -
          <lpage>133</lpage>
          (
          <year>1943</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Nelder</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Mead</surname>
          </string-name>
          ,
          <article-title>A simplex method for function minimization</article-title>
          ,
          <source>Computer Journal 7</source>
          ,
          <fpage>308</fpage>
          -
          <lpage>313</lpage>
          (
          <year>1965</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.G.</given-names>
            <surname>Ivakhnenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.V.</given-names>
            <surname>Grigorevich</surname>
          </string-name>
          , Cybernetics and forecasting techniques, American Elsevier (
          <year>1967</year>
          )
          <article-title>; A.G. Ivakhnenko, Cybernetic Predicting Devices, CCM Information Corporation (</article-title>
          <year>1973</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>J.</given-names>
            <surname>Schmidhuber</surname>
          </string-name>
          ,
          <source>Deep Learning in Neural Networks: An Overview, Neural Networks</source>
          <volume>61</volume>
          ,
          <fpage>85</fpage>
          -
          <lpage>117</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Xiao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schoenholz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Bahri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Novak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Sohl-Dickstein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Pennington</surname>
          </string-name>
          ,
          <article-title>Wide neural networks of any depth evolve as linear models under gradient descent</article-title>
          ,
          <source>J. Stat. Mech. Theor. and Experiment</source>
          .
          <volume>12</volume>
          ,
          <issue>124002</issue>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>H.T.</given-names>
            <surname>Siegelmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.G.</given-names>
            <surname>Horne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.L.</given-names>
            <surname>Giles</surname>
          </string-name>
          ,
          <article-title>Computational Capabilities of Recurrent NARX Neural Networks</article-title>
          ,
          <source>IEEE Transactions on Systems, Man and Cybernetics</source>
          ,
          <string-name>
            <surname>Part</surname>
            <given-names>B</given-names>
          </string-name>
          (
          <year>Cybernetics</year>
          )
          <volume>27</volume>
          ,
          <fpage>208</fpage>
          -
          <lpage>15</lpage>
          (
          <year>1995</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>R.K.</given-names>
            <surname>Tripathy</surname>
          </string-name>
          , et al.,
          <article-title>Localization of Myocardial Infarction From Multi-Lead ECG Signals Using Multiscale Analysis and Convolutional Neural Network</article-title>
          ,
          <source>IEEE Sensors Journal</source>
          <volume>19</volume>
          ,
          <fpage>11437</fpage>
          -
          <lpage>11448</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [16]
          <article-title>NARXSim neuromorphic package</article-title>
          , Facultat
          <string-name>
            <surname>d'Informàtica de Barcelona - Universitat Polytecnica de Catalunya</surname>
          </string-name>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>