<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>DEEP LEARNING FOR AUTOMATIC RF-MODULATION CLASSIFICATION</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>M. Dima</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>T. Dima</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Univ. of Bucharest</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bucharest</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Romania</string-name>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Maria Dima, Mihai-Tiberiu Dima</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <fpage>5</fpage>
      <lpage>9</lpage>
      <abstract>
        <p>Classical methods use statistical-moments to determine the type of modulation in question. This essentially correct approach for discerning amplitude modulation (AM) from frequency modulation (FM) fails for more demanding cases such as AM vs. AM-LSB (lower side-band rejection) - radio signals being richer in information than statistical moments. Parameters with good discriminating power were selected in a data conditioning phase and binary deep-learning classifiers were trained for AM-LSB vs. AM-USB, FM vs. AM, AM vs. AM-LSB, etc. The parameters were formed as features, from wave reconstruction primary parameters: rolling pedestal, amplitude, frequency and phase. Very encouraging results were obtained for AM-LSB vs. AM-USB with stochastic training, showing that this particularly difficult case (inaccessible with stochastic moments) is well solvable with multi-layer perceptron (MLP) neuromorphic software.</p>
      </abstract>
      <kwd-group>
        <kwd>RF modulation</kwd>
        <kwd>MLP neuromorphic software</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Signals Intell (SIGINT) is a branch of the military and civilian intell services monitoring
(mainly) the RF communications. Automated Modulation Classifiers (AMC’s) are of 2 types:
likelihood classifiers (LC’s) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and feature classifiers (FC’s) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. LC’s use a likelihood function on
the received signal, while FC’s neuromorphic software for feature extraction. LC methods have high
CPU demand and need prior information from transmitters. FC’s do not require this, however perform
relatively well. They consist of (i) feature extraction - parameters constructed from amplitude,
frequency, and phase distributions [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Features from advanced processing, such as Fourier (FFT) and
wavelet transforms [4], or high-order statistical cumulants [5] require longer signal samples and are
CPU intensive, for instance noise jammed signals can be analysed with the FFT of the cyclic
autocorrelation function [
        <xref ref-type="bibr" rid="ref4">6</xref>
        ] and decrypted. Secondly, (ii) classification – such as: linear, k-means [
        <xref ref-type="bibr" rid="ref5">7</xref>
        ],
clustering algorithms, neural software [
        <xref ref-type="bibr" rid="ref6">8</xref>
        ] and support vector machine (SVM) with kernels [
        <xref ref-type="bibr" rid="ref7">9</xref>
        ]. Typical
identification purities are 95% [
        <xref ref-type="bibr" rid="ref8">10</xref>
        ] (S/N of 0dB) for a variety of deep-learning methods, and 90% [
        <xref ref-type="bibr" rid="ref9">11</xref>
        ]
(S/N of -10dB). Existing methods assume equal signal-to-noise (S/N) in the training and witness sets.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Signal conditioning and feature creation</title>
      <p>Before attempting to constitute any particular feature quantities, it is important to foresee how
the procedure would be immune to noise and jamming. The best approach is to base the features on
physially understood quantities, thus the reconstruction of the fundamental wave:
where f, p, A are slowly varying</p>
      <p>Pedestal reconstruction
perform the wave average between ti and tf:
functions of time.
- for this the simplest method is to
where sinc(x) = sin(x) / x and Ae = Asinc(f) – with  the duration of one sample. Since the sin term
does not vanish, we try to zero the sinc term. For tf-ti = n, the n  m/f, condition must be met, with
m  N. Basically m is scanned until the relation gives a close-enough integer (in our case n = 11)
and then p = u.</p>
      <p>Amplitude reconstruction – following the same idea, we designed a similar formula for the
amplitude:
Through a coincidence the “magic number” n for double the frequency is very similar to n = 11 from
pedestal determination and we can use the same loop for the averages.</p>
      <p>Frequency reconstruction - similar to amplitude, we determined frequency with an OII dipolar
moment, which basically differentiates the sine wave:
where k indexes u(t-k). We used k=1.</p>
      <p>Phase reconstruction – similar to frequency we determined phase with an OII dipolar moment
taking reference to a fixed phase sine:
where for  = 0 the error may be significant, however phase is not absolute, rather relative to the
previous sample’s phase, as such such errors tend to systematically cancel out.</p>
      <p>Feature creation – having pedestal, amplitude, frequency and phase for each sample, we
accumulated these quantities in histograms looking for discriminating features. We devised similar
other parameters (in number of 12) to capture the differences between various modulation types. As an
example, the figure above shows the distribution of the full width at ¼ maximum for the phase
distribution histograms - with red, again, AM modulation and with blue, FM modulation.</p>
    </sec>
    <sec id="sec-3">
      <title>2. Deep-learning performance and conclusions</title>
      <p>Using this set of 12 parameters we trained (with BFGS – Broyden-Fletcher-Goldfarb-Shanno
algorithm for AM vs. FM, or stochastic for AM-LSB vs. AM-USB) deep learning neural networks for
binary sets of modulations.</p>
      <p>The results were excellent for instance AM vs. FM, and the most difficult case (and notable
result too) was AM-LSB vs. AM-USB which are essentially the same type of modulation, and is
known to be practically impossible to discern with the classical statistical-moments method. The
figure below shows this result.</p>
      <p>Concluding, our deep learning neuromorphic software approach to AMC’s confirms the
promising results of a pleiad of other such approaches. What distinguishes our approach is a 2 step
feature creation method. The first step reconstructs the basic signal parameters, pedestal, amplitude,
frequency and phase and creates histograms with 1000 such samples (each n=11, “magic number”
samples long). The second step analyses these histograms and draws parameters out of them. We
found these parameters to be much better performing than the primary raw parameters.</p>
      <p>As showcase for this conclusion stands the difficult case of discriminating AM-LSB vs.
AMUSB modulation, which flags the correct modulation in 95% of cases.
[4] J. Liu, Q. Luo, A novel modulation classification algorithm based on daubechies5 wavelet and
fractional fourier transform in cognitive radio, 14th IEEE ICCT Communication Technology
Conference, document/6511199, pp. 115–120, (2012); Y. Lv, Y. Liu, F. Liu, J. Gao, K. Liu, G. Xie,
Automatic modulation recognition of digital signals using CWT based on optimal scales, IEEE
Conference On Computer and Information Technology, document/6984692, pp. 430–434, (2014).
[5] D. Das, A. Anand, P. K. Bora, R. Bhattacharjee, Cumulant based automatic modulation
classification of QPSK, OQPSK, π/4-QPSK and 8-PSK in MIMO environment, IEEE Conference On
Signal Processing and Communications, document/7439996, pp. 1–5, (2016); A. Hazza, M. Shoaib, A.
Saleh, A. Fahd, Robustness of digitally modulated signal features against variation in HF noise model,
EURASIP J. Wirel. Commun. Netw. 2011, 24, (2011).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J.L.</given-names>
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Su</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <article-title>Likelihood-Ratio Approaches to Automatic Modulation Classification</article-title>
          ,
          <source>IEEE Trans. Syst. Man Cybernet. Part C Appl. Rev</source>
          .
          <volume>41</volume>
          ,
          <fpage>455</fpage>
          -
          <lpage>469</lpage>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hazza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Shoaib</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Alshebeili</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fahad</surname>
          </string-name>
          ,
          <article-title>An overview of feature-based methods for digital modulation classification</article-title>
          ,
          <source>Communications, Signal Processing, and their Applications</source>
          ,
          <source>ICCSPA 1st International Conference IEEE, document 6487244</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          , (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>EE.</given-names>
            <surname>Azzouz</surname>
          </string-name>
          , AK. Nandi,
          <article-title>Automatic identification of digital modulation types</article-title>
          ,
          <source>Signal Process</source>
          .
          <volume>47</volume>
          ,
          <fpage>55</fpage>
          -
          <lpage>69</lpage>
          (
          <year>1995</year>
          )
          <article-title>; JJ</article-title>
          .
          <string-name>
            <surname>Popoola</surname>
            ,
            <given-names>R. van Olst</given-names>
          </string-name>
          ,
          <article-title>A novel modulation sensing method</article-title>
          ,
          <source>IEEE Veh. Tech. Mag. 6</source>
          , pp.
          <fpage>60</fpage>
          -
          <lpage>69</lpage>
          , (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>U.</given-names>
            <surname>Satija</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Manikandan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ramkumar</surname>
          </string-name>
          ,
          <article-title>Performance study of cyclostationary based digital modulation classification schemes</article-title>
          ,
          <source>IEEE Conference on Industrial and Information Systems, document/7036609</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          , (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M. W.</given-names>
            <surname>Aslam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. K.</given-names>
            <surname>Nandi</surname>
          </string-name>
          ,
          <article-title>Automatic modulation classification using combination of genetic programming and KNN</article-title>
          ,
          <source>IEEE Trans. Wirel. Commun</source>
          .
          <volume>11</volume>
          ,
          <fpage>2742</fpage>
          -
          <lpage>2750</lpage>
          , (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>K.</given-names>
            <surname>Hassan</surname>
          </string-name>
          , I. Dayoub,
          <string-name>
            <given-names>W.</given-names>
            <surname>Hamouda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Berbineau</surname>
          </string-name>
          ,
          <article-title>Automatic modulation recognition using wavelet transform and neural network</article-title>
          ,
          <source>IEEE Conference on Intelligent Transport Systems Telecommunications, document/5399351</source>
          , pp.
          <fpage>234</fpage>
          -
          <lpage>238</lpage>
          , (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>V.</given-names>
            <surname>Orlic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dukic</surname>
          </string-name>
          ,
          <article-title>Multipath channel estimation algorithm for automatic modulation classification using sixth-order cumulants, Electron</article-title>
          . Lett.
          <volume>46</volume>
          ,
          <fpage>1348</fpage>
          -
          <lpage>1349</lpage>
          , (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [10]
          <string-name>
            <surname>GJ. Mendis</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Wei</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Madanayake</surname>
          </string-name>
          ,
          <article-title>Deep learning-based automated modulation classification for cognitive radio</article-title>
          ,
          <source>IEEE Conference on Communication Systems, document/7833571</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          , (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Dai</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , H. Sun,
          <article-title>Automatic modulation classification using stacked sparse autoencoders</article-title>
          ,
          <source>IEEE Conference on Signal Processing, document/7877834</source>
          , pp.
          <fpage>248</fpage>
          -
          <lpage>252</lpage>
          , (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>