<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Features of speech audio for deep learning accent recognition</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>University of KwaZulu-Natal</institution>
          ,
          <addr-line>Durban</addr-line>
          ,
          <country country="ZA">South Africa</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>1925</year>
      </pub-date>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>An accent is the distinctive way words are pronounced. Every speaker has an accent, which varies by gender, age, formality, social class, geographical region, and native language. Accents differ by voice quality, phoneme pronunciation, and prosody. Since it is difficult to extract these exact features, existing work used alternate features. These features were generally spectral features, which captured the frequency of speech. Such features included the MelFrequency Cepstral Coefficient (MFCC), Spectrogram, Chromagram, Spectral Centroid, and Spectral Roll-off, which were extracted from raw audio samples. However, it was not clear which features yielded the highest accuracy for an accent classification task. These five features were used to train a 2-layer CNN on a dataset of five distinct language-accents, namely, Arabic, English, French, Mandarin, and Spanish. The accuracy of each feature were evaluated and compared. The MFCC yielded the highest accuracy.</p>
      </abstract>
      <kwd-group>
        <kwd>Accent Recognition</kwd>
        <kwd>MFCC</kwd>
        <kwd>Chromagram</kwd>
        <kwd>Spectral Centroid</kwd>
        <kwd>Spectral Roll-off</kwd>
        <kwd>Spectrogram</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>and performs best with deep models [2]. A 2-layer CNN model was used to classify
accents and it achieved an accuracy rate of 77.9% [4]. A fusion of Spectral Centroid
features with MFCC features increased Qur’anic accent identification by 4% as
compared to using MFCC features alone [5].</p>
      <p>The Data was acquired from the Speech Accent Archive [6]. Five language-accents
were extracted from the Archive, namely English (627 samples), Spanish (220),
Mandarin (132), French (80), and Arabic (172). Speakers recited a standard paragraph.
One of the objectives was to identify an optimal segment length for the model to have
a more accurate classification. The original dataset was rendered to create 3 different
datasets, each of which had speakers reading for different lengths of time such as a
single isolated word (“Please”), three consecutive words (“Please call Stella.”) and
recitation of the paragraph. There were five features investigated, and three datasets,
yielding a total of fifteen different experiments. Each Feature was extracted from the
raw audio and served as input to a 2-layer CNN model which was used for the
classification task.
The MFCC feature was the best performing feature. Three consecutive word
utterances performed better than single word utterances or paragraph recitation. The three
consecutive word utterances were long enough for the CNN to extract a pattern in the
speech, but not too long that a complex pattern appeared, which is not generalizable,
as can be seen in the paragraph. English samples made up the majority of the dataset,
and was best classified. The MFCC only had 13 bands, and the Chromagram had 12
pitch scales. Therefore, the shallow CNN model was able to identify a pattern
between samples using those non-complex features. The Spectrogram is more complex
since it records overtones (timbre) and does so by representing lines above each other
along its y-axis. Therefore, a shallow model did not grasp a pattern between
Spectrograms as well. Although the Spectral Roll-off is not often used in Speech Processing,
it achieved the second highest accuracy. The Spectral Centroid, in comparison to the
other features’ accuracies, was relatively high, and the third best.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>K.</given-names>
            <surname>Chakraborty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Talele</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Upadhya</surname>
          </string-name>
          , “
          <article-title>Voice Recognition Using MFCC Algorithm,”</article-title>
          <source>International Journal of Innovative Research in Advanced Engineering</source>
          , vol.
          <volume>1</volume>
          , no.
          <issue>10</issue>
          , p.
          <fpage>4</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>Y.</given-names>
            <surname>Fan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Potok</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Shroba</surname>
          </string-name>
          , “Deep Learning for Audio,” University of Illinois at Urbana-Champaign, Department of Computer Science, Illinois,
          <source>Lecture Proceedings</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>K.</given-names>
            <surname>Chionh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Song</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Yin</surname>
          </string-name>
          , “
          <source>Application of Convolutional Neural Networks in Accent Identification,” Project Report</source>
          , Carnegie Mellon University, Pittsburgh, Pennsylvania,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>B.</given-names>
            <surname>Hassan</surname>
          </string-name>
          , “
          <article-title>Feature extraction using Spectral Centroid and Mel Frequency Cepstral Coefficient for Quranic Accent Automatic Identification</article-title>
          ,” in
          <source>2014 IEEE Student Conference on Research and Development</source>
          , Penang, Malaysia,
          <year>2014</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          George Mason University and
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Weinberger</surname>
          </string-name>
          , “Speech Accent Archive,”
          <year>2014</year>
          . [Online]. Available: http://accent.gmu.edu/.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>