<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Exploring a Perceptually-weighted DNN-based Fusion Model for Speech Separation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alessandro Ragano</string-name>
          <email>alessandro.ragano@ucdconnect.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrew Hines</string-name>
          <email>andrew.hines@ucd.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Insight Centre for Data Analytics, University College Dublin</institution>
          ,
          <country country="IE">Ireland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Deep Neural Network (DNN)-based fusion approaches for single-channel speech separation have recently been introduced but the non uniform perceptual weighting of the human auditory system has not been exploited during the DNN training phase. In addition, the perceived quality of the speech signal has not been assessed using a DNN-based fusion model. We propose a new perceptually-weighted DNN-based fusion model which employs a perceptual cost function and assess the perceived quality of several DNN-based fusion models. Objective and subjective evaluations for speech quality are compared. The results show that the perceptually-weighted DNN-based fusion model displays a signi cant improvement in terms of Source To Interferences Ratio (SIR) compared to a combined mask. However subjective quality assessment listening tests suggests that the proposed DNN-based fusion model does not result in improved perceived speech quality.</p>
      </abstract>
      <kwd-group>
        <kwd>Deep Neural Networks</kwd>
        <kwd>Perceptual Audio Quality</kwd>
        <kwd>Speech Separation</kwd>
        <kwd>Fusion</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Speech separation consists of extracting the speech signal from a mixture signal
that contains one or more audio sources. Ideally, the estimated speech signal
should be una ected as much as possible, i.e., without the presence of other
sources and without any distortion. The speech separation problem is more
complicated when only one channel is provided, i.e., the single-channel scenario. In
this paper we propose a Deep Neural Network (DNN)-based fusion method which
considers the perceptual importance of each frequency band of the speech signal
during the training.</p>
      <p>
        Within the research community, several models have been proposed in
order to solve the single-channel speech separation problem. Independent
Component Analysis (ICA) has been proposed in [
        <xref ref-type="bibr" rid="ref10 ref12">12, 10</xref>
        ], where the inherent time
structure of audio sources is encoded in the ICA basis functions. Other
approaches usually work in the time/frequency domain, where scaling matrices
called time/frequency masks are estimated and applied to the mixture in order
to extract sources. Rowes proposed the factorial Hidden Markov Models (HMM)
in [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], while approaches based on the Non-Negative Matrix Factorization (NMF)
are described in [
        <xref ref-type="bibr" rid="ref19 ref20 ref21 ref23">23, 19, 21, 20</xref>
        ] where the mixture magnitude spectrogram is
factorized in two matrices. Recently, approaches based on Deep Learning [
        <xref ref-type="bibr" rid="ref7 ref9">7,
9</xref>
        ] have been shown to exhibit better performances than the previous methods
establishing the current state-of-the-art performance in single-channel speech
enhancement. Even though the existing approaches achieve good performances,
the speech separation problem remains far from being solved as the estimated
speech signal is usually a ected by distortions and background interference. One
typical limitation that occurs in speech separation methods concerns robustness,
i.e., the achievement of high performance under limited and speci c conditions
of the mixture. When conditions deviate, separation performance decreases. For
example, some time/frequency masks have been shown to be successful for
stereophonic scenarios [
        <xref ref-type="bibr" rid="ref1 ref19 ref3">1, 19, 3</xref>
        ] by exploiting some characteristics of the mix (e.g., the
speech signal is typically located in the center channel) but they could fail in
the mono channel scenario. In order to overcome this limitations, fusion
methods have been recently introduced. They involve combining various estimated
time/frequency masks for covering several signal aspects that typically occur
in real applications. They have been shown to be successful in classi cation
tasks [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] and have been applied to audio source separation problems. A fusion
framework for underdetermined audio source separation that employs fusion
rules inspired by classi cation is described in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Compared to [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], signi cant
improvements have been found in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] where the authors proposed three
alternative fusion methods based on standard nonlinear optimization, Bayesian model
averaging and DNN. The DNN approach was favoured and has been widely
explored in [
        <xref ref-type="bibr" rid="ref4 ref5 ref6">6, 4, 5</xref>
        ]. Although fusion methods have been shown to be successful,
they did not account for the perceived quality of the extracted sources.
Existing fusion methods assessed the amount of distortion and interference using the
Blind Audio Source Separation (BASS) performance measurements [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] that
although they perform well, they do not account for perceptual aspects [
        <xref ref-type="bibr" rid="ref15 ref2">15, 2</xref>
        ].
Regarding the perceived quality of the speech signals, perceptually weighted
DNN have recently gained interest [
        <xref ref-type="bibr" rid="ref18 ref25">18, 25</xref>
        ]. As yet, to the authors' knowledge,
no perception-based cost function has been explored with a DNN-based fusion
model. In this paper we propose a new DNN-based fusion model that employs
a perceptually-weighted cost function which is partly derived from [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and we
also explore how fusion of speech separation time/frequency masks using a DNN
a ects the perceived quality.
      </p>
      <p>The paper is structured as follows: Section 2 gives a formulation of the BASS
problem in the time/frequency domain. Section 3 presents the proposed
DNNbased fusion architecture and Section 4 describes the DNN training and the
perceptually-weighted cost function. Section 5 shows the experimental results:
how the speech signal is subjectively perceived, and the results obtained from
the BASS performance measurements. Conclusions are o ered in Section 6.</p>
    </sec>
    <sec id="sec-2">
      <title>Formulation of the Audio Source Separation Problem in the Time/Frequency Domain</title>
      <p>In this paper we limit our scope to BASS problems as we only make use of the
mixture signal and some a priori statistics of the source signals. In addition,
instead of using a convolutive system, we model the channel signal as a linear
combination of the source signals as we neglect the presence of environment
reverberation. Let us consider X(k; f ), S1(k; f ) and S2(k; f ) as the Short Time
Fourier Transform (STFT) of the mixture x(n) = s1(n) + s2(n), the speech
signal s1(n) and the background signal s2(n) respectively. Due to the sparsity
characteristics of the sources in the time/frequency domain, the mixture
magnitude spectrogram jX(k; f )j almost preserves the linear mixing conditions and
we can approximate the single channel as follows:</p>
      <p>jX(k; f )j jS1(k; f )j + jS2(k; f )j:
Methods that work in the STFT domain usually estimate a spectral weighting
matrix M that assigns a value for each time/frequency element of the mixture
spectrogram. More speci cally we want to produce 2 masks that applied on the
mixture spectrogram gives us the estimation of the magnitude source
spectrograms Z1(k; f ) and Z2(k; f ):</p>
      <p>Z1(k; f ) = M (k; f )
Z2(k; f ) = (1</p>
      <p>M (k; f ))
jX(k; f )j
jX(k; f )j:
This operation, called time/frequency weighting, discriminates the frequency
bins between the sources. In the next section we see how to combine four
time/frequency masks to overcome the limitations of using a mask individually.
3</p>
    </sec>
    <sec id="sec-3">
      <title>DNN Fusion Architecture</title>
      <p>The proposed method is based on using a Feedforward Neural Network (FNN)
in order to achieve the combination of time/frequency masks that are
characterised by di erent properties. More speci cally, we analyse two DNNs trained
with di erent features and the same cost function, i.e., the Mean Squared Error
(MSE) and we propose one DNN which employs a new perceptually-weighted
cost function.</p>
      <p>
        The block diagram fusion model architecture is shown in Figure 1 where four
time/frequency masks are combined and the single channel scenario was studied.
The architecture is partially inspired from [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Every speech separation algorithm produces two masks, one for the speech
signal and one for the background signal. Since we combine two algorithms, we
deal with the fusion of four masks. From the mixture signal an STFT with Hann
window and 2048 points is computed. It has been shown that source
separation in the time/frequency domain can be estimated only with the magnitude
(1)
(2)
(3)
spectrogram by discarding the phase which is useful for the time-domain
reconstruction. Next, the Hadamard product between the STFT of the mixture
and each mask is used to compute two time/frequency representations for each
source. The FNN input is the concatenation of four estimated magnitude
spectrograms, where two of them account for the speech signal while the others
represent the background signal. Generally, fusion of source separation methods
can be conducted by combining di erent kinds of information such as masks or
separate magnitude spectrograms produced by masks themselves. However, in
this scenario, we combined the separated magnitude spectrograms as in early
experiments we observed better results combining magnitude spectrograms when
compared to masks combinations.</p>
      <p>The DNN takes the combined magnitude spectrograms as input features and
produces new estimated magnitude spectrograms of both speech and background
signal. The sources are then combined in order to reconstruct a mask as follows:
M1dnn(k; f ) =</p>
      <p>Z1(k; f )2</p>
      <p>Z1(k; f )2 + Z2(k; f )2
M2dnn(k; f ) = 1</p>
      <p>M1dnn(k; f ):
(4)
(5)</p>
      <p>We reconstruct a mask instead of using the output of the FNN as we chose
to apply a musical-noise suppression lter which has been developed for masks
and not for magnitude spectrograms. Each mask is used to scale the mixture
(6)
(7)
input X(k; f ) in order to estimate the STFT of the two sources:
Z1(k; f ) = M1dnn(k; f )
Z2(k; f ) = M2dnn(k; f )</p>
      <p>
        X(k; f )
X(k; f ):
Finally the two sources are reconstructed in the time domain using an Inverse
Short Time Fourier Transform (ISTFT) and reapplying the phase of the
original mixture. The described architecture can be imagined with more separation
algorithms and it is easily extendable for a generic number of speech separators.
However extending the architecture necessitates a network modi cation in terms
of number of nodes and network hyperparameters. A key issue of the proposed
model concerns the FNN outputs. The FNN can be trained in order to learn how
to predict masks or magnitude spectrograms. Predicting masks facilitates easier
training as the FNN learns values in a bounded range [
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ], while the prediction
of magnitude spectrograms requires unlimited non negative range. Nevertheless
we chose to predict magnitude spectrograms as they are less sensitive to the SNR
variations of training data with respect to mask prediction. Thus, as shown in
[
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] we can employ a training dataset with signi cant SNR variations in the
mixtures.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>DNN training</title>
      <p>The employed training dataset contains 250 audio mixes of speech and
background signal which repeat themselves with di erent combinations. We split the
dataset in two parts: 80% of time frames were assigned to the training data and
the remaining 20% was used for validation. All the time frames have been
shufed using a xed random seed in order to compare all the models. The mixtures
are constructed with di erent SNR in order to have high variability and accurate
reproducibility of real mix scenarios. The SNRs chosen are: 3 dB, 6 dB, 9 dB, 12
dB, 15 dB, 18 dB. The speech signals have been recorded in di erent languages.</p>
      <p>
        In all the models we perform a z-score standardization such that the
magnitudes of the frequency bins have the properties of a standard normal distribution
with zero mean and unit variance. This pre-processing guarantees that the
update of the weights is not biased by particular directions [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The DNN has
4100 node for each hidden layer with 2 hidden layers and 2050 nodes in the
output layer. This is due to the fact that we compute a 2048 point STFT and
each estimated magnitude spectrogram has 1025 frequency bins. The activation
function in the hidden layer is the hyperbolic tangent. The output layer contains
the concatenation of the estimated speech and the estimated background and
has Recti ed Linear Unit (ReLU) as activation function since we want to predict
magnitude spectrograms. The choice of the parameters and the network
architecture were partly taken from [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. In order to prevent over tting we used the
early stopping technique which suggests that no over tting occurred during the
training. The early stopping has been preferred to the cross-validation because
of the computational cost of the latter method [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <sec id="sec-4-1">
        <title>Reduced Resolution Magnitude Spectrograms</title>
        <p>In order to deal with a manageable feature set, we propose to use a reduced
resolution of the magnitude spectrograms which exploits the perceptual mel scale.
The mel scale sets the relationship between the perceived frequency of a pure
tone respect to its actual measured frequency. Humans discern frequencies
differently depending on the frequency range: small changes in the low frequency
range are discerned better than the high frequency range. In order to compute
the mel spectrogram we applied mel-spaced rectangular lter banks to each time
frame obtaining a reduced resolution of each frame. The reduced resolution
allows the combination of a greater number of speech separation algorithms and
reduces the training time. However, doing this operation with linearly spaced
lter banks would have not been bene cial since it does not re ect the human
hearing resolution. On the other hand, mel-spaced lter banks reduce the
number of frequency bins while maintaining the speech quality. Unlike a typical
conversion with 40 lters we used 192 lters keeping the signal quality while
maintaining su cient frequency information to train the network. Both MSE
models have been trained with batch size of 256 and learning rate equal to 0.01.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Modi ed Distortion To Signal Ratio</title>
        <p>
          We propose a fusion model which employs a Modi ed Distortion To Signal
Ratio (MDSR) as a cost function. The MSE gives the same importance to each
frequency bin that is involved in the error. It computes the energy of the error
without taking into account that some frequency bands are perceptually more
important than others. The MDSR instead, takes into account the perceived
audio quality of blindly separated audio signals and it is mainly derived from
the Distortion To Signal Ratio (DSR) called DSX in [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ].
        </p>
        <p>Given a time frame, the DSX is formulated as:</p>
        <p>I L</p>
        <p>P P
DSX(k)seg;sj = i=1 l=1</p>
        <p>EEtearrrgoert;;jj((kk;;ll;;ii)) w(k; l; i)
I L
P P w(k; l; i)
i=1 l=1
:
(8)</p>
        <p>
          The ratio between the energy error and the energy target can be seen as a
classic DSR except that it is computed in the Bark bands. The Bark scale is a
frequency scale on which equal distances correspond with perceptually equal
distances, more details regarding the Bark scale are showed in [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. This is weighted
by the perceived loudness w(k; l; i) which boosts up the DSR in the perceptually
important bands.
        </p>
        <p>The estimation of the perceived loudness is given by:
w(k; l; i) = Etarget;s1;s2 (k; l; i)0:25:
(9)</p>
        <p>
          Unlike the BASS measurements, that exhibit poor correlation with subjective
perception, the DSX has been shown to be linked with the perceived quality
[
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. This is why we identi ed it as a potential tness function for improving the
DNN-based fusion model performances.
        </p>
        <p>
          In order to adapt the DSX for network training, a number of modi cations
were required. In [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] the author used orthogonal projections in order to compute
the error and the target energy, while we will consider the energy of the squared
di erence between the target signal and the estimated signal in the Bark scale
and the square of the target signal. This approximation simpli es the di
erentiability requirements of the cost function in the training phase. The number
of channels was also adapted. The DSX formulation is composed by summation
over Bark band and over channels while we only consider the single channel as we
are in the single channel scenario. Another di erence concerns the concatenation
of speech and background while the original DSX formulation is unique for each
source. Therefore in our model the Etarget(k;l) contains 48 Bark bands where
the rst 24 address the energy of the target speech signal, while the remaining
24 represent the energy of the target background signal. The other measures
such as loudness and energy error are modi ed at the same way. Therefore, the
adapted version of the DSX is:
2L
        </p>
        <p>P
M DSR(k) = l=1</p>
        <p>Eerror;s1s2 (k;l)
Etarget;s1s2 (k;l) w(k; l)
2L
P w(k; l)
l=1
(10)
where L = 24 is the number of Bark bands. This model has been trained with
learning rate equal to 1e-5.</p>
        <p>
          Even though the results in [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] suggested positive expectations we will show
in the next section that this function does not produce anticipated improvements
in terms of the perceived quality.
5
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Experimental Results and Discussions</title>
      <sec id="sec-5-1">
        <title>Model Name Model Meaning</title>
        <p>Alg1
Alg2
MSE
Mel Inputs
MDSR</p>
        <p>The rst algorithm used in the fusion
The second algorithm used in the fusion
FNN fusion with MSE Contribution
FNN fusion with mel magnitude spectrograms Contribution
FNN fusion with MDSR Contribution</p>
      </sec>
      <sec id="sec-5-2">
        <title>SOA/Contribution</title>
        <sec id="sec-5-2-1">
          <title>State of the Art</title>
        </sec>
        <sec id="sec-5-2-2">
          <title>State of the Art</title>
          <p>This section provides an evaluation of the experimental results. Both
objective and subjective measurements are analysed, in order to see how they
correlate.
(a) Source To Distortion Ratio.</p>
          <p>(b) Source To Interferences Ratio.</p>
          <p>(c) Source To Artifacts Ratio.</p>
        </sec>
      </sec>
      <sec id="sec-5-3">
        <title>Evaluation of the Blind Audio Source Separation Performance</title>
      </sec>
      <sec id="sec-5-4">
        <title>Measurements</title>
        <p>
          The objective measurements have been computed with the BASS performance
measurements, described in [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. The BASS performance measurements take into
account some aspects like distortion, interference and artifacts. We computed 3
measurements, Source To Distortion Ratio (SDR), Source To Interferences
Ratio (SIR) and Source to Artifacts Ratio (SAR), for all the models. The results
have been computed with a test dataset composed by 65 audio mixtures whose
Signal To Noise Ratio (SNR) range goes from 3 dB to 18 dB. Our model predicts
both the speech signal and background signal, but since we are more interested
in the speech signal we decided to do not consider performances regarding the
background signal. We use graph that show performances in dB and we evaluate
them on all the models, which are listed in Table 1. Each value in dB
represents the average over the all test dataset of the measurement computed on the
extracted speech signal.
        </p>
        <p>Source To Distortion Ratio Each combination displayed similar performance to
each individual algorithm meaning that there is no signi cant improvement in
terms of SDR. The MDSR shows 5 dB of SDR which is not considered to be a
promising result.</p>
        <p>Source To Interferences Ratio The SIR measurement has been computed for
assessing the amount of interference of the background signal that occurs in the
estimated speech signal. Each DNN-based combiner achieves an improvement
of roughly 4 dB with respect to each mask individually. In addition, all of the
DNN-based combiner achieve an improvement of 10 dB with respect to the test
mixtures which have an average SIR of 11.52 dB.</p>
        <p>Source To Artifacts Ratio The last BASS performance measurement represents
how much of artifacts is present with respect to the target signal. We observed
that every combiner introduces more artifacts than each algorithm individually.
5.2</p>
      </sec>
      <sec id="sec-5-5">
        <title>Evaluation of the perceived quality</title>
        <p>
          The subjective performance measurements have been assessed with a
listening test based on the MUltiple Stimuli with Hidden Reference and Anchor
(MUSHRA) test [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. We asked to 6 expert listeners to evaluate the overall
sound quality of the speech signal. As indicated in the ITU BS.1534-1
recommendations, the listeners had to assign a score from 0 (bad) to 100 (excellent)
for di erent versions of the speech signal produced by the following models:
{ Algorithm 1
{ Algorithm 2
{ Fusion with FNN - MSE
{ Fusion with FNN - mel spectrograms
{ Fusion with FNN - MDSR
{ The target speech signal (Hidden Reference)
{ A highly distorted version of the speech signal (Anchor).
        </p>
        <p>
          In order to have accurate audio delity we used the professional STAX
headphones. Unlike the original MUSHRA, where the anchor is a low-pass ltered
version of the reference, we employed a strongly degraded version of the speech
signal as we are not assessing a lossy audio compression algorithm. We asked
listeners to evaluate how the overall sound quality was di erent with respect to the
target speech signal. This means that they had to assign low score when the
estimated speech signal showed artifacts and also when the background signal was
considered relevantly present. We chose 5 audio mixtures taken from a di erent
dataset with varied language and speaker gender. Each audio mixture has been
taken as 6 dB of input SNR since it re ects more real scenarios and our training
dataset range goes from 3 dB to 18 dB. All the signals have been normalized to
have the same integrated loudness. In order to evaluate how the DNN was going
to act in presence of varied background signals we decided to include background
that were di erent from the ones used in the training dataset, i.e., drum tracks,
guitar tracks and impulsive noise. The results, showed in Figure 3, represent the
mean and the 95% con dence intervals computed using Student's t-distribution
for each test item and algorithm, and the mean over all items. The
approximation by looking the mean of the models suggests that on average, fusion models
have been rated worse than one of the combined time/frequency mask. The
observed result is not line with the objective BASS performance measurements
Excelent90
100
80
Good70
60
Fair50
Poor30
Bad10
40
20
0
hiddenRef
anchor
Alg1
MDSR1
MelInputs
MSE
Alg2
espf
espm
engf
germ
germ
al items
where the DNN-based fusion models outperform each mask individually. MDSR
did not perform as anticipated with feedback and comments of the listeners
conrming a presence of the noise gate e ect in various signals, which is considered
annoying since it is usually preferred an higher constant noise to a lower but
variable noise. After informal listening we believe that those signals are the ones
produced by the perceptually-weighted DNN. Therefore we conclude that the
MDSR does not show promising results in terms of the perceived quality and
more work is still required. It should be noted that MDSR was shown to correlate
source separation with perceived quality in [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. This work has shown that this
correlation does not translates into improved quality when MDSR is applied in
a cost function. In addition, it can be observed that using the reduced resolution
is convenient as it reduces the training time and it did not signi cantly impact
performance quality.
6
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Conclusions</title>
      <p>We have proposed a new perceptually-weighted DNN-based fusion model that
takes into account the perceived quality of blindly separated audio signals. We
assessed both objective and subjective measurements in order to see if the
perceptual model outperforms each mask individually and others DNN-based fusion
models.</p>
      <p>The experimental results from the BASS performance measurements show
that the perceptually-weighted DNN-based fusion model outperforms only one
of the two algorithms in terms of SIR. The DNN-based fusion model with MSE
outperforms each mask individually in terms of SIR and presents similar
performances in terms of SDR. We also conducted a listening test for assessing the
perceived speech quality. Our experimental results show that using any
DNNbased fusion models does not improve the perceived quality of the speech signals
compared to each mask individually.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>This work was performed at Fraunhofer IIS, Erlangen, Germany with the
cooperation of Politecnico di Milano, Milan, Italy. This publication has emanated
from research conducted with the nancial support of Science Foundation Ireland
(SFI) under Grant Number SFI/12/RC/2289.</p>
      <p>The authors would like to sincerely thank Dr. Jouni Paulus and Prof. Jurgen
Herre of Fraunhofer IIS for their support and their excellent advice during this
research project.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Cobos</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lopez</surname>
            ,
            <given-names>J.J.:</given-names>
          </string-name>
          <article-title>Stereo audio source separation based on time-frequency masking and multilevel thresholding</article-title>
          .
          <source>Digital Signal Processing: A Review Journal</source>
          <volume>18</volume>
          (
          <issue>6</issue>
          ),
          <volume>960</volume>
          {
          <fpage>976</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Emiya</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vincent</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harlander</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hohmann</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Subjective and Objective Quality Assessment of Audio Source Separation</article-title>
          .
          <source>IEEE Transactions on Audio, Speech and Language Processing</source>
          <volume>19</volume>
          (
          <issue>7</issue>
          ),
          <year>2046</year>
          {
          <year>2057</year>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Geiger</surname>
            ,
            <given-names>J.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grosche</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parodi</surname>
            ,
            <given-names>Y.L.</given-names>
          </string-name>
          :
          <article-title>Dialogue enhancement of stereo sound</article-title>
          .
          <source>European Signal Processing Conference (EUSIPCO)</source>
          . pp.
          <volume>869</volume>
          {
          <issue>873</issue>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Grais</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          , Roma, G.,
          <string-name>
            <surname>Simpson</surname>
            ,
            <given-names>A.J.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plumbley</surname>
          </string-name>
          , M.D.:
          <article-title>Single Channel Audio Source Separation using Deep Neural Network Ensembles</article-title>
          .
          <source>AES: Journal of the Audio Engineering Society (9494)</source>
          ,
          <volume>236</volume>
          {
          <fpage>246</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Grais</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          , Roma, G.,
          <string-name>
            <surname>Simpson</surname>
            ,
            <given-names>A.J.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plumbley</surname>
          </string-name>
          , M.D.:
          <string-name>
            <surname>Two-Stage SingleChannel Audio Source</surname>
          </string-name>
          <article-title>Separation Using Deep Neural Networks</article-title>
          .
          <source>IEEE/ACM Transactions on Audio, Speech, and Language Processing</source>
          <volume>25</volume>
          (
          <issue>9</issue>
          ),
          <volume>1469</volume>
          {
          <fpage>1479</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Grais</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          , Roma, G.,
          <string-name>
            <surname>Simpson</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plumbley</surname>
          </string-name>
          , M.D.:
          <article-title>Combining Mask Estimates for Single Channel Audio Source Separation Using Deep Neural Networks</article-title>
          .
          <source>Interspeech</source>
          <year>2016</year>
          , Proceedings of. pp.
          <volume>3339</volume>
          {
          <issue>3343</issue>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Grais</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sen</surname>
            ,
            <given-names>M.U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Erdogan</surname>
          </string-name>
          , H.:
          <article-title>Deep neural networks for single channel source separation</article-title>
          .
          <source>Acoustics, Speech and Signal Processing (ICASSP)</source>
          . pp.
          <volume>3734</volume>
          {
          <issue>3738</issue>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Hines</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kendrick</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Narwaria</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Redi</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          :
          <article-title>Robustness and prediction accuracy of Machine Learning for objective visual quality assessment</article-title>
          .
          <source>In: European Signal Processing Conference</source>
          . pp.
          <volume>2130</volume>
          {
          <issue>2134</issue>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>P.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hasegawa-Johnson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smaragdis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Deep Learning for Monaural Speech Separation</article-title>
          .
          <source>Acoustics, Speech and Signal Processing (ICASSP)</source>
          . pp.
          <volume>1562</volume>
          {
          <issue>1566</issue>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. Hyvarinen,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Oja</surname>
          </string-name>
          , E.:
          <article-title>Independent Component Analysis: Algorithms and Applications</article-title>
          .
          <source>Neural Networks</source>
          <volume>13</volume>
          (
          <issue>45</issue>
          ),
          <volume>411</volume>
          {
          <fpage>430</fpage>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. International Telecommunication Unions: BS.1534
          <article-title>-1: Method for the subjective assessment of intermediate quality level of coding systems pp</article-title>
          .
          <volume>1</volume>
          {
          <issue>18</issue>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Jang</surname>
            ,
            <given-names>G.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>T.W.:</given-names>
          </string-name>
          <article-title>A Maximum Likelihood Approach to Single-channel Source Separation</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          <volume>1</volume>
          (
          <issue>7-8</issue>
          ),
          <volume>1365</volume>
          {
          <fpage>1392</fpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Jaureguiberry</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Richard</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leveau</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hennequin</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vincent</surname>
          </string-name>
          , E.:
          <article-title>Introducing a simple fusion framework for audio source separation</article-title>
          .
          <source>IEEE International Workshop on Machine Learning for Signal Processing</source>
          , MLSP (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Jaureguiberry</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vincent</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Richard</surname>
          </string-name>
          , G.:
          <article-title>Fusion methods for speech enhancement and audio source separation</article-title>
          .
          <source>IEEE/ACM Transactions on Audio, Speech, and Language Processing</source>
          <volume>24</volume>
          (
          <issue>7</issue>
          ),
          <volume>1266</volume>
          {
          <fpage>1279</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kastner</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Evaluating Physical Measures for Predicting the Perceived Quality of Blindly Separated Audio Source Signals</article-title>
          .
          <source>AES: Journal of the Audio Engineering</source>
          Society pp.
          <volume>1</volume>
          {
          <issue>13</issue>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Kittler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hater</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Duin</surname>
            ,
            <given-names>R.P.:</given-names>
          </string-name>
          <article-title>Combining classi ers</article-title>
          .
          <source>Proceedings - International Conference on Pattern Recognition</source>
          <volume>2</volume>
          (
          <issue>3</issue>
          ),
          <volume>897</volume>
          {
          <fpage>901</fpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>LeCun</surname>
            ,
            <given-names>Y.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bottou</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Orr</surname>
            ,
            <given-names>G.B.</given-names>
          </string-name>
          , Muller, K.R.:
          <source>E cient backprop. Lecture Notes in Computer Science (including subseries Lecture Notes in Arti cial Intelligence and Lecture Notes in Bioinformatics) 7700 LECTU</source>
          ,
          <volume>9</volume>
          {
          <fpage>48</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jackson</surname>
            ,
            <given-names>P.J.B.</given-names>
          </string-name>
          :
          <article-title>A Perceptually-Weighted Deep Neural Network for Monaural Speech Enhancement in Various Background Noise Conditions</article-title>
          .
          <source>European Signal Processing Conference (EUSIPCO)</source>
          . pp.
          <volume>1310</volume>
          {
          <issue>1314</issue>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Ozerov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fevotte</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation</article-title>
          .
          <source>IEEE Transactions on Audio, Speech and Language Processing</source>
          <volume>18</volume>
          (
          <issue>3</issue>
          ),
          <volume>550</volume>
          {
          <fpage>563</fpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Roweis</surname>
          </string-name>
          , S.S.T.:
          <article-title>One microphone source separation</article-title>
          .
          <source>Advances in neural information processing systems</source>
          pp.
          <volume>793</volume>
          {
          <issue>799</issue>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Smaragdis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , J.C.:
          <article-title>Non-Negative Matrix Factorization for Polyphonic Music Transcription</article-title>
          . IEEE Workshop on Applications of Signal Processing to Audio and Acoustics pp.
          <volume>177</volume>
          {
          <issue>180</issue>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Vincent</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gribonval</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fevotte</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Performance Measurement in Blind Audio Source Separation</article-title>
          .
          <source>IEEE Transactions on Audio, Speech and Language Processing</source>
          <volume>14</volume>
          (
          <issue>4</issue>
          ),
          <volume>1462</volume>
          {
          <fpage>1469</fpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Virtanen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria</article-title>
          .
          <source>IEEE Transactions on Audio, Speech and Language Processing</source>
          <volume>15</volume>
          (
          <issue>3</issue>
          ),
          <volume>1066</volume>
          {
          <fpage>1074</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>X.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>A Deep Ensemble Learning Method for Monaural Speech Separation</article-title>
          .
          <source>IEEE Transactions on Audio, Speech and Language Processing</source>
          <volume>21</volume>
          (
          <issue>5</issue>
          ),
          <volume>1475</volume>
          {
          <fpage>1487</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Zhen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sivaraman</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sung</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <string-name>
            <surname>On Psychoacoustically Weighted Cost Functions Towards Resource-E cient Deep</surname>
          </string-name>
          <article-title>Neural Networks for Speech Denoising</article-title>
          . arXiv preprint arXiv:
          <year>1801</year>
          .
          <volume>09774</volume>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Zwicker</surname>
          </string-name>
          , E.:
          <article-title>Subdivision of the audible frequency range into critical bands (frequenzgruppen)</article-title>
          .
          <source>The Journal of the Acoustical Society of America</source>
          <volume>33</volume>
          (
          <issue>2</issue>
          ),
          <volume>248</volume>
          {
          <fpage>248</fpage>
          (
          <year>1961</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>