This paper describes the team MTM participation in Violent Scenes Detection (VSD) task of the MediaEval 2014 campaign. We propose an approach to the problem of detecting violence, which is based on probabilistic graphical models using Mel-frequency cepstral coefficients (MFCCs) as audio feature. In our approach, we employ Dynamic Bayesian Networks (DBNs) to represent a violent scene as an dynamic system.
The goal of the Violent Scenes Detection (VSD) task of the
MediaEval 2014 benchmarking campaign is to detect violence in
movies [
We propose to model video based on temporal structure and principle of causality using Dynamic Bayesian Networks (DBN).
For this year’s benchmark, we have developed an acoustic system based on temporal data (MFCC vector). The main idea behind this approach is to represent a violent scene as a dynamic system.
A DBN (see Figure 1) is a state-space model of random variable
Vt [
Vt = (Ut; Xt; Yt); (1) where Ut represents the hidden, Xt the input and Yt the output variable. A pair (B1; B2) defines a DBN, where B1 and B2 are Ui 2 Xi 2
Ui 1 Xi 1
Ui Xi
Ui+1 Xi+1 BNs. The two-slice temporal Bayes net B2 (DBN unrolled for 2 slices), defines P (VtjVt 1):
P (VtjVt 1) =
N Y P (VitjP a(Vit)); i=1 where P a(Vit) are the parents in the net. Next, our acoustic feature detector is described. 2.2
Our audio concept detector is based on MFCCs. The audio signal is segmented into acoustic frames with overlapping. Acoustic frames are used to group samples using a window with fixed length. We split the audio signal into frames of 40ms length, with 20ms overlap, and apply a Hamming window to each frame. The Hamming function is given by: w(n) = 0:54 0:46 cos( 2 n N 1 ):
For each audio frame, 12 MFCCs (range 133Hz-6855Hz) and their first and second derivates are computed to build an acoustic vector yj :
yj = (y1j ; y2j ; :::; y3j6): 2.3
After the feature extraction, a way of representing audio is through a feature vector model using Bag of Audio Words (BoAW). In this representation, each vector has the size of the vocabulary, where each vocabulary word represents a position vector. The ith vector value for a n audio segment equals the number of occurrences of that word i in the audio segment. (2) (3) (4)
0.0000 0.0429 0.1875 0.1018 0.0480 0.1974 0.1201 run #1 DBN
Average Average Precision Precision 2014 at 100 (MAP2014) (MAP@100)
For each run, a naive DBN is trained using two different observed vectors Yt: (i) acoustic vector yj , and (i) BoAW byj with 128 audio words (see Figure 2). The likelihood of a model M , P (y1:T jM ), is used to assign a sequence y1:T to non-violent or violent label as follows:
M (y1:T ) = arg max P (y1:T jM )P (M ):
M (5)
The Bayes Net Toolbox for Matlab (BNT) [
2). We investigated the results and came to the presumption that BoAW removes noisy observations,while reducing the number of observations per segment. It might be related with the observation "grouping" when the BoAW is computed for the temporal segment (see Figure 2). Thus, BoAW removes data noise and builds a better representation for a scene (model observation). However, the results are still very poor. We suppose it could be due to features, only MFCCs seems not capable of distinguishing all violence and non-violence segments and generalize the violence concept. Further work directions relies in capture the causality in violence segments using different structures and other feature modalities (feature selection). 5. 6.
This work was supported in part by two grants from CAPES and CNPq.