Acoustic scene analysis from acoustic event sequence with intermittent missing event

We propose a novel method for analyzing acoustic scenes that can sophisticatedly estimate acoustic scenes from an acoustic event sequence with intermittent missing events. On the basis of the idea that acoustic events are temporally correlated, we model the transition of acoustic events using a hidden Markov model (HMM) and estimate missing acoustic events. Then, we incorporate the transition of acoustic events in a generative process of acoustic event sequence associated with the acoustic scenes based on acoustic topic model (ATM). Since the proposed method allows us to analyze acoustic scenes from acoustic event sequences while estimating missing acoustic events, we can estimate acoustic scenes successfully and restore missing acoustic events. Evaluation results indicate that the proposed method achieves an estimation accuracy for acoustic scenes comparable to that obtained when there is no missing data. Additionally, the proposed model can estimate acoustic events that are strongly correlated with acoustic scenes in an acoustic event sequence.

[1]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[2]  Shrikanth S. Narayanan,et al.  Acoustic topic model for audio information retrieval , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[3]  Václav Hlavác,et al.  Multi-class support vector machine , 2002, Object recognition supported by user interaction for service robots.

[4]  Radford M. Neal Probabilistic Inference Using Markov Chain Monte Carlo Methods , 2011 .

[5]  Shrikanth Narayanan,et al.  Supervised acoustic topic model for unstructured audio information retrieval , 2010 .

[6]  Suehiro Shimauchi,et al.  User activity estimation method based on probabilistic generative model of acoustic event sequence with user activity and its subordinate categories , 2013, INTERSPEECH.

[7]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Vesa T. Peltonen,et al.  Audio-based context recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Daniel P. W. Ellis,et al.  Audio-Based Semantic Concept Classification for Consumer Video , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  Janto Skowronek,et al.  Automatic surveillance of the acoustic activity in our living environment , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[11]  Ching-Yung Lin,et al.  Healthcare audio event classification using Hidden Markov Models and Hierarchical Hidden Markov Models , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[12]  Tuomas Virtanen,et al.  Acoustic event detection in real life recordings , 2010, 2010 18th European Signal Processing Conference.

[13]  Tuomas Virtanen,et al.  Audio context recognition using audio event histograms , 2010, 2010 18th European Signal Processing Conference.

[14]  M. Al Masum Shaikh,et al.  Automatic Life-Logging: A novel approach to sense real-world activities by environmental sound cues and common sense , 2008, 2008 11th International Conference on Computer and Information Technology.

[15]  Christophe Beaugeant,et al.  Single microphone wind noise reduction using techniques of artificial bandwidth extension , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[16]  Yasunori Ohishi,et al.  Acoustic scene analysis based on latent acoustic topic and event allocation , 2013, 2013 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[17]  Hirokazu Kameoka,et al.  Bayesian semi-supervised audio event transcription based on Markov indian buffet process , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Andrey Temko,et al.  CLEAR Evaluation of Acoustic Event Detection and Classification Systems , 2006, CLEAR.

[19]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.