On the Detection of Footsteps Based on Acoustic and Seismic Sensing

In this work, we present a copula-based framework for integrating signals of different but statistically correlated modalities for binary hypothesis testing problems. Specifically, we consider the problem of detecting the presence of a human using footstep signals from seismic and acoustic sensors. An approach based on canonical correlation analysis and copula theory is employed to establish a likelihood ratio test. Experimental results based on real data are presented.

[1]  Louis L. Scharf,et al.  Canonical coordinates and the geometry of inference, rate, and capacity , 2000, IEEE Trans. Signal Process..

[2]  A. Murat Tekalp,et al.  Lip feature extraction based on audio-visual correlation , 2005, 2005 13th European Signal Processing Conference.

[3]  David Malah,et al.  Speech enhancement using a minimum mean-square error log-spectral amplitude estimator , 1984, IEEE Trans. Acoust. Speech Signal Process..

[4]  James M. Sabatier,et al.  Passive ultrasonic method for human footstep detection , 2007, SPIE Defense + Commercial Sensing.

[5]  Malcolm Slaney,et al.  FaceSync: A Linear Operator for Measuring Synchronization of Video Facial Images and Audio Tracks , 2000, NIPS.

[6]  R. Clemen,et al.  Correlations and Copulas for Decision and Risk Analysis , 1999 .

[7]  Gervasio Prado,et al.  Footstep detection and tracking , 2001, SPIE Defense + Commercial Sensing.

[8]  R. Gittins,et al.  Canonical Analysis: A Review with Applications in Ecology , 1985 .

[9]  Sanjit K. Mitra,et al.  Voice activity detection based on multiple statistical models , 2006, IEEE Transactions on Signal Processing.

[10]  P. Varshney,et al.  Multisensor surveillance systems : the fusion perspective , 2003 .

[11]  A. Murat Tekalp,et al.  Multimodal Speaker Identification Using Canonical Correlation Analysis , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  Pramod K. Varshney,et al.  Multisensor Surveillance Systems , 2003, Springer US.

[13]  Vinayak S. Naik,et al.  A line in the sand: a wireless sensor network for target detection, classification, and tracking , 2004, Comput. Networks.

[14]  Gerard E. Sleefe,et al.  Acoustic and seismic modalities for unattended ground sensors , 1999, Defense, Security, and Sensing.

[15]  Michael Elad,et al.  Pixels that sound , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  R. Nelsen.  An Introduction to Copulas , 1998 .

[17]  Gervasio Prado,et al.  Problems in seismic detection and tracking , 2000, Defense, Security, and Sensing.

[18]  Ross E. Bland,et al.  Acoustic and seismic signal processing for footsetp detection , 2006 .