Joint Acoustic-Video Fingerprinting of Vehicles, Part I

We address vehicle classification and measurement problems using acoustic and video sensors. In this paper, we show how to estimate a vehicle's speed, width, and length by jointly estimating its acoustic wave-pattern using a single passive sensor that records the vehicle's drive-by noise. The acoustic wave-pattern is approximated using three envelope shape (ES) components, which approximate the shape of the received signal's power envelope. We incorporate the parameters of the ES components along with the estimates of the vehicle engine RPM and number of cylinders to create a vehicle profile vector that forms an intuitive discriminatory feature space. In the companion paper, we discuss vehicle classification and mensuration based on silhouette extraction and wheel detection, using a video sensor. Vehicle speed estimation and classification results are provided using field data.

[1]  L. Rayleigh,et al.  The theory of sound , 1894 .

[2]  A. Einstein.  On the Electrodynamics of Moving Bodies , 2005 .

[3]  A. Einstein.  Zur Elektrodynamik bewegter Körper , 1905 .

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  Ronald W. Schafer,et al.  Digital Processing of Speech Signals , 1978 .

[6]  J. Hunt,et al.  Highway Modeling. Part I: Prediction of Velocity and Turbulence Fields in the Wake of Vehicles , 1979 .

[7]  Boualem Boashash,et al.  A methodology for detection and classification of some underwater acoustic signals using time-frequency analysis techniques , 1990, IEEE Trans. Acoust. Speech Signal Process..

[8]  M. Kilger,et al.  Video-based traffic monitoring , 1992 .

[9]  M. Kilger,et al.  A shadow handler in a video-based real-time traffic monitoring system , 1992, [1992] Proceedings IEEE Workshop on Applications of Computer Vision.

[10]  L. J. Ziomek.  Three necessary conditions for the validity of the Fresnel phase approximation for the near-field beam pattern of an aperture , 1993 .

[11]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Geoffrey D. Sullivan,et al.  A Generic Deformable Model for Vehicle Recognition , 1995, BMVC.

[13]  B. Quinn.  Doppler speed and range estimation using frequency and amplitude estimates , 1995 .

[14]  Somkiat Sampan,et al.  Neural Fuzzy Techniques In Vehicle Acoustic Signal Classification , 1997 .

[15]  Yoram Bresler,et al.  Doppler-based motion estimation for wide-band sources from single passive sensor measurements , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Rama Chellappa,et al.  Probe-based automatic target recognition in infrared imagery , 1997, IEEE Trans. Image Process..

[17]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  James F. Forren,et al.  Traffic monitoring by tire noise , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[19]  Y Ohashi Asokawa.  AUTOMATIC VEHICLE RECOGNITION BY SILHOUETTE THEORY , 1998 .

[20]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[21]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[22]  Li Liu.  Ground Vehicle Acoustic Signal Processing Based on Biological Hearing Models , 1999 .

[23]  Antonio Criminisi,et al.  New approach to obtain height measurements from video , 1999, Other Conferences.

[24]  Rama Chellappa,et al.  Vehicle detection and tracking in video , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[25]  Manohar Das,et al.  An efficient technique for modeling and synthesis of automotive engine sounds , 2001, IEEE Trans. Ind. Electron..

[26]  Rama Chellappa,et al.  A generic approach to simultaneous tracking and verification in video , 2002, IEEE Trans. Image Process..

[27]  R. Graf,et al.  On the horn effect of a tyre/road interface, part I: experiment and computation , 2002 .

[28]  Ulf Sandberg,et al.  Tyre/road noise reference book , 2002 .

[29]  Feng Zhao,et al.  Collaborative signal and information processing in microsensor networks , 2002, IEEE Signal Processing Magazine.

[30]  Mario E. Munich.  Bayesian subspace methods for acoustic signature recognition of vehicles , 2004, 2004 12th European Signal Processing Conference.

[31]  Yu Hen Hu,et al.  Vehicle classification in distributed sensor networks , 2004, J. Parallel Distributed Comput..

[32]  Qinfen Zheng,et al.  A temporal variance-based moving target detector , 2005 .

[33]  Rama Chellappa,et al.  Video Mensuration Using a Stationary Camera , 2006, ECCV.

[34]  Joseph L. Mundy,et al.  Augmenting Shape with Appearance in Vehicle Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[35]  Ioannis Patras,et al.  Combining color and shape information for illumination-viewpoint invariant object recognition , 2006, IEEE Transactions on Image Processing.

[36]  Volkan Cevher,et al.  Target Tracking Using a Joint Acoustic Video System , 2007, IEEE Transactions on Multimedia.

[37]  Volkan Cevher,et al.  Vehicle Speed Estimation Using Acoustic Wave Patterns , 2009, IEEE Transactions on Signal Processing.