Vehicle engine classification using normalized tone-pitch indexing and neural computing on short remote vibration sensing data

Abstract As a non-invasive and remote sensor, a Laser Doppler Vibrometer (LDV) has found a broad spectrum of applications. It is a remote, non-line-of-sight sensor to detect threats more reliably and provide increased security protection, which is of utmost importance to military and law enforcement applications. However, the use of the LDV in situation surveillance, especially in vehicle classification, lacks systematic investigations as to its phenomenological and statistical properties. In this work, we aim to identify vehicles by their engine types within a very short period of time to yield a practical expert and intelligent system to classify vehicle engines remotely using laser sensors. Based on our preliminary success on the use of tone-pitch indexes (TPI) over these data, a new normalized tone-pitch indexing (nTPI) scheme is developed to capture engine periodic vibrations by various engine types with vibration data over a much shorter period (from 1.25 to 0.2 s), which makes it possible to monitor slowly moving vehicles around 15 miles per hour. We also exploit the learning power of neural computing, including artificial neural network (ANN), Deep Belief nets (DBN), Stacked Auto-Encoder (SAE), and Convolutional Neural Networks (CNN). To apply a CNN, a two-dimensional array is formulated by stacking nTPI data in an overlapping manner, which is termed as 2DonTPI. The classification results using the proposed nTPI and 2DonTPI over a standard LDV dataset are promising: with encoding duration significantly smaller than that required by the original TPI, consistently high performance is attained for all four neural computing methods. The new vibration data representation combined with neural computing approaches gives rise to a powerful expert and intelligent system for vehicle engine classification, which can find a great array of applications for civil, law enforcement, and military agencies for Intelligence, Surveillance and Reconnaissance purposes that are of crucial importance to national and international security.

[1]  Gian Marco Revel,et al.  Structural damage assessment in composite material using laser Doppler vibrometry , 2004, International Conference on Vibration Measurements by Laser Techniques: Advances and Applications.

[2]  Jie Wei,et al.  Classification of uncooperative vehicles with sparse laser Doppler vibrometry measurements , 2015, Defense + Security Symposium.

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[4]  Jie Wei,et al.  Shape Indexing and Recognition Based on Regional Analysis , 2007, IEEE Transactions on Multimedia.

[5]  R. Bellman Dynamic programming. , 1957, Science.

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  Alexander Lerch,et al.  An Introduction to Audio Content Analysis: Applications in Signal Processing and Music Informatics , 2012 .

[8]  Karmon Vongsy,et al.  Engine classification using vibrations measured by Laser Doppler Vibrometer on different surfaces , 2015, Defense + Security Symposium.

[9]  Paul E. Utgoff,et al.  Many-Layered Learning , 2002, Neural Computation.

[10]  Stuart J. Shelley,et al.  Analysis of vehicle vibration sources for automatic differentiation between gas and diesel piston engines , 2012, Defense + Commercial Sensing.

[11]  Amir Averbuch,et al.  A diffusion framework for detection of moving vehicles , 2010, Digit. Signal Process..

[12]  Hao Tang,et al.  Crowd Counting with Minimal Data Using Generative Adversarial Networks for Multiple Target Regression , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[13]  Jie Wei,et al.  Color object indexing and retrieval in digital libraries , 2002, IEEE Trans. Image Process..

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  Mark R. Stevens,et al.  Identifying vehicles using vibrometry signatures , 2002, Object recognition supported by user interaction for service robots.

[16]  Shashidhar G. Koolagudi,et al.  Classification of vocal and non-vocal segments in audio clips using genetic algorithm based feature selection (GAFS) , 2018, Expert Syst. Appl..

[17]  Haizhou Li,et al.  An overview of text-independent speaker recognition: From features to supervectors , 2010, Speech Commun..

[18]  Verónica Bolón-Canedo,et al.  Toward the scalability of neural networks through feature selection , 2013, Expert Syst. Appl..

[19]  Jeffrey F. Rhoads,et al.  Structural Dynamic Imaging Through Interfaces Using Piezoelectric Actuation and Laser Vibrometry for Diagnosing the Mechanical Properties of Composite Materials , 2013 .

[20]  Jie Wei,et al.  Spectral Eigen Index: Military vehicle fingerprinting using Eigen analysis in spectral domain , 2018, Pattern Recognit. Lett..

[21]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[22]  Alex Acero,et al.  Spoken Language Processing: A Guide to Theory, Algorithm and System Development , 2001 .

[23]  Enrico Primo Tomasini,et al.  The laser doppler vibrometer as an instrument for nonintrusive diagnostic of works of art: Application to fresco paintings , 1996 .

[24]  Tao Wang,et al.  A multimodal temporal panorama approach for moving vehicle detection, reconstruction and classification , 2013, Comput. Vis. Image Underst..

[25]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[26]  Jie Wei,et al.  Markov Edit Distance , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[28]  Pinar Kirci,et al.  Selection of spectral features for land cover type classification , 2018, Expert Syst. Appl..

[29]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Pravin Varaiya,et al.  A Wireless Accelerometer-Based Automatic Vehicle Classification Prototype System , 2014, IEEE Transactions on Intelligent Transportation Systems.

[32]  Jie Wei,et al.  Vehicle Engine Classification Using Spectral Tone-Pitch Vibration Indexing and Neural Network , 2014, Int. J. Monit. Surveillance Technol. Res..

[33]  Eric O. Postma,et al.  Learning scale-variant and scale-invariant features for deep image classification , 2016, Pattern Recognit..