Classification and modeling of human activities using empirical mode decomposition with S-band and millimeter-wave micro-Doppler radars

The ability to identify human movements can be an important tool in many different applications such as surveillance, military combat situations, search and rescue operations, and patient monitoring in hospitals. This information can provide soldiers, security personnel, and search and rescue workers with critical knowledge that can be used to potentially save lives and/or avoid a dangerous situation. Most research involving human activity recognition is focused on using the Short-Time Fourier Transform (STFT) as a method of analyzing the micro-Doppler signatures. Because of the time-frequency resolution limitations of the STFT and because Fourier transform-based methods are not well-suited for use with non-stationary and nonlinear signals, we have chosen a different approach. Empirical Mode Decomposition (EMD) has been shown to be a valuable time-frequency method for processing non-stationary and nonlinear data such as micro-Doppler signatures and EMD readily provides a feature vector that can be utilized for classification. For classification, the method of a Support Vector Machine (SVMs) was chosen. SVMs have been widely used as a method of pattern recognition due to their ability to generalize well and also because of their moderately simple implementation. In this paper, we discuss the ability of these methods to accurately identify human movements based on their micro-Doppler signatures obtained from S-band and millimeter-wave radar systems. Comparisons will also be made based on experimental results from each of these radar systems. Furthermore, we will present simulations of micro-Doppler movements for stationary subjects that will enable us to compare our experimental Doppler data to what we would expect from an "ideal" movement.

[1]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Raghu G. Raj,et al.  Analysis of radar dismount signatures via non-parametric and parametric methods , 2009, 2009 IEEE Radar Conference.

[3]  A.E. Fathy,et al.  Through-the-Wall Radar Life Detection and Monitoring , 2007, 2007 IEEE/MTT-S International Microwave Symposium.

[4]  Qun Zhang,et al.  Analysis of micro-doppler effect in SIMO radar , 2010, 2010 2nd International Conference on Signal Processing Systems.

[5]  Qiang Wang,et al.  Life signal extraction in through-the-wall surveillance , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Ram M. Narayanan,et al.  Through wall ranging and imaging using UWB random noise waveform: System design considerations and preliminary experimental results , 2009, 2009 IEEE Antennas and Propagation Society International Symposium.

[7]  Paramita Barua,et al.  Heart-beat detection and ranging through a wall using ultra wide band radar , 2011, 2011 International Conference on Communications and Signal Processing.

[8]  M Crivellini,et al.  Biomechanical analysis of sit-to-stand movement in normal and obese subjects. , 2003, Clinical biomechanics.

[9]  David G. Falconer,et al.  Through-the-wall differential radar , 1997, Defense + Security Symposium.

[10]  Jiguang Sun,et al.  The analysis of TWI data for human being's periodic motions , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[11]  C. Karabacak,et al.  Multi-aspect angle classification of human radar signatures , 2013, Defense, Security, and Sensing.

[12]  Jenshan Lin,et al.  A microwave radio for Doppler radar sensing of vital signs , 2001, 2001 IEEE MTT-S International Microwave Sympsoium Digest (Cat. No.01CH37157).

[13]  B. Levitas,et al.  UWB Radar for Human Being Detection Behind the Wall , 2006, 2006 International Radar Symposium.

[14]  David J. Daniels,et al.  Surface-Penetrating Radar , 1996 .

[15]  Ram M. Narayanan,et al.  Micro-doppler radar classification of human motions under various training scenarios , 2013, Defense, Security, and Sensing.

[16]  Mark A. Richards,et al.  Principles of Modern Radar: Basic Principles , 2013 .

[17]  Ram M. Narayanan,et al.  A Portable Real-Time Digital Noise Radar System for Through-the-Wall Imaging , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Soo-Young Lee,et al.  Support Vector Machines with Binary Tree Architecture for Multi-Class Classification , 2004 .

[19]  Youngwook Kim,et al.  Application of ultra-wide band radar for classification of human activities , 2012 .

[20]  Ram M. Narayanan,et al.  Hilbert-Huang transform analysis of human activities using through-wall noise and noise-like radar , 2008 .

[21]  David Tahmoush,et al.  UHF measurement of breathing and heartbeat at a distance , 2010, 2010 IEEE Radio and Wireless Symposium (RWS).

[22]  Hao Ling,et al.  Through-wall measurements of a Doppler and direction-of-arrival (DDOA) radar for tracking indoor movers , 2005, 2005 IEEE Antennas and Propagation Society International Symposium.

[23]  I.A. Vasilyev,et al.  Through wall sensing of human breathing and heart beating by monochromatic radar , 2004, Proceedings of the Tenth International Conference on Grounds Penetrating Radar, 2004. GPR 2004..

[24]  Zhao Li,et al.  A new algorithm for through wall human respiration monioring using GPR , 2012, 2012 14th International Conference on Ground Penetrating Radar (GPR).

[25]  Benjamin E. Barrowes,et al.  Through-Wall Bio-Radiolocation With UWB Impulse Radar: Observation, Simulation and Signal Extraction , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  G. R. Cooper,et al.  A class of noise radar systems , 1963 .

[27]  A. Vansant,et al.  Sit-to-stand movement pattern. A kinematic study. , 1986, Physical therapy.

[28]  Qun Zhang,et al.  Three-dimensional micro-doppler signature extraction in MIMO radar , 2010, 2010 2nd International Conference on Signal Processing Systems.

[29]  Allen M. Waxman,et al.  Acoustic Micro-Doppler Gait Signatures of Humans and Animals , 2007, 2007 41st Annual Conference on Information Sciences and Systems.

[30]  Ram M. Narayanan,et al.  THROUGH-THE-WALL DETECTION OF STATIONARY HUMAN TARGETS USING DOPPLER RADAR , 2010 .

[31]  V.C. Chen,et al.  Spatial and temporal independent component analysis of micro-Doppler features , 2005, IEEE International Radar Conference, 2005..

[32]  Victor C. Chen,et al.  Analysis of radar micro-Doppler with time-frequency transform , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[33]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[34]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[35]  A. C. Raptis,et al.  Compact Millimeter-Wave Sensor for Remote Monitoring of Vital Signs , 2012, IEEE Transactions on Instrumentation and Measurement.

[36]  Olivier Sigaud,et al.  A Two-Level Model of Anticipation-Based Motor Learning for Whole Body Motion , 2009, ABiALS.

[37]  Sergey Ivashov,et al.  Detection of Human Breathing and Heartbeat by Remote Radar , 2004 .

[38]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  N. Petrochilos,et al.  A versatile through-the-wall doppler radar using BSS algorithms , 2007, 2007 IEEE Antennas and Propagation Society International Symposium.

[40]  B. Barrowes,et al.  The Application of the Hilbert-Huang Transform in Through-wall Life Detection with UWB Impulse Radar , 2010 .

[41]  Qun Zhang,et al.  Micro-Doppler analysis of vibrating target in bistatic radar , 2009, 2009 2nd Asian-Pacific Conference on Synthetic Aperture Radar.

[42]  Michael C. Wicks,et al.  New law enforcement applications of millimeter-wave radar , 1997, Defense, Security, and Sensing.

[43]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[44]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[45]  E Zaikov,et al.  UWB radar for detection and localization of trapped people , 2010, 11-th INTERNATIONAL RADAR SYMPOSIUM.

[46]  Victor C. Chen,et al.  Analysis of radar human gait signatures , 2010 .

[47]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[48]  Hao Ling,et al.  Time-Frequency Transforms for Radar Imaging and Signal Analysis , 2002 .

[49]  Ram M. Narayanan,et al.  Human activity classification using Hilbert-Huang transform analysis of radar Doppler data , 2011, Defense + Commercial Sensing.

[50]  Sedki M. Riad,et al.  Ultrawideband through-the-wall propagation , 2005 .

[51]  Hao Ling,et al.  Microdoppler signature simulation of computer animated human and animal motions , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[52]  M.Y.W. Chia,et al.  Through-wall UWB radar operating within FCC's mask for sensing heart beat and breathing rate , 2005, 2005 European Microwave Conference.

[53]  Wei Zhang,et al.  Extraction of Vibrating Features With Dual-Channel Fixed-Receiver Bistatic SAR , 2012, IEEE Geoscience and Remote Sensing Letters.

[54]  Q. Du,et al.  Application of the EMD method in the vibration analysis of ball bearings , 2007 .

[55]  Victor C. Chen,et al.  Doppler signatures of radar backscattering from objects with micro-motions , 2008 .

[56]  Ram M. Narayanan,et al.  Simultaneous human detection and ranging using a millimeter-wave radar system transmitting wideband noise with an embedded tone , 2012, Defense + Commercial Sensing.

[57]  Kurt Oughstun,et al.  On the Lorentz-Lorenz formula and the Lorentz model of dielectric dispersion. , 2003, Optics express.

[58]  Ming Li,et al.  Life detection and location methods using UWB impulse radar in a coal mine , 2011 .

[59]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[60]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[61]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[62]  G. Cheron,et al.  Chest wall motion during tidal breathing. , 1997, Journal of applied physiology.