Human Presence Sensing and Gesture Recognition for Smart Home Applications With Moving and Stationary Clutter Suppression Using a 60-GHz Digital Beamforming FMCW Radar

With the advancement of radio frequency (RF) assisted smart home technology, it is critical for the RF sensors deployed indoors to isolate the target of interest from unwanted clutter sources. This paper presents a novel method for suppressing both moving and stationary clutters in an indoor environment to localize stationary human subjects with a millimeter-wave frequency-modulated continuous-wave (FMCW) radar. The method derives its roots from the intrinsic high-pass filter (HPF) characteristic of the exponential moving average (EMA) algorithm, a preferred approach for background stationary clutter suppression. In this work, emphasis was laid on expanding the capability to detect and suppress unwanted moving clutter sources in the indoor environment along with stationary clutters, which has not been widely explored before. The proposed method removes motion artifacts so that the characteristic respiratory signal can be identified for human-aware localization. The paper provides experimental validation of the proposed method, wherein a 60-GHz FMCW radar with digital beamforming (DBF) capability was used to identify the 2-D location of a sitting human subject, with a moving window curtain in the background acting as a strong moving clutter source along with other stationary clutters. In addition, a lateral hand gesture recognition technique is presented, wherein the EMA algorithm was used to enhance the signature of the hand motion. The instantaneous position of the hand at the beginning and end of the gesture was determined to classify the gesture as a left-to-right or right-to-left hand swipe.

[1]  Sung Ho Cho,et al.  Multi-Human Detection Algorithm Based on an Impulse Radio Ultra-Wideband Radar System , 2016, IEEE Access.

[2]  Christian Waldschmidt,et al.  Mitigation of Leakage in FMCW Radars by Background Subtraction and Whitening , 2020, IEEE Microwave and Wireless Components Letters.

[3]  Avik Santra,et al.  Human Target Detection, Tracking, and Classification Using 24-GHz FMCW Radar , 2019, IEEE Sensors Journal.

[4]  Jie Liu,et al.  Wellness Sensor Networks: A Proposal and Implementation for Smart Home for Assisted Living , 2015, IEEE Sensors Journal.

[5]  Changzhi Li,et al.  Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors , 2016, IEEE Transactions on Microwave Theory and Techniques.

[6]  Insoo Koo,et al.  Toward a Lightweight Intrusion Detection System for the Internet of Things , 2019, IEEE Access.

[7]  Murad Khan,et al.  Internet of Things Based Energy Aware Smart Home Control System , 2016, IEEE Access.

[8]  Changzhi Li,et al.  A Portable FMCW Interferometry Radar With Programmable Low-IF Architecture for Localization, ISAR Imaging, and Vital Sign Tracking , 2017, IEEE Transactions on Microwave Theory and Techniques.

[9]  Jong-Hun Lee,et al.  A Pedestrian Detection Scheme Using a Coherent Phase Difference Method Based on 2D Range-Doppler FMCW Radar , 2016, Sensors.

[10]  Cheng Li,et al.  Panoramic Camera-Based Human Localization Using Automatically Generated Training Data , 2020, IEEE Access.

[11]  Songcheol Hong,et al.  Feature-Based Hand Gesture Recognition Using an FMCW Radar and its Temporal Feature Analysis , 2018, IEEE Sensors Journal.

[12]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[13]  Mamun Bin Ibne Reaz,et al.  A Review of Smart Homes—Past, Present, and Future , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  H. Mirinejad,et al.  A review of intelligent control techniques in HVAC systems , 2012, 2012 IEEE Energytech.

[15]  Changzhi Li,et al.  A Low Power 5.8-GHz ISM-Band Intermodulation Radar System for Target Motion Discrimination , 2019, IEEE Sensors Journal.

[16]  Chris D. Nugent,et al.  From Activity Recognition to Intention Recognition for Assisted Living Within Smart Homes , 2017, IEEE Transactions on Human-Machine Systems.

[17]  Jing Wang,et al.  Portable Doppler/FSK/FMCW Radar Systems for Life Activity Sensing and Human Localization , 2019, 2019 14th International Conference on Advanced Technologies, Systems and Services in Telecommunications (TELSIKS).

[18]  Yazhou Wang,et al.  CW and Pulse–Doppler Radar Processing Based on FPGA for Human Sensing Applications , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jing Liang,et al.  Non-Contact Detection of Vital Signs Using a UWB Radar Sensor , 2019, IEEE Access.

[20]  P. Pasquina,et al.  Sensor technology for smart homes. , 2011, Maturitas.

[21]  Jong-Hun Lee,et al.  Moving and stationary target detection scheme using coherent integration and subtraction for automotive FMCW radar systems , 2017, 2017 IEEE Radar Conference (RadarConf).

[22]  Changzhi Li,et al.  Hand Gesture Recognition Using FMCW Radar in Multi-Person Scenario , 2021, 2021 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNeT).

[23]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[24]  Antonio Lázaro,et al.  Techniques for Clutter Suppression in the Presence of Body Movements during the Detection of Respiratory Activity through UWB Radars , 2014, Sensors.

[25]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[26]  Changzhi Li,et al.  A $K$ -Band Portable FMCW Radar With Beamforming Array for Short-Range Localization and Vital-Doppler Targets Discrimination , 2017, IEEE Transactions on Microwave Theory and Techniques.

[27]  C. G. Raghavendra,et al.  Object tracking and detection for short range surveillance using 2D ultrasonic sensor array , 2016, 2016 International Conference on Circuits, Controls, Communications and Computing (I4C).

[28]  Robin J. Evans,et al.  Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks , 2019, IEEE Sensors Journal.

[29]  Seong-Cheol Kim,et al.  Adaptive clutter suppression algorithm for human detection using IR-UWB radar , 2017, 2017 IEEE SENSORS.

[30]  L.P. Ligthart,et al.  UWB Radar for Human Being Detection , 2005, IEEE Aerospace and Electronic Systems Magazine.

[31]  Liyanage C. De Silva,et al.  State of the art of smart homes , 2012, Eng. Appl. Artif. Intell..

[32]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[33]  Changzhi Li,et al.  Intermodulation-Based Nonlinear Smart Health Sensing of Human Vital Signs and Location , 2019, IEEE Access.

[34]  Abdulsalam Yassine,et al.  Mining Human Activity Patterns From Smart Home Big Data for Health Care Applications , 2017, IEEE Access.

[35]  Sonia,et al.  Ultrasonic sensor-based human detector using one-class classifiers , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[36]  Kevin Chetty,et al.  On the Application of Digital Moving Target Indication Techniques to Short-Range FMCW Radar Data , 2018, IEEE Sensors Journal.

[37]  Jun Zhang,et al.  An iterative singular vector decomposition based micro-motion target indication in through-the-wall radar , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[38]  James Moyne,et al.  Comparison of energy consumption in HVAC systems using simple ON-OFF, intelligent ON-OFF and optimal controllers , 2011, 2011 IEEE Power and Energy Society General Meeting.

[39]  Maria E. Niessen,et al.  Monitoring Activities of Daily Living in Smart Homes: Understanding human behavior , 2016, IEEE Signal Processing Magazine.

[40]  Bo Yang,et al.  Distributed Multi-Human Location Algorithm Using Naive Bayes Classifier for a Binary Pyroelectric Infrared Sensor Tracking System , 2016, IEEE Sensors Journal.

[41]  Ram M. Narayanan,et al.  Moving target indication with non-linear radar , 2015, 2015 IEEE Radar Conference (RadarCon).

[42]  Changzhi Li,et al.  24-GHz Impedance-Modulated BPSK Tags for Range Tracking and Vital Signs Sensing of Multiple Targets Using an FSK Radar , 2021, IEEE Transactions on Microwave Theory and Techniques.

[43]  Eric Campo,et al.  A review of smart homes - Present state and future challenges , 2008, Comput. Methods Programs Biomed..

[44]  Chao Cai,et al.  Smart Home Based on WiFi Sensing: A Survey , 2018, IEEE Access.

[45]  Jun Wang,et al.  Clutter Cancellation Based on Frequency Domain Analysis in Passive Bistatic Radar , 2020, IEEE Access.