Motion Sensing Using Radar: Gesture Interaction and Beyond

Since the debut of iOS and Android smartphones 10 years ago, the world has seen a mobile era wherein our phones have become a mobile computing platform deeply integrated into our lives [1]-[4]. Due to the advancement of computing, it is believed that the world is shifting to a new era where artificial intelligence (AI) is unlocking capabilities that were previously unthinkable [5]-[13]. Because computing is becoming more universally available, interaction with computing devices needs to be much more natural, intuitive, and, above all, intelligent [14].

[1]  Ralf Klamma,et al.  Mobile Community Cloud Computing: Emerges and Evolves , 2010, 2010 Eleventh International Conference on Mobile Data Management.

[2]  Jiang Long,et al.  Instrument-Based Noncontact Doppler Radar Vital Sign Detection System Using Heterodyne Digital Quadrature Demodulation Architecture , 2010, IEEE Transactions on Instrumentation and Measurement.

[3]  Manolya Kavakli,et al.  A survey of speech-hand gesture recognition for the development of multimodal interfaces in computer games , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[4]  ROBERT WATSON-WATT.  Radar in War and in Peace , 1945, Nature.

[5]  Changzhan Gu,et al.  From Tumor Targeting to Speech Monitoring: Accurate Respiratory Monitoring Using Medical Continuous-Wave Radar Sensors , 2014, IEEE Microwave Magazine.

[6]  Kun-mu Chen,et al.  An X-Band Microwave Life-Detection System , 1986, IEEE Transactions on Biomedical Engineering.

[7]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[8]  Scott W. Campbell,et al.  Mobile Communication and Civic Life: Linking Patterns of Use to Civic and Political Engagement , 2010 .

[9]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Paolo Bernardi,et al.  Design, Realization, and Test of a UWB Radar Sensor for Breath Activity Monitoring , 2014, IEEE Sensors Journal.

[12]  Olga Boric-Lubecke,et al.  Doppler radar occupancy sensor for small-range motion detection , 2017, 2017 IEEE Asia Pacific Microwave Conference (APMC).

[13]  Paul Leroux,et al.  Analysis of an Indoor Biomedical Radar-Based System for Health Monitoring , 2013, IEEE Transactions on Microwave Theory and Techniques.

[14]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[15]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[16]  Wenyao Xu,et al.  SleepSense: A Noncontact and Cost-Effective Sleep Monitoring System , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[17]  Changzhan Gu,et al.  Application of Linear-Frequency-Modulated Continuous-Wave (LFMCW) Radars for Tracking of Vital Signs , 2014, IEEE Transactions on Microwave Theory and Techniques.

[18]  J.C. Lin.  Noninvasive microwave measurement of respiration , 1975, Proceedings of the IEEE.

[19]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Changzhan Gu,et al.  A Two-Tone Radar Sensor for Concurrent Detection of Absolute Distance and Relative Movement for Gesture Sensing , 2017, IEEE Sensors Letters.

[21]  Thomas Zwick,et al.  Impact of Frequency Ramp Nonlinearity, Phase Noise, and SNR on FMCW Radar Accuracy , 2016, IEEE Transactions on Microwave Theory and Techniques.

[22]  Zhiwei Xiong,et al.  Hybrid structured light for scalable depth sensing , 2012, 2012 19th IEEE International Conference on Image Processing.

[23]  Tzyy-Sheng Horng,et al.  Gesture Sensing Using Retransmitted Wireless Communication Signals Based on Doppler Radar Technology , 2015, IEEE Transactions on Microwave Theory and Techniques.

[24]  Steve B. Jiang,et al.  Accurate Respiration Measurement Using DC-Coupled Continuous-Wave Radar Sensor for Motion-Adaptive Cancer Radiotherapy , 2012, IEEE Transactions on Biomedical Engineering.

[25]  Changzhi Li,et al.  A Portable $K$ -Band 3-D MIMO Radar With Nonuniformly Spaced Array for Short-Range Localization , 2018, IEEE Transactions on Microwave Theory and Techniques.

[26]  Changzhan Gu,et al.  Physiological Radar Sensor Chip Development , 2017 .

[27]  Changzhi Li,et al.  Microwave Noncontact Motion Sensing and Analysis: Li/Microwave Noncontact Motion Sensing and Analysis , 2013 .

[28]  Changzhi Li,et al.  Random Body Movement Cancellation in Doppler Radar Vital Sign Detection , 2008, IEEE Transactions on Microwave Theory and Techniques.

[29]  Changzhi Li,et al.  A Portable FMCW Interferometry Radar With Programmable Low-IF Architecture for Localization, ISAR Imaging, and Vital Sign Tracking , 2017, IEEE Transactions on Microwave Theory and Techniques.

[30]  Huimin Lu,et al.  Depth Map Reconstruction for Underwater Kinect Camera Using Inpainting and Local Image Mode Filtering , 2017, IEEE Access.

[31]  N.J.S. Stacy,et al.  Ingara: an integrated airborne imaging radar system , 1996, IGARSS '96. 1996 International Geoscience and Remote Sensing Symposium.

[32]  J. Kostamovaara,et al.  Precise pulsed time-of-flight laser range finder for industrial distance measurements , 2001 .

[33]  Luke Dormehl,et al.  Thinking Machines: The Quest for Artificial Intelligence--and Where It's Taking Us Next , 2017 .

[34]  Martin Schneider,et al.  Automotive Radar – Status and Trends , 2005 .

[35]  Yan Zhang,et al.  The Atmospheric Imaging Radar (AIR) for high-resolution observations of severe weather , 2011, 2011 IEEE RadarCon (RADAR).

[36]  Maciej Wojnowski,et al.  A Highly Integrated 60 GHz 6-Channel Transceiver With Antenna in Package for Smart Sensing and Short-Range Communications , 2016, IEEE Journal of Solid-State Circuits.

[37]  M. Ash,et al.  Determination of Sweep Linearity Requirements in FMCW Radar Systems Based on Simple Voltage-Controlled Oscillator Sources , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[39]  Changzhi Li,et al.  A Review on Recent Advances in Doppler Radar Sensors for Noncontact Healthcare Monitoring , 2013, IEEE Transactions on Microwave Theory and Techniques.

[40]  Changzhan Gu,et al.  A multi-radar wireless system for respiratory gating and accurate tumor tracking in lung cancer radiotherapy , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Jenshan Lin,et al.  Digitally assisted low IF architecture for noncontact vital sign detection , 2015, 2015 IEEE MTT-S International Microwave Symposium.

[42]  O. Adrian.  Future Surface Radar technology: From Air Defence to Air and Missile Defence , 2007, 2007 IEEE Radar Conference.

[43]  Christian Waldschmidt,et al.  Future trends and directions in radar concerning the application for autonomous driving , 2014, 2014 44th European Microwave Conference.

[44]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[46]  Shumin Zhai,et al.  The influence of muscle groups on performance of multiple degree-of-freedom input , 1996, CHI.

[47]  Steve Wheeler,et al.  How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX , 2011, Biomedical engineering online.

[48]  Olga Boric-Lubecke,et al.  System-on-Chip based Doppler radar occupancy sensor , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Robert Weigel,et al.  A D-band transceiver front-end for broadband applications in a 0.35μm SiGe bipolar technology , 2014, 2014 IEEE Radio Frequency Integrated Circuits Symposium.

[50]  Patrick Schrempf,et al.  RadarCat: Radar Categorization for Input & Interaction , 2016, UIST.

[51]  Yong Huang,et al.  Microwave life-detection systems for searching human subjects under earthquake rubble or behind barrier , 2000, IEEE Transactions on Biomedical Engineering.

[52]  Rafiqul Zaman Khan,et al.  Survey on Various Gesture Recognition Technologies and Techniques , 2012 .

[53]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[54]  M. Murad,et al.  Requirements for next generation automotive radars , 2013, 2013 IEEE Radar Conference (RadarCon13).

[55]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[56]  Changzhi Li,et al.  A $K$ -Band Portable FMCW Radar With Beamforming Array for Short-Range Localization and Vital-Doppler Targets Discrimination , 2017, IEEE Transactions on Microwave Theory and Techniques.

[57]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[58]  Changzhi Li,et al.  A Review on Recent Progress of Portable Short-Range Noncontact Microwave Radar Systems , 2017, IEEE Transactions on Microwave Theory and Techniques.

[59]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[60]  P. D. L. Williams,et al.  Civil Marine Radar – A Review and a Way Ahead , 1998, Journal of Navigation.

[61]  T.J. Nohara,et al.  Low-cost radar surveillance of inland waterways for homeland security applications , 2004, Proceedings of the 2004 IEEE Radar Conference (IEEE Cat. No.04CH37509).

[62]  Wenjing Su,et al.  Radar & additive manufacturing technologies: The future of Internet of Things (IoT) , 2018, 2018 IEEE Radar Conference (RadarConf18).

[63]  Changzhan Gu,et al.  Short-Range Noncontact Sensors for Healthcare and Other Emerging Applications: A Review , 2016, Sensors.

[64]  Changzhi Li,et al.  An FMCW radar sensor for human gesture recognition in the presence of multiple targets , 2017, 2017 First IEEE MTT-S International Microwave Bio Conference (IMBIOC).

[65]  Tatsuya Hirose,et al.  A 77GHz transceiver in 90nm CMOS , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[66]  Francisco Bernardo,et al.  O soli mio: exploring millimeter wave radar for musical interaction , 2017, NIME.

[67]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[68]  Olga Boric-Lubecke,et al.  Benefits of Coherent Low-IF for Vital Signs Monitoring Using Doppler Radar , 2014, IEEE Transactions on Microwave Theory and Techniques.

[69]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Changzhi Li,et al.  Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors , 2016, IEEE Transactions on Microwave Theory and Techniques.

[71]  Changzhan Gu,et al.  A Hybrid FMCW-Interferometry Radar for Indoor Precise Positioning and Versatile Life Activity Monitoring , 2014, IEEE Transactions on Microwave Theory and Techniques.

[72]  Majid Sarrafzadeh,et al.  A Self-Calibrating Radar Sensor System for Measuring Vital Signs , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[73]  A.E. Fathy,et al.  Through-the-Wall Radar Life Detection and Monitoring , 2007, 2007 IEEE/MTT-S International Microwave Symposium.

[74]  Alexander G. Hauptmann,et al.  Speech and gestures for graphic image manipulation , 1989, CHI '89.

[75]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[76]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[77]  Olga Boric-Lubecke,et al.  Doppler radar sensor for occupancy monitoring , 2013, 2013 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems.

[78]  Changzhi Li,et al.  Overview of Recent Development on Wireless Sensing Circuits and Systems for Healthcare and Biomedical Applications , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.