Boosting fine-grained activity sensing by embracing wireless multipath effects

With a big success in data communication, wireless signals are now exploited for fine-grained contactless activity sensing including human respiration monitoring, finger gesture recognition, subtle chin movement tracking when speaking, etc. Different from coarsegrained body and limb movements, these fine-grained movements are in the scale of millimetres and are thus difficult to be sensed. While good sensing performance can be achieved at one location, the performance degrades dramatically at a very nearby location. In this paper, by revealing the effect of static multipaths in sensing, we propose a novel method to add man-made "virtual" multipath to significantly improve the sensing performance. With carefully designed "virtual" multipath, we are able to boost the sensing performance at each location purely in software without any extra hardware. We demonstrate the effectiveness of the proposed method on three fine-grained sensing applications with just one Wi-Fi transceiver-pair, each equipped with a single antenna. For respiration monitoring, we can remove the "blind spots" and achieve full coverage respiration sensing. For finger gesture recognition, our system can significantly increase the recognition accuracy from 33% to 81%. For chin movement tracking, we are able to count the number of spoken syllables in a sentence at an accuracy of 92.8%.

[1]  Muhammad Shahzad,et al.  Position and Orientation Agnostic Gesture Recognition Using WiFi , 2017, MobiSys.

[2]  Xinyu Zhang,et al.  mTrack: High-Precision Passive Tracking Using Millimeter Wave Radios , 2015, MobiCom.

[3]  Xiaohui Liang,et al.  When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals , 2016, CCS.

[4]  Dan Wu,et al.  WiDir: walking direction estimation using wireless signals , 2016, UbiComp.

[5]  Li Sun,et al.  WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices , 2015, MobiCom.

[6]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[7]  Dan Wu,et al.  MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards , 2017, ArXiv.

[8]  Wei Wang,et al.  Recognizing Keystrokes Using WiFi Devices , 2017, IEEE Journal on Selected Areas in Communications.

[9]  Chen Wang,et al.  Low Human-Effort, Device-Free Localization with Fine-Grained Subcarrier Information , 2018, IEEE Transactions on Mobile Computing.

[10]  Tommi S. Jaakkola,et al.  Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture , 2017, ICML.

[11]  Charles X. Ling,et al.  A Reliable People Counting System via Multiple Cameras , 2012, TIST.

[12]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[13]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[14]  Dan Wu,et al.  Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals , 2017, Computer.

[15]  Dina Katabi,et al.  Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[16]  S. Venkatesh,et al.  Implementation and analysis of respiration-rate estimation using impulse-based UWB , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[17]  Jie Xiong,et al.  ToneTrack: Leveraging Frequency-Agile Radios for Time-Based Indoor Wireless Localization , 2015, MobiCom.

[18]  Harris Drucker,et al.  Comparison of learning algorithms for handwritten digit recognition , 1995 .

[19]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[20]  Dan Wu,et al.  Human respiration detection with commodity wifi devices: do user location and body orientation matter? , 2016, UbiComp.

[21]  Fadel Adib,et al.  Multi-Person Localization via RF Body Reflections , 2015, NSDI.

[22]  Yang Xu,et al.  WiFinger: talk to your smart devices with finger-grained gesture , 2016, UbiComp.

[23]  Rong Luo,et al.  Design and Implementation of a WiFi-Based Local Locating System , 2007, 2007 IEEE International Conference on Portable Information Devices.

[24]  Zimu Zhou,et al.  Enabling Gesture-based Interactions with Objects , 2017, MobiSys.

[25]  Xu Chen,et al.  Tracking Vital Signs During Sleep Leveraging Off-the-shelf WiFi , 2015, MobiHoc.

[26]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[27]  Rob Miller,et al.  Smart Homes that Monitor Breathing and Heart Rate , 2015, CHI.

[28]  Parameswaran Ramanathan,et al.  Leveraging directional antenna capabilities for fine-grained gesture recognition , 2014, UbiComp.

[29]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2014, IEEE Transactions on Mobile Computing.

[30]  Ronald W. Schafer,et al.  What Is a Savitzky-Golay Filter? [Lecture Notes] , 2011, IEEE Signal Processing Magazine.

[31]  Xiang Li,et al.  Dynamic-MUSIC: accurate device-free indoor localization , 2016, UbiComp.

[32]  Beihong Jin,et al.  From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[33]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[34]  Tingting Zhang,et al.  A Low Complexity Asynchronous UWB TDOA Localization Method , 2015, Int. J. Distributed Sens. Networks.

[35]  Xiang Li,et al.  Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches , 2017, IEEE Communications Magazine.

[36]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[37]  Dina Katabi,et al.  Extracting Gait Velocity and Stride Length from Surrounding Radio Signals , 2017, CHI.

[38]  Shaojie Tang,et al.  Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals , 2014, 2014 IEEE Real-Time Systems Symposium.

[39]  Yunhao Liu,et al.  Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames , 2017, CHI.

[40]  Ιωάννης Μανώλης,et al.  Οδηγός για το Raspberry Pi 3 Model B , 2017 .

[41]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.