Exploring the Sensing Capability of Wireless Signals

Wireless communications are ubiquitous nowadays, especially in the new era of Internet of Things (IoT). Most of IoT devices access the Internet via some kind of wireless connections. The major role of wireless signals is a type of communication medium. Besides that, taking advantage of the growing physical layer capabilities of wireless techniques, recent research has demonstrated the possibility of reusing wireless signals for both communication and sensing. The capability of wireless sensing and the ubiquitous availability of wireless signals make it possible to meet the rising demand of pervasive environment perception. Physical layer features including signal attributes and channel state information (CSI) can be used for the purpose of physical world sensing. This dissertation focuses on exploring the sensing capability of wireless signals. The research approach is to first take measurements from physical layer of wireless connections, and then develop various techniques to extract or infer information about the environment from the measurements, like the locations of signal sources, the motion of human body, etc. The research work in this dissertation makes three contributions. We start from wireless signal attributes analysis. Specifically, the cyclostationarity properties of wireless signals are studied. Taking WiFi signals as an example, we propose signal cyclostationarity models induced by WiFi Orthogonal Frequency Division Multiplexing (OFDM) structure including pilots, cyclic prefix, and preambles. The induced cyclic frequencies is then applied to the signal-selective direction estimation problem. Second, based on the analysis of wireless signal attributes, we design and implement a prototype of a single device system, named MobTrack, which can locate indoor interfering radios. The goal of designing MobTrack is to provide a lightweight, handhold system that can locate interfering radios with sub-meter accuracy with as few antennas as possible. With a small antenna array, the cost, complexity as well as size of this device are reduced. MobTrack is the first single device indoor interference localization system without the requirement of multiple pre-deployed access points (AP). Third, channel state information is studied in applications of human motion sensing. We design WiTalk, the first system which is able to do fine-grained motion sensing like leap reading on smartphones using the CSI dynamics generated by human movements. WiTalk proposes a new fine-grained human motion sensing technique with the distinct contextfree feature. To achieve this goal using CSI, WiTalk generates CSI spectrograms using signal processing techniques and extracts features by calculating the contours of the CSI spectrograms. The proposed technique is verified in the application scenario of lip reading, where the fine-grained motion is the mouth movements. Exploring the Sensing Capability of Wireless Signals

[1]  Chatschik Bisdikian,et al.  An overview of the Bluetooth wireless technology , 2001, IEEE Commun. Mag..

[2]  Philippe Ciblat,et al.  OFDM System Identification for Cognitive Radio Based on Pilot-Induced Cyclostationarity , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[3]  David Chu,et al.  SwordFight: enabling a new class of phone-to-phone action games on commodity phones , 2012, MobiSys '12.

[4]  Yide Wang,et al.  An extended cyclic music algorithm , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[6]  Parth H. Pathak,et al.  Visible Light Communication, Networking, and Sensing: A Survey, Potential and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[7]  Anass Benjebbour,et al.  Cyclostationarity-Inducing Transmission Methods for Recognition among OFDM-Based Systems , 2008, EURASIP J. Wirel. Commun. Netw..

[8]  Steven R. Schnur Identification and classification of OFDM based signals using preamble correlation and cyclostationary feature extraction , 2009 .

[9]  Shlomi Arnon Visible Light Communication , 2015 .

[10]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[11]  Zhu Cao,et al.  Direct counterfactual communication via quantum Zeno effect , 2017, Proceedings of the National Academy of Sciences.

[12]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[13]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[14]  Colin L. Mallows,et al.  A system for LEASE: location estimation assisted by stationary emitters for indoor RF wireless networks , 2004, IEEE INFOCOM 2004.

[15]  Cam-Tu Nguyen,et al.  SilentTalk: Lip reading through ultrasonic sensing on mobile phones , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[16]  Aditi Malik,et al.  Free Space Optics: Current Applications and Future Challenges , 2015 .

[17]  P. McDermott-Wells,et al.  What is Bluetooth? , 2005, IEEE Potentials.

[18]  Xiaolin Li,et al.  Towards accurate acoustic localization on a smartphone , 2013, 2013 Proceedings IEEE INFOCOM.

[19]  Rohit Negi,et al.  Guaranteeing Secrecy using Artificial Noise , 2008, IEEE Transactions on Wireless Communications.

[20]  Cellular,et al.  Ganong's review of medical physiology , 2016 .

[21]  Dave Evans,et al.  How the Next Evolution of the Internet Is Changing Everything , 2011 .

[22]  Murat Uysal,et al.  Survey on Free Space Optical Communication: A Communication Theory Perspective , 2014, IEEE Communications Surveys & Tutorials.

[23]  Yunhao Liu,et al.  From RSSI to CSI , 2013, ACM Comput. Surv..

[24]  Shoji Kawahito,et al.  A New Automotive VLC System Using Optical Communication Image Sensor , 2016, IEEE Photonics Journal.

[25]  Jie Yang,et al.  Hearing Your Voice is Not Enough: An Articulatory Gesture Based Liveness Detection for Voice Authentication , 2017, CCS.

[26]  Bing Chen,et al.  Wi-Wri: Fine-Grained Writing Recognition Using Wi-Fi Signals , 2016, 2016 IEEE Trustcom/BigDataSE/ISPA.

[27]  Marwan Krunz,et al.  Secrecy beyond encryption: obfuscating transmission signatures in wireless communications , 2015, IEEE Communications Magazine.

[28]  Li Sun,et al.  WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices , 2015, MobiCom.

[29]  Hai-Han Lu,et al.  A 56 Gb/s PAM4 VCSEL-Based LiFi Transmission With Two-Stage Injection-Locked Technique , 2017, IEEE Photonics Journal.

[30]  Sridhar Rajagopal,et al.  IEEE 802.15.7 visible light communication: modulation schemes and dimming support , 2012, IEEE Communications Magazine.

[31]  Frédo Durand,et al.  The visual microphone , 2014, ACM Trans. Graph..

[32]  Roy Want,et al.  An introduction to RFID technology , 2006, IEEE Pervasive Computing.

[33]  Chuan Li,et al.  Short-range ultrasonic digital communications in air , 2008, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[34]  W. Gardner Exploitation of spectral redundancy in cyclostationary signals , 1991, IEEE Signal Processing Magazine.

[35]  Kostas E. Bekris,et al.  Robotics-Based Location Sensing Using Wireless Ethernet , 2005, Wirel. Networks.

[36]  Shoji Kawahito,et al.  Image-sensor-based visible light communication for automotive applications , 2014, IEEE Communications Magazine.

[37]  Sachin Katti,et al.  PinPoint: Localizing Interfering Radios , 2013, NSDI.

[38]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[39]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[40]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[41]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[42]  Lajos Hanzo,et al.  A Survey on Wireless Security: Technical Challenges, Recent Advances, and Future Trends , 2015, Proceedings of the IEEE.

[43]  Sneha Kumar Kasera,et al.  Secret Key Extraction from Wireless Signal Strength in Real Environments , 2009, IEEE Transactions on Mobile Computing.

[44]  Sachin Katti,et al.  DOF: a local wireless information plane , 2011, SIGCOMM 2011.

[45]  G.B. Giannakis,et al.  Localization via ultra-wideband radios: a look at positioning aspects for future sensor networks , 2005, IEEE Signal Processing Magazine.

[46]  Kenneth S. Suslick,et al.  Ultrasound: Its Chemical, Physical, and Biological Effects , 1988 .

[47]  Junqing Zhang,et al.  Efficient Key Generation by Exploiting Randomness From Channel Responses of Individual OFDM Subcarriers , 2016, IEEE Transactions on Communications.

[48]  Rafael F. Schaefer,et al.  Wireless physical layer security , 2016, Proceedings of the National Academy of Sciences.

[49]  Dan Wu,et al.  Human respiration detection with commodity wifi devices: do user location and body orientation matter? , 2016, UbiComp.

[50]  Tadayoshi Kohno,et al.  CovertBand , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[51]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[52]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2016, IEEE Trans. Mob. Comput..

[53]  Linda Doyle,et al.  Cyclostationary Signatures in Practical Cognitive Radio Applications , 2008, IEEE Journal on Selected Areas in Communications.

[54]  Marcos E. Castro,et al.  CYCLOSTATIONARY DETECTION FOR OFDM IN COGNITIVE RADIO S YSTEMS , 2011 .

[55]  Susumu Yoshida,et al.  Multipath delay estimation for indoor wireless communication , 1990, 40th IEEE Conference on Vehicular Technology.

[56]  Thomas Kailath,et al.  On spatial smoothing for direction-of-arrival estimation of coherent signals , 1985, IEEE Trans. Acoust. Speech Signal Process..

[57]  Svilen Dimitrov,et al.  Principles of LED Light Communications: Towards Networked Li-Fi , 2015 .

[58]  Chatschik Bisdikian,et al.  Bluetooth Revealed: The Insider's Guide to an Open Specification for Global Wireless Communications , 2001 .

[59]  Kannan Srinivasan,et al.  Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals , 2016, CoNEXT.

[60]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[61]  Yiqiang Yu,et al.  Introduction to Direction-Of-Arrival Estimation , 2010 .

[62]  Qian Xu,et al.  Experimental Study on Key Generation for Physical Layer Security in Wireless Communications , 2016, IEEE Access.

[63]  Joon Son Chung,et al.  Lip Reading Sentences in the Wild , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Xu Chen,et al.  Tracking Vital Signs During Sleep Leveraging Off-the-shelf WiFi , 2015, MobiHoc.

[65]  Kin K. Leung,et al.  A Survey of Indoor Localization Systems and Technologies , 2017, IEEE Communications Surveys & Tutorials.

[66]  Venkata N. Padmanabhan,et al.  Indoor localization without the pain , 2010, MobiCom.

[67]  Wade Trappe,et al.  Radio-telepathy: extracting a secret key from an unauthenticated wireless channel , 2008, MobiCom '08.

[68]  石井彻,et al.  The radar system , 2005 .

[69]  L. Vaidman,et al.  Quantum mechanical interaction-free measurements , 1993, hep-th/9305002.

[70]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[71]  Jue Wang,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2015, SIGCOMM 2015.

[72]  Zheng Yang,et al.  Sensorless Sensing with WiFi , 2015 .

[73]  Venkata N. Padmanabhan,et al.  Centaur: locating devices in an office environment , 2012, Mobicom '12.

[74]  Mostafa Zaman Chowdhury,et al.  A Comparative Survey of Optical Wireless Technologies: Architectures and Applications , 2018, IEEE Access.

[75]  Sheng Tan,et al.  WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition , 2016, MobiHoc.

[76]  Linglong Dai,et al.  Secure communication in TDS-OFDM system using constellation rotation and noise insertion , 2010, IEEE Transactions on Consumer Electronics.

[77]  Kaishun Wu,et al.  CSI-Based Indoor Localization , 2013, IEEE Transactions on Parallel and Distributed Systems.

[78]  Xiaohui Liang,et al.  When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals , 2016, CCS.

[79]  Junqing Zhang,et al.  On the Key Generation From Correlated Wireless Channels , 2017, IEEE Communications Letters.

[80]  Moustafa Youssef,et al.  The Horus WLAN location determination system , 2005, MobiSys '05.

[81]  Junqing Zhang,et al.  Securing Wireless Communications of the Internet of Things from the Physical Layer, An Overview , 2017, Entropy.

[82]  D. L. Begley,et al.  "Free-space laser communications: a historical perspective" , 2002, The 15th Annual Meeting of the IEEE Lasers and Electro-Optics Society.

[83]  Stefano Chessa,et al.  Wireless sensor networks: A survey on the state of the art and the 802.15.4 and ZigBee standards , 2007, Comput. Commun..

[84]  K. Woyach,et al.  Sensorless Sensing in Wireless Networks: Implementation and Measurements , 2006, 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks.

[85]  Tom Minka,et al.  You are facing the Mona Lisa: spot localization using PHY layer information , 2012, MobiSys '12.

[86]  Kyu-Han Kim,et al.  TypingRing: A Wearable Ring Platform for Text Input , 2015, MobiSys.

[87]  Parth H. Pathak,et al.  Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch , 2015, HotMobile.

[88]  Thomas L. Szabo,et al.  Diagnostic Ultrasound Imaging: Inside Out , 2004 .

[89]  Min Gao,et al.  FILA: Fine-grained indoor localization , 2012, 2012 Proceedings IEEE INFOCOM.

[90]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[91]  Srihari Nelakuditi,et al.  SpinLoc: spin once to know your location , 2012, HotMobile '12.

[92]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[93]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[94]  Tsuhan Chen,et al.  Profile View Lip Reading , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[95]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[96]  J. Flanagan,et al.  Human jaw movement in mastication and speech. , 1989, Archives of oral biology.

[97]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[98]  B. G. Agee,et al.  Cyclic MUSIC algorithms for signal-selective direction estimation , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[99]  Shinji Maeda,et al.  Mechanical properties of lip movements: How to characterize different speaking styles? , 2003 .

[100]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[101]  W. A. Brown,et al.  Computationally efficient algorithms for cyclic spectral analysis , 1991, IEEE Signal Processing Magazine.

[102]  Xianda Zhang,et al.  An improved signal-selective direction finding algorithm using second-order cyclic statistics , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[103]  Ted Kremenek,et al.  A Probabilistic Room Location Service for Wireless Networked Environments , 2001, UbiComp.

[104]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[105]  Hirozumi Yamaguchi,et al.  Wi-Fi Channel Selection Based on Urban Interference Measurement , 2016, MobiQuitous.

[106]  Weiwei Hu,et al.  Accuracy of Ranging Based on DMT Visible Light Communication for Indoor Positioning , 2017, IEEE Photonics Technology Letters.

[107]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[108]  Klaus Finkenzeller,et al.  Rfid Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification , 2003 .

[109]  Jim Geier Designing and Deploying 802.11n Wireless Networks , 2010 .

[110]  Alexander H. Waibel,et al.  Toward movement-invariant automatic lip-reading and speech recognition , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[111]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[112]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[113]  J. Landt,et al.  The history of RFID , 2005, IEEE Potentials.

[114]  Junqing Zhang,et al.  Key Generation From Wireless Channels: A Review , 2016, IEEE Access.

[115]  Harald Haas,et al.  Indoor optical wireless communication: potential and state-of-the-art , 2011, IEEE Communications Magazine.

[116]  Jeffrey H. Reed,et al.  Cyclostationary Approaches to Signal Detection and Classification in Cognitive Radio , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[117]  Swarun Kumar,et al.  Accurate indoor localization with zero start-up cost , 2014, MobiCom.

[118]  Janusz Gozdecki,et al.  Wireless link prediction and triggering using modified Ornstein–Uhlenbeck jump diffusion process , 2014, Wirel. Networks.

[119]  P Pignoli,et al.  Intimal plus medial thickness of the arterial wall: a direct measurement with ultrasound imaging. , 1986, Circulation.

[120]  C. Manikopoulos,et al.  A Quantitative Analysis of Power Consumption for Location-Aware Applications on Smart Phones , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[121]  Kyu-Han Kim,et al.  SAIL: single access point-based indoor localization , 2014, MobiSys.

[122]  Yu-Wei Su,et al.  A Comparative Study of Wireless Protocols: Bluetooth, UWB, ZigBee, and Wi-Fi , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[123]  Wade Trappe,et al.  Low-Energy Security: Limits and Opportunities in the Internet of Things , 2015, IEEE Security & Privacy.

[124]  M.G. Bellanger,et al.  Digital processing of speech signals , 1980, Proceedings of the IEEE.

[125]  Andreas Haeberlen,et al.  Practical robust localization over large-scale 802.11 wireless networks , 2004, MobiCom '04.

[126]  Xiaonan Guo,et al.  On distinguishing the multiple radio paths in RSS-based ranging , 2012, 2012 Proceedings IEEE INFOCOM.

[127]  A. Lee Swindlehurst,et al.  Robust Beamforming for Security in MIMO Wiretap Channels With Imperfect CSI , 2010, IEEE Transactions on Signal Processing.

[128]  Hatim Salih,et al.  Protocol for direct counterfactual quantum communication. , 2012, Physical review letters.

[129]  Jie Yang,et al.  Push the limit of WiFi based localization for smartphones , 2012, Mobicom '12.

[130]  Harald Haas,et al.  What is LiFi? , 2015, 2015 European Conference on Optical Communication (ECOC).

[131]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[132]  Swarun Kumar,et al.  Decimeter-Level Localization with a Single WiFi Access Point , 2016, NSDI.