WIBECAM: Device Free Human Activity Recognition Through WiFi Beacon-Enabled Camera

This paper presents WIBECAM, a Human Activity Recognition system which does not require neither user instrumentation, nor specialized infrastructure, nor active operation - it passively leverages Beacon frames periodically emitted by a single off-the-shelf Wi-Fi access point. As many other recent proposals, WIBECAM also exploits the different multipath conditions (and their temporal variations) induced by human activity. In most of the previously proposed systems, the classification is based on the characterization of the signal strength variations, caused by the human activity. WIBECAM's main distinguishing aspect is that it 'watches' the channel in the frequency domain where spectral metrics, calculated on the raw signal samples of the received Beacon frames, are like 'snapshots' of the channel taken in a regular and periodical way. The classification process uses properly selected features that measure the changes of consecutive 'snapshots'. WIBECAM adapts to any Wi-Fi access point (and may comply even with legacy 802.11b-only ones), as it does not exploit neither OFDM and CSI extracted from the receiver, nor MIMO/multiple antennas. WIBECAM has been built into USRP software radios. Its classification accuracy has been preliminarily assessed for four different activities in two different environments; the resulting confusion matrices show very promising performance.

[1]  Lu Wang,et al.  FIMD: Fine-grained Device-free Motion Detection , 2012, 2012 IEEE 18th International Conference on Parallel and Distributed Systems.

[2]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[3]  Moustafa Youssef,et al.  Robust WLAN Device-free Passive motion detection , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[4]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[5]  Pierfrancesco Lombardo,et al.  WiFi-Based Passive Bistatic Radar: Data Processing Schemes and Experimental Results , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[6]  David Wetherall,et al.  Predictable 802.11 packet delivery from wireless channel measurements , 2010, SIGCOMM '10.

[7]  Gerhard Tröster,et al.  The telepathic phone: Frictionless activity recognition from WiFi-RSSI , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[8]  Moustafa Youssef,et al.  CoSDEO 2016 Keynote: A decade later — Challenges: Device-free passive localization for wireless environments , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[9]  Lionel M. Ni,et al.  An RF-Based System for Tracking Transceiver-Free Objects , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom'07).

[10]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[11]  Yusheng Ji,et al.  RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals , 2014, IEEE Transactions on Mobile Computing.

[12]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[13]  Moustafa Youssef,et al.  RASID: A robust WLAN device-free passive motion detection system , 2011, 2012 IEEE International Conference on Pervasive Computing and Communications.