Contact-free sensing for collective activity recognition

We are surrounded by a multitude of communicating sensing devices. Furnished with wearables to serve our very needs, we traverse sensor-rich environments of smart cities. Through new open standards and novel protocols this loose collection of devices increasingly evolves into a superorganism of wearables and environmental devices. All these devices share a single ubiquitous sensor type: the RF-interface. Ubiquitously available signals from e.g. FM-radio, WiFi or UMTS can be exploited as sensor for presence, location, crowd-size, activity or gestures [4, 1, 2]. On-site training of these systems will soon be replaced by offline-raytracing techniques [3] and recognition accuracies will further increase with the Channel State Information (CSI) on recent OFDM receivers. In contrast to RSSI, CSI features channel response information as a PHY layer power feature, revealing amplitudes and phases of each subcarrier (cf. Figure 2). Exemplary, enabled by this superorganism of wireless devices, we envision the advance of sentiment sensing, smart city architectures as well as autonomous intelligent spaces.

[1]  Moustafa Youssef,et al.  Device-Free Radio-based Low Overhead Identification of Subject Classes , 2015, WPA@MobiSys.

[2]  Gerhard Tröster,et al.  The telepathic phone: Frictionless activity recognition from WiFi-RSSI , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[3]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[4]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.