Gait Recognition for Co-Existing Multiple People Using Millimeter Wave Sensing

Gait recognition, i.e., recognizing persons from their walking postures, has found versatile applications in security check, health monitoring, and novel human-computer interaction. The millimeter-wave (mmWave) based gait recognition represents the most recent advance. Compared with traditional camera-based solutions, mmWave based gait recognition bears unique advantages of being still effective under non-line-of-sight scenarios, such as in black, weak light, or blockage conditions. Moreover, they are able to accomplish person identification while preserving privacy. Currently, there are only few works in mmWave gait recognition, since no public data set is available. In this paper, we build a first-of-its-kind mmWave gait data set, in which we collect gait of 95 volunteers 'seen' from two mmWave radars in two different scenarios, which together lasts about 30 hours. Using the data set, we propose a novel deep-learning driven mmWave gait recognition method called mmGaitNet, and compare it with five state-of-the-art algorithms. We find that mmGaitNet is able to achieve 90% accuracy for single-person scenarios, 88% accuracy for five co-existing persons, while the existing methods achieve less than 66% accuracy for both scenarios.

[1]  Jianfeng Feng,et al.  GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition , 2018, AAAI.

[2]  Xiang Li,et al.  Joint Intensity and Spatial Metric Learning for Robust Gait Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[4]  Shu Wang,et al.  Acoustic Eavesdropping through Wireless Vibrometry , 2015, MobiCom.

[5]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[6]  Wu Liu,et al.  Attentive Spatial–Temporal Summary Networks for Feature Learning in Irregular Gait Recognition , 2019, IEEE Transactions on Multimedia.

[7]  Andrew Markham,et al.  mID: Tracking and Identifying People with Millimeter Wave Radar , 2019, 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS).

[8]  Ju Wang,et al.  TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices , 2017, MobiCom.

[9]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[10]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[13]  Jerry L. Eaves,et al.  Principles of Modern Radar , 1987 .

[14]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[15]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Shaoyuan Yang,et al.  Autonomous Environment Mapping Using Commodity Millimeter-wave Network Device , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[17]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[18]  Song Wang,et al.  Robot Navigation in Radio Beam Space: Leveraging Robotic Intelligence for Seamless mmWave Network Coverage , 2019, MobiHoc.

[19]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[20]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[21]  Wu Liu,et al.  Beyond View Transformation: Cycle-Consistent Global and Partial Perception Gan for View-Invariant Gait Recognition , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[22]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[23]  Parth H. Pathak,et al.  Monitoring vital signs using millimeter wave , 2016, MobiHoc.

[24]  Han Zou,et al.  WiFi-Based Human Identification via Convex Tensor Shapelet Learning , 2018, AAAI.