DeepPIRATES: A Training-Light PIR-Based Localization Method With High Generalization Ability

Pyroelectric infrared (PIR) sensors are much promising for device-free localization (DFL) due to their advantages of lower cost, low power consumption, and privacy protection. Most PIR-based localization methods usually assume some geometric models according to the detection principle of PIR sensors, which are however not accurate or robust due to the various cases of infrared radiation from human body, especially the case of multiple persons. Recently, deep learning is utilized in the PIR-based localization method (i.e. PIRNet Yang et al.) and well handles the complex infrared radiation even in the multi-person case. However, this method requires a high training cost, and has very weak generalization ability as it assumes the PIR sensors’ deployment in the testing environment is same to the deployment in training environment. To reduce the training cost and achieve high generalization ability, in this paper, we propose a robust method DeepPIRATES, which can be directly utilized in various deployment scenarios without retraining. DeepPIRATES combines deep learning and a geometric model. Specifically, DeepPIRATES divides the localization task into two steps. The first step utilizes a neural network to estimate the azimuth changes of multiple persons to a PIR sensor. Then, DeepPIRATES utilizes the persons’ azimuth changes to infer their locations based on a geometric model. Extensive experimental results show that DeepPIRATES can achieve similar localization accuracy as PIRNet, while does not require to be retrained when the sensor deployment changes.

[1]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[2]  Ashish Pandharipande,et al.  Indoor user zoning and tracking in passive infrared sensing systems , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[3]  Tomas Pfister,et al.  Learning from Simulated and Unsupervised Images through Adversarial Training , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Luca Benini,et al.  Tracking Motion Direction and Distance With Pyroelectric IR Sensors , 2010, IEEE Sensors Journal.

[5]  Jie Xiong,et al.  mD-Track: Leveraging Multi-Dimensionality for Passive Indoor Wi-Fi Tracking , 2018, MobiCom.

[6]  Mohamed S. Kamel,et al.  A new neural network structure with cooperative modules , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[7]  Jesper Jensen,et al.  Permutation invariant training of deep models for speaker-independent multi-talker speech separation , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Meng Zhang,et al.  Multiple human location in a distributed binary pyroelectric infrared sensor network , 2017 .

[9]  Xuefeng Liu,et al.  Enhancing PIR-Based Multi-Person Localization Through Combining Deep Learning With Domain Knowledge , 2021, IEEE Sensors Journal.

[10]  Qi Hao,et al.  Preprocessing Design in Pyroelectric Infrared Sensor-Based Human-Tracking System: On Sensor Selection and Calibration , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Gerald Gerlach,et al.  Thermal Infrared Sensors: Theory, Optimisation and Practice , 2011 .

[12]  Jianwei Niu,et al.  From relative azimuth to absolute location: pushing the limit of PIR sensor based localization , 2020, MobiCom.

[13]  Tao Yang,et al.  Robust People Detection and Tracking in a Multi-Camera Indoor Visual Surveillance System , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[14]  R. Venkatesha Prasad,et al.  PIR sensors: characterization and novel localization technique , 2015, IPSN.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Mohamed S. Kamel,et al.  Modular neural networks: a survey. , 1999, International journal of neural systems.