Simultaneous Indoor Tracking and Activity Recognition Using Pyroelectric Infrared Sensors

Indoor human tracking and activity recognition are fundamental yet coherent problems for ambient assistive living. In this paper, we propose a method to address these two critical issues simultaneously. We construct a wireless sensor network (WSN), and the sensor nodes within WSN consist of pyroelectric infrared (PIR) sensor arrays. To capture the tempo-spatial information of the human target, the field of view (FOV) of each PIR sensor is modulated by masks. A modified partial filter algorithm is utilized to decode the location of the human target. To exploit the synergy between the location and activity, we design a two-layer random forest (RF) classifier. The initial activity recognition result of the first layer is refined by the second layer RF by incorporating various effective features. We conducted experiments in a mock apartment. The mean localization error of our system is about 0.85 m. For five kinds of daily activities, the mean accuracy for 10-fold cross-validation is above 92%. The encouraging results indicate the effectiveness of our system.

[1]  Oliver Brdiczka,et al.  Detecting Individual Activities from Video in a Smart Home , 2007, KES.

[2]  Faran Awais Butt,et al.  Short-time energy, magnitude, zero crossing rate and autocorrelation measurement for discriminating voiced and unvoiced segments of speech signals , 2013, 2013 The International Conference on Technological Advances in Electrical, Electronics and Computer Engineering (TAEECE).

[3]  Xuemei Guo,et al.  Design and implementation of a distributed fall detection system based on wireless sensor networks , 2012, EURASIP Journal on Wireless Communications and Networking.

[4]  Kai-Chun Liu,et al.  Wearable sensor-based activity recognition for housekeeping task , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[5]  Shuai Tao,et al.  Multiperson Locating and Their Soft Tracking in a Binary Infrared Sensor Network , 2015, IEEE Transactions on Human-Machine Systems.

[6]  Damith Chinthana Ranasinghe,et al.  Recognition of falls using dense sensing in an ambient assisted living environment , 2017, Pervasive Mob. Comput..

[7]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[8]  Daijin Kim,et al.  A Depth Video Sensor-Based Life-Logging Human Activity Recognition System for Elderly Care in Smart Indoor Environments , 2014, Sensors.

[9]  David Barber,et al.  Bayesian reasoning and machine learning , 2012 .

[10]  Weihua Sheng,et al.  Wearable Sensor-Based Behavioral Anomaly Detection in Smart Assisted Living Systems , 2015, IEEE Transactions on Automation Science and Engineering.

[11]  Antonio Fernández-Caballero,et al.  A survey of video datasets for human action and activity recognition , 2013, Comput. Vis. Image Underst..

[12]  Weihua Sheng,et al.  Motion- and location-based online human daily activity recognition , 2011, Pervasive Mob. Comput..

[13]  An-An Liu,et al.  Jointly Learning Multiple Sequential Dynamics for Human Action Recognition , 2015, PloS one.

[14]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[15]  Tao Dong,et al.  A Review of Wearable Technologies for Elderly Care that Can Accurately Track Indoor Position, Recognize Physical Activities and Monitor Vital Signs in Real Time , 2017, Sensors.

[16]  Henry A. Kautz,et al.  Hierarchical Conditional Random Fields for GPS-Based Activity Recognition , 2005, ISRR.

[17]  Meng Li,et al.  A Random Forest-based ensemble method for activity recognition , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Jun Liu,et al.  Design and implementation of a compressive infrared sampling for motion acquisition , 2014, EURASIP J. Adv. Signal Process..

[19]  Kai-Chun Liu,et al.  Significant Change Spotting for Periodic Human Motion Segmentation of Cleaning Tasks Using Wearable Sensors , 2017, Sensors.

[20]  Michael S. Ryoo,et al.  Privacy-Preserving Human Activity Recognition from Extreme Low Resolution , 2016, AAAI.

[21]  L. Morgan,et al.  Mental Illness in Assisted Living: Challenges for Quality of Life and Care , 2016, Journal of housing for the elderly.

[22]  Qi Hao,et al.  Human Tracking With Wireless Distributed Pyroelectric Sensors , 2006, IEEE Sensors Journal.

[23]  Stephen J. Maybank,et al.  Activity recognition using a supervised non-parametric hierarchical HMM , 2016, Neurocomputing.

[24]  Qi Hao,et al.  Multiple Human Tracking and Identification With Wireless Distributed Pyroelectric Sensor Systems , 2009, IEEE Systems Journal.

[25]  Bo Yang,et al.  Credit-Based Multiple Human Location for Passive Binary Pyroelectric Infrared Sensor Tracking System: Free From Region Partition and Classifier , 2017, IEEE Sensors Journal.

[26]  C. Mazzà,et al.  Step Detection and Activity Recognition Accuracy of Seven Physical Activity Monitors , 2015, PloS one.

[27]  Xuemei Guo,et al.  A Novel Infrared Motion Sensing System for Compressive Classification of Physical Activity , 2016, IEEE Sensors Journal.

[28]  M. Rashid,et al.  Pyroelectric detectors and their applications , 1989, Conference Record of the IEEE Industry Applications Society Annual Meeting,.

[29]  Tong Liu,et al.  Abnormal Activity Detection Using Pyroelectric Infrared Sensors , 2016, Sensors.

[30]  Shing Chiang Tan,et al.  Temporal sampling forest ($$\varvec{\textit{TS-F}}$$TS-F): an ensemble temporal learner , 2017, Soft Comput..

[31]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[32]  Christopher G. Atkeson,et al.  Simultaneous Tracking and Activity Recognition (STAR) Using Many Anonymous, Binary Sensors , 2005, Pervasive.

[33]  Xiaobai Sun,et al.  Reference structure tomography. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  A. S. Bhalla,et al.  Pyroelectric Sensors , 1998 .

[35]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[36]  Ilias Maglogiannis,et al.  Video Analytics for Activity Recognition in Indoor Environments Using Fisheye Cameras , 2016 .

[37]  Tong Liu,et al.  Human indoor localization based on ceiling mounted PIR sensor nodes , 2016, 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[38]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Kostas Delibasis,et al.  A novel robust approach for handling illumination changes in video segmentation , 2016, Eng. Appl. Artif. Intell..

[40]  Dae-Man Han,et al.  Smart home energy management system using IEEE 802.15.4 and zigbee , 2010, IEEE Transactions on Consumer Electronics.

[41]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).