Occupancy Pattern Recognition with Infrared Array Sensors: A Bayesian Approach to Multi-body Tracking

Thermal vision systems based on low-cost IR array sensors are becoming attractive in many smart living scenarios. This paper proposes a Bayesian framework for recognition and discrimination of body motions based on real-time analysis of thermal signatures. Unlike conventional frame-based methods, the proposed approach exploits a statistical model for the extraction of body-induced thermal signatures and a mobility model for tracking multi-body motions inside an indoor area. This approach prevents typical detection problems and can be also used in presence of interfering thermal sources such as heaters, radiators and other thermal devices. The Bayesian method is verified experimentally for ceiling mounted sensors and shows high accuracy and robustness even in cases where thermal signatures are closer to the ambient temperature.

[1]  Rachel Cardell-Oliver,et al.  Occupancy Estimation Using a Low-Pixel Count Thermal Imager , 2016, IEEE Sensors Journal.

[2]  Alberto Cerpa,et al.  ThermoSense: Occupancy Thermal Based Sensing for HVAC Control , 2013, BuildSys@SenSys.

[3]  Zhangjie Chen,et al.  Infrared–ultrasonic sensor fusion for support vector machine–based fall detection , 2018 .

[4]  Ohtsuki Tomoaki,et al.  Activity Recognition Using Low Resolution Infrared Array Sensor , 2015, AmI 2015.

[5]  Douglas M. Hawkins,et al.  Multivariate Exponentially Weighted Moving Covariance Matrix , 2008, Technometrics.

[6]  Geoff V. Merrett,et al.  Real-time room occupancy estimation with Bayesian machine learning using a single PIR sensor and microcontroller , 2017, 2017 IEEE Sensors Applications Symposium (SAS).

[7]  Norbert Wehn,et al.  Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array , 2014, UbiComp.

[8]  Umberto Spagnolini,et al.  Device-Free Radio Vision for Assisted Living: Leveraging wireless channel quality information for human sensing , 2016, IEEE Signal Processing Magazine.

[9]  Neil Johnson,et al.  A smart sensor to detect the falls of the elderly , 2004, IEEE Pervasive Computing.

[10]  Oliver Amft,et al.  Using a Thermopile Matrix Sensor to Recognize Energy-related Activities in Offices , 2013, ANT/SEIT.

[11]  Suk Ho Lee,et al.  Human tracking with an infrared camera using a curve matching framework , 2012, EURASIP J. Adv. Signal Process..

[12]  Tomoaki Ohtsuki,et al.  Activity recognition using low resolution infrared array sensor , 2015, 2015 IEEE International Conference on Communications (ICC).

[13]  Luca Benini,et al.  Tracking Motion Direction and Distance With Pyroelectric IR Sensors , 2010, IEEE Sensors Journal.

[14]  Yongwoo Jeong,et al.  Probabilistic method to determine human subjects for low-resolution thermal imaging sensor , 2014, 2014 IEEE Sensors Applications Symposium (SAS).

[15]  Thomas B. Moeslund,et al.  Thermal cameras and applications: a survey , 2013, Machine Vision and Applications.

[16]  Junichi Tanaka,et al.  Low power wireless human detector utilizing thermopile infrared array sensor , 2014, IEEE SENSORS 2014 Proceedings.

[17]  Mark W. Schmidt,et al.  Fast Optimization Methods for L1 Regularization: A Comparative Study and Two New Approaches , 2007, ECML.

[18]  Koji Hashimoto,et al.  The use of thermal ir array sensor for indoor fall detection , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[19]  J. R. Llata,et al.  Working Together: A Review on Safe Human-Robot Collaboration in Industrial Environments , 2017, IEEE Access.

[20]  Rachel Cardell-Oliver,et al.  Hierarchical Classification of Low Resolution Thermal Images for Occupancy Estimation , 2017, 2017 IEEE 42nd Conference on Local Computer Networks Workshops (LCN Workshops).