Human Detection Based on the Generation of a Background Image and Fuzzy System by Using a Thermal Camera

Recently, human detection has been used in various applications. Although visible light cameras are usually employed for this purpose, human detection based on visible light cameras has limitations due to darkness, shadows, sunlight, etc. An approach using a thermal (far infrared light) camera has been studied as an alternative for human detection, however, the performance of human detection by thermal cameras is degraded in case of low temperature differences between humans and background. To overcome these drawbacks, we propose a new method for human detection by using thermal camera images. The main contribution of our research is that the thresholds for creating the binarized difference image between the input and background (reference) images can be adaptively determined based on fuzzy systems by using the information derived from the background image and difference values between background and input image. By using our method, human area can be correctly detected irrespective of the various conditions of input and background (reference) images. For the performance evaluation of the proposed method, experiments were performed with the 15 datasets captured under different weather and light conditions. In addition, the experiments with an open database were also performed. The experimental results confirm that the proposed method can robustly detect human shapes in various environments.

[1]  Wayne Niblack,et al.  An introduction to digital image processing , 1986 .

[2]  A. T. Ali,et al.  Visual road traffic monitoring and data collection , 1993, Proceedings of VNIS '93 - Vehicle Navigation and Information Systems Conference.

[3]  Etienne E. Kerre,et al.  Defuzzification: criteria and classification , 1999, Fuzzy Sets Syst..

[4]  R. Cucchiara,et al.  Statistic and knowledge-based moving object detection in traffic scenes , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[5]  B. Bose,et al.  Evaluation of membership functions for fuzzy logic controlled induction motor drive , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[6]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  James W. Davis,et al.  Robust detection of people in thermal imagery , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  James W. Davis,et al.  Fusion-Based Background-Subtraction using Contour Saliency , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  B. Kapralos,et al.  An introduction to digital image processing , 1990 .

[10]  Dragoljub Pokrajac,et al.  Tracking motion objects in infrared videos , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[11]  Xin Li,et al.  Layered Representation for Pedestrian Detection and Tracking in Infrared Imagery , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  James W. Davis,et al.  A Two-Stage Template Approach to Person Detection in Thermal Imagery , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[13]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Jan-Erik Källhammer,et al.  Night vision: requirements and possible roadmap for FIR and NIR systems , 2006, SPIE Photonics Europe.

[15]  Mark E Hallenbeck,et al.  Extracting Roadway Background Image , 2006 .

[16]  Xin Li,et al.  Pedestrian detection and tracking in infrared imagery using shape and appearance , 2007, Comput. Vis. Image Underst..

[17]  James W. Davis,et al.  Background-subtraction using contour-based fusion of thermal and visible imagery , 2007, Comput. Vis. Image Underst..

[18]  Thierry Bouwmans,et al.  Fuzzy foreground detection for infrared videos , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  H. Foroughi,et al.  A novel fuzzy background subtraction method based on cellular automata for urban traffic applications , 2008, 2008 9th International Conference on Signal Processing.

[20]  Yupin Luo,et al.  Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems , 2009, IEEE Transactions on Intelligent Transportation Systems.

[21]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[22]  Weihong Wang,et al.  Improved human detection and classification in thermal images , 2010, 2010 IEEE International Conference on Image Processing.

[23]  Rita Cucchiara,et al.  HMM Based Action Recognition with Projection Histogram Features , 2010, ICPR Contests.

[24]  Qiang Wu,et al.  Feature Enhancement Using Gradient Salience on Thermal Image , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[25]  Ognjen Arandjelovic,et al.  Multiple-object Tracking in Cluttered and Crowded Public Spaces , 2010, ISVC.

[26]  Zheng Yi,et al.  Moving object detection based on running average background and temporal difference , 2010, 2010 IEEE International Conference on Intelligent Systems and Knowledge Engineering.

[27]  Sei-Wang Chen,et al.  Nighttime pedestrian detection using thermal imaging based on HOG feature , 2011, Proceedings 2011 International Conference on System Science and Engineering.

[28]  R. Biswas,et al.  Effect of different defuzzification methods in a fuzzy based load balancing application , 2011 .

[29]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Syed Muhammad Saqlain,et al.  A robust and enhanced approach for human detection in crowd , 2012, 2012 15th International Multitopic Conference (INMIC).

[31]  Wei Li,et al.  An effective approach to pedestrian detection in thermal imagery , 2012, 2012 8th International Conference on Natural Computation.

[32]  Kang Ryoung Park,et al.  New Fuzzy-Based Retinex Method for the Illumination Normalization of Face Recognition , 2012 .

[33]  Chao Gao,et al.  Background subtraction based level sets for human segmentation in thermal infrared surveillance systems , 2013 .

[34]  Mohan M. Trivedi,et al.  Part-Based Pedestrian Detection and Feature-Based Tracking for Driver Assistance: Real-Time, Robust Algorithms, and Evaluation , 2013, IEEE Transactions on Intelligent Transportation Systems.

[35]  Meisen Pan,et al.  Human Object Extraction Using Nonextensive Fuzzy Entropy and Chaos Differential Evolution , 2013 .

[36]  Antonio Barrientos,et al.  Human Detection from a Mobile Robot Using Fusion of Laser and Vision Information , 2013, Sensors.

[37]  Maziar Palhang,et al.  Pedestrian detection using principal components analysis of gradient distribution , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[38]  Yang Wang,et al.  A weakly supervised approach for object detection based on Soft-Label Boosting , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[39]  Tusar Kanti Mishra,et al.  Background subtraction and human detection in outdoor videos using fuzzy logic , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[40]  Jun Miura,et al.  Fuzzy-based illumination normalization for face recognition , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[41]  Yutaka Hata,et al.  A Fuzzy Human Detection for Security System Using Infrared Laser Camera , 2013, 2013 IEEE 43rd International Symposium on Multiple-Valued Logic.

[42]  Antonio Fernández-Caballero,et al.  A fuzzy model for human fall detection in infrared video , 2013, J. Intell. Fuzzy Syst..

[43]  Afsane Rajaei,et al.  Human detection in semi-dense scenes using HOG descriptor and mixture of SVMs , 2013, ICCKE 2013.

[44]  Cristiano Premebida,et al.  Pedestrian detection in far infrared images , 2013, Integr. Comput. Aided Eng..

[45]  O. Kosheleva,et al.  Why Trapezoidal and Triangular Membership Functions Work So Well: Towards a Theoretical Explanation , 2014 .

[46]  Kang Ryoung Park,et al.  Human Detection Based on the Generation of a Background Image by Using a Far-Infrared Light Camera , 2015, Sensors.

[47]  Kang Ryoung Park,et al.  Robust Pedestrian Detection by Combining Visible and Thermal Infrared Cameras , 2015, Sensors.

[48]  Jinwen Ma,et al.  Combination features and models for human detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Alexandrina Rogozan,et al.  Pedestrian Detection in Far-Infrared Daytime Images Using a Hierarchical Codebook of SURF , 2015, Sensors.