A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection

Traditional methods for video smoke detection can easily achieve very low training errors but their generalization performances are not good due to arbitrary shapes of smoke, intra-class variations, occlusions and clutters. To overcome these problems, a double mapping framework is proposed to extract partition based features with AdaBoost. The first mapping is from an original image to block features. A feature vector is presented by concatenating histograms of edge orientation, edge magnitude and Local Binary Pattern (LBP) bit, and densities of edge magnitude, LBP bit, color intensity and saturation. Each component of the feature vector produces a feature image. To obtain shape-invariant features, a detection window is partitioned into a set of small blocks called a partition, and many multi-scale partitions are generated by changing block sizes and partition schemes. The sum of each feature image within each block of each partition is computed to generate block features. The second mapping is from the block features to statistical features. The statistical features of the block features, such as, mean, variance, skewness, kurtosis and Hu moments, are computed on all partitions to form a feature pool. AdaBoost is used to select discriminative shape-invariant features from the feature pool. Experiments show that the proposed method has better generalization performance and less insensitivity to geometry transform than traditional methods.

[1]  Hanqing Lu,et al.  Face detection using improved LBP under Bayesian framework , 2004, Third International Conference on Image and Graphics (ICIG'04).

[2]  Xiang Chen,et al.  Image Based Forest Fire Detection Using Dynamic Characteristics with Artificial Neural Networks , 2009, 2009 International Joint Conference on Artificial Intelligence.

[3]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Begoña C. Arrue,et al.  Computer vision techniques for forest fire perception , 2008, Image Vis. Comput..

[5]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[6]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[7]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[8]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[10]  Abdesselam Bouzerdoum,et al.  Detecting People in Images: An Edge Density Approach , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Narendra Ahuja,et al.  Vision based fire detection , 2004, ICPR 2004.

[12]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[13]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[14]  Daijin Kim,et al.  A compact local binary pattern using maximization of mutual information for face analysis , 2011, Pattern Recognit..

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[16]  Yair Weiss,et al.  Learning object detection from a small number of examples: the importance of good features , 2004, CVPR 2004.

[17]  Philippe Guillemant,et al.  Real-time identification of smoke images by clustering motions on a fractal curve with a temporal embedding method , 2001 .

[18]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[19]  Toby P. Breckon,et al.  A non-temporal texture driven approach to real-time fire detection , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  A. Enis Çetin,et al.  Wavelet based real-time smoke detection in video , 2005, 2005 13th European Signal Processing Conference.

[21]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[22]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[23]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, AMFG.

[24]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[25]  ByoungChul Ko,et al.  Fire detection based on vision sensor and support vector machines , 2009 .

[26]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[27]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[28]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Frederick W. Williams,et al.  Video Image Fire Detection for Shipboard Use , 2006 .

[30]  Dongil Han,et al.  Flame and smoke detection method for early real-time detection of a tunnel fire , 2009 .

[31]  Hong Zhang,et al.  Real-time detection of steam in video images , 2007, Pattern Recognit..

[32]  Shu Liao,et al.  Face Recognition by Using Elongated Local Binary Patterns with Average Maximum Distance Gradient Magnitude , 2007, ACCV.

[33]  Tieniu Tan,et al.  Topology modeling for Adaboost-cascade based object detection , 2010, Pattern Recognit. Lett..

[34]  Chu-Song Chen,et al.  Fast Human Detection Using a Novel Boosted Cascading Structure With Meta Stages , 2008, IEEE Transactions on Image Processing.

[35]  Alejandro F. Frangi,et al.  Haar-like features with optimally weighted rectangles for rapid object detection , 2010, Pattern Recognition.

[36]  Zhang Yongming,et al.  Video Fire Smoke Detection Using Motion and Color Features , 2010 .

[37]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.