Fire smoke detection algorithm based on motion characteristic and convolutional neural networks

It is a challenging task to recognize smoke from visual scenes due to large variations in the feature of color, texture, shapes, etc. The current detection algorithms are mainly based on single feature or fusion of multiple static features of smoke, which leads to low detection accuracy. To solve this problem, this paper proposes a smoke detection algorithm based on the motion characteristics of smoke and the convolutional neural networks (CNN). Firstly, a moving object detection algorithm based on background dynamic update and dark channel priori is proposed to detect the suspected smoke regions. Then, the features of suspected region is extracted automatically by CNN, on that the smoke identification is performed. Compared to previous work, our algorithm improves the detection accuracy, which can reach 99% in the testing sets. For the problem that the region of smoke is relatively small in the early stage of smoke generation, the strategy of implicit enlarging the suspected regions is proposed, which improves the timeliness of smoke detection. In addition a fine-tuning method is proposed to solve the problem of scarce of data in the training network. Also, the algorithm has good smoke detection performance by testing under various video scenes.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  A. Enis Çetin,et al.  Wavelet based real-time smoke detection in video , 2005, 2005 13th European Signal Processing Conference.

[3]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  N. Fujiwara,et al.  Extraction of a smoke region using fractal coding , 2004, IEEE International Symposium on Communications and Information Technology, 2004. ISCIT 2004..

[5]  Vincenzo Piuri,et al.  Wildfire smoke detection using computational intelligence techniques , 2011, 2011 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[6]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[7]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Lei Wang,et al.  A Novel Video-Based Smoke Detection Method Using Image Separation , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Toby P. Breckon,et al.  A non-temporal texture driven approach to real-time fire detection , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Liang Li,et al.  Efficient parallel HEVC intra-prediction on many-core processor , 2014 .

[13]  Pan Wang,et al.  Smoke Detection Based on Deep Convolutional Neural Networks , 2016, 2016 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII).

[14]  Allen Tannenbaum,et al.  Fire and smoke detection in video with optimal mass transport based optical flow and neural networks , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Zhang Yongming,et al.  Video Fire Smoke Detection Using Motion and Color Features , 2010 .

[16]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[17]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[21]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[22]  ByoungChul Ko,et al.  Spatiotemporal bag-of-features for early wildfire smoke detection , 2013, Image Vis. Comput..

[23]  Sheng Luo,et al.  Smoke detection based on condensed image , 2015 .

[24]  Farhat Fnaiech,et al.  Convolutional neural network for video fire and smoke detection , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[25]  Wanqing Li,et al.  Smoke detection in videos using Non-Redundant Local Binary Pattern-based features , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[26]  Cristian Sminchisescu,et al.  CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Tao Wang,et al.  Flutter Analysis Based Video Smoke Detection: Flutter Analysis Based Video Smoke Detection , 2011 .

[28]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[29]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[30]  Yongdong Zhang,et al.  Parallel deblocking filter for HEVC on many-core processor , 2014 .