A Dual Convolution Network Using Dark Channel Prior for Image Smoke Classification

Through a comparative analysis, we confirm that the value of the dark channel pixels of the smoke image is higher than the non-smoke image. It means that the dark channel of the smoke image has more elaborate information of the smoke, which is of great benefit to our detailed feature extraction of smoke. On this background, we propose a dual convolution network using dark channel prior for image smoke classification (DarkC-DCN) for the image smoke classification. In DarkC-DCN, basing on the AlexNet, and through continuous structural improvement and optimization, we improve a detailed CNN to extract the detailed features of dark channel images. Similarly, to extract the general features in the image, we further design another residual network based on the AlexNet, which is the main framework of the entire network. To ascertain the robustness of the network, the two channels are trained separately for various inputs. In addition, we perform feature fusion before the common fully connected layer. In the experiment, we also add some non-smoke data similar to smoke in the public smoke data set for data expansion. The experimental results indicate that the model has a good performance in general. The accuracy value reaches 98.56%.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[3]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  ByoungChul Ko,et al.  Wildfire smoke detection using spatiotemporal bag-of-features of smoke , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[5]  Shuzhi Sam Ge,et al.  Learning Saliency Features for Face Detection and Recognition Using Multi-task Network , 2016, Int. J. Soc. Robotics.

[6]  Wanqing Li,et al.  Smoke detection in videos using Non-Redundant Local Binary Pattern-based features , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  A. Enis Çetin,et al.  Wavelet based real-time smoke detection in video , 2005, 2005 13th European Signal Processing Conference.

[9]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[10]  Carlo S. Regazzoni,et al.  Early fire and smoke detection based on colour features and motion analysis , 2012, 2012 19th IEEE International Conference on Image Processing.

[11]  Simone Calderara,et al.  Vision based smoke detection system using image energy and color information , 2011, Machine Vision and Applications.

[12]  Yuan Yan Tang,et al.  High-Order Distance-Based Multiview Stochastic Learning in Image Classification , 2014, IEEE Transactions on Cybernetics.

[13]  Zhijing Yang,et al.  Normalized Co-Occurrence Mutual Information for Facial Pose Detection Inside Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  ByoungChul Ko,et al.  Spatiotemporal bag-of-features for early wildfire smoke detection , 2013, Image Vis. Comput..

[15]  Lei Wang,et al.  Detection and Separation of Smoke From Single Image Frames , 2018, IEEE Transactions on Image Processing.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  Thou-Ho Chen,et al.  An intelligent real-time fire-detection method based on video processing , 2003, IEEE 37th Annual 2003 International Carnahan Conference onSecurity Technology, 2003. Proceedings..

[18]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[19]  A. Enis Çetin,et al.  Entropy functional based adaptive decision fusion framework , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[20]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Frederick W. Williams,et al.  Video Image Fire Detection for Shipboard Use , 2006 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Liang Zhao,et al.  Fire smoke detection algorithm based on motion characteristic and convolutional neural networks , 2017, Multimedia Tools and Applications.

[24]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[25]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[26]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Gao Xu,et al.  Deep Domain Adaptation Based Video Smoke Detection using Synthetic Smoke Images , 2017, ArXiv.