Fast smoke and flame detection based on lightweight deep neural network

The occurrence of fire disaster will cause great danger to human living environment, accurate and timely early warning can reduce or even eliminate the destructive losses caused by the smoke and flame produced by fire disaster. In recent years, thanks to the remarkable achievements of deep learning in the field of image, we propose a smoke and flame detection method based on deep learning. However, the huge amount of parameters and calculations brought by the deep neural network structure results in a large model and a slow detection speed. In this regard, we use lightweight design and channel pruning method to achieve the outstanding compression and acceleration effect, and realize the accurate and fast detection tasks of smoke and flame. Extensive experiments on the smoke and flame dataset demonstrate that after using the lightweight structure modification on the Refinedet model, it can only lose 0.4% of the mAP value while saving 87.8% parameters and 97% FLOPs. After pruning, 47.5% parameters and 43.0% FLOPs can be reduced again, and the mAP value is increased by 0.7% instead. Finally, our research results can be applied to many security detections such as smart home, power transmission and transformation lines and forest protection.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[3]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jian Wang,et al.  A Flame Detection Synthesis Algorithm , 2014 .

[7]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[8]  Shifeng Zhang,et al.  Single-Shot Refinement Neural Network for Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Yi Yang,et al.  Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks , 2018, IJCAI.