An Efficient Fire Detection Method Based on Multiscale Feature Extraction, Implicit Deep Supervision and Channel Attention Mechanism

Recent progress in vision-based fire detection is driven by convolutional neural networks. However, the existing methods fail to achieve a good tradeoff among accuracy, model size, and speed. In this paper, we propose an accurate fire detection method that achieves a better balance in the abovementioned aspects. Specifically, a multiscale feature extraction mechanism is employed to capture richer spatial details, which can enhance the discriminative ability of fire-like objects. Then, the implicit deep supervision mechanism is utilized to enhance the interaction among information flows through dense skip connections. Finally, a channel attention mechanism is employed to selectively emphasize the contribution between different feature maps. Experimental results demonstrate that our method achieves 95.3% accuracy, which outperforms the suboptimal method by 2.5%. Moreover, the speed and model size of our method are 3.76% faster on the GPU and 63.64% smaller than the suboptimal method, respectively.

[1]  Henry Leung,et al.  An adaptive threshold deep learning method for fire and smoke detection , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Farhat Fnaiech,et al.  Convolutional neural network for video fire and smoke detection , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[3]  ByoungChul Ko,et al.  Fire detection based on vision sensor and support vector machines , 2009 .

[4]  K. Angayarkkani,et al.  Efficient Forest Fire Detection System: A Spatial Data Mining and Image Processing Based Approach , 2009 .

[5]  Jian Wang,et al.  Multi-feature fusion based fast video flame detection , 2010 .

[6]  Fei Long,et al.  Video-Based Fire Detection with Saliency Detection and Convolutional Neural Networks , 2017, ISNN.

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Hongwei Zhang,et al.  A Novel Fire Detection Approach Based on CNN-SVM Using Tensorflow , 2017, ICIC.

[9]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[11]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[13]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[14]  Glenn Healey,et al.  A system for real-time fire detection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Joel J. P. C. Rodrigues,et al.  Energy-Efficient Monitoring of Fire Scenes for Intelligent Networks , 2020, IEEE Network.

[16]  Sung Wook Baik,et al.  Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Gwanggil Jeon,et al.  Vision-Based Fire Detection Algorithm Using Optical Flow , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[18]  Aleksandr Ometov,et al.  Facilitating mmWave Mesh Reliability in PPDR Scenarios Utilizing Artificial Intelligence , 2019, IEEE Access.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  A. Enis Çetin,et al.  Covariance matrix-based fire and flame detection method in video , 2012, Machine Vision and Applications.

[21]  Chunhua Shen,et al.  Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Turgay Çelik,et al.  Fire Pixel Classification using Fuzzy Logic and Statistical Color Model , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[23]  Mohamed Elhoseny,et al.  Efficient Fire Detection for Uncertain Surveillance Environment , 2019, IEEE Transactions on Industrial Informatics.

[24]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[25]  Sung Wook Baik,et al.  Early fire detection using convolutional neural networks during surveillance for effective disaster management , 2017, Neurocomputing.

[26]  A. Enis Çetin,et al.  Flame detection in video using hidden Markov models , 2005, IEEE International Conference on Image Processing 2005.

[27]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[28]  Jong-Myon Kim,et al.  Fire flame detection in video sequences using multi-stage pattern recognition techniques , 2012, Eng. Appl. Artif. Intell..

[29]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Martin Mueller,et al.  Optical Flow Estimation for Flame Detection in Videos , 2013, IEEE Transactions on Image Processing.

[31]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[32]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[33]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Hyun-Woo Lee,et al.  Deep neural networks for wild fire detection with unmanned aerial vehicle , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[35]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[36]  Wentao Mao,et al.  Fire Recognition Based On Multi-Channel Convolutional Neural Network , 2018 .

[37]  Toby P. Breckon,et al.  Experimentally Defined Convolutional Neural Network Architecture Variants for Non-Temporal Real-Time Fire Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[38]  Oleksii Maksymiv,et al.  Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence , 2017, 2017 14th International Conference The Experience of Designing and Application of CAD Systems in Microelectronics (CADSM).

[39]  Xiang Chen,et al.  Image Based Forest Fire Detection Using Dynamic Characteristics with Artificial Neural Networks , 2009, 2009 International Joint Conference on Artificial Intelligence.

[40]  Lei Gao,et al.  Video fire detection based on Gaussian Mixture Model and multi-color features , 2017, Signal Image Video Process..

[41]  Alessia Saggese,et al.  Real-Time Fire Detection for Video-Surveillance Applications Using a Combination of Experts Based on Color, Shape, and Motion , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  José Fernando Rodrigues,et al.  BoWFire: Detection of Fire in Still Images by Integrating Pixel Color and Texture Analysis , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[43]  Wei Li,et al.  Real-Time Fire Detection Based on Deep Convolutional Long-Recurrent Networks and Optical Flow Method , 2018, 2018 37th Chinese Control Conference (CCC).