Convolutional neural network for smoke and fire semantic segmentation

In recent decades, global warming has contributed to an increase in the number and inten-sity of wildfires destroying millions hectares of forest areas and causing many casualties each year. Firemen must therefore have the most effective means to prevent any wildfire from breaking out and to fight the blaze before being unable to contain and extinguish it. This article will present a new network architecture based on Convolutional Neural Network to detect and locate smoke and fire. This network generates fire and smoke masks in an RGB image by segmentation. The purpose of this work is to help firemen in assessing the extent of fire or monitor an incipient fire in real time with a camera embedded in a vehicle. To train this network, a database with the corresponding images and masks has been created. Such a database will allow to compare the performances of different networks. A comparison of this network with the best segmentation networks such as U-Net and Yuan networks has highlighted its efficiency in terms of location accuracy, reduction of false positive classifications such as clouds or haze. This architecture is also efficient in real time.

[1]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[2]  Ross B. Girshick,et al.  Mask R-CNN , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[4]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[5]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[8]  Osman Günay,et al.  Fire Detection in Video Using LMS Based Active Learning , 2010 .

[9]  Moulay A. Akhloufi,et al.  Computer vision for wildfire research: An evolving image dataset for processing and analysis , 2017 .

[10]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[11]  Sung Wook Baik,et al.  Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Steven Verstockt,et al.  Video fire detection - Review , 2013, Digit. Signal Process..

[15]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Xuelong Li,et al.  Deep Smoke Segmentation , 2018, Neurocomputing.

[19]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[22]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[23]  A. Enis Çetin,et al.  HMM Based Falling Person Detection Using Both Audio and Video , 2005, 2006 IEEE 14th Signal Processing and Communications Applications.

[24]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Farhat Fnaiech,et al.  Convolutional neural network for video fire and smoke detection , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[27]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[28]  Joonwhoan Lee,et al.  A Video-Based Fire Detection Using Deep Learning Models , 2019, Applied Sciences.

[29]  Turgay Çelik,et al.  Fire and smoke detection without sensors: Image processing based approach , 2007, 2007 15th European Signal Processing Conference.

[30]  N. Perkins,et al.  The inconsistency of "optimal" cutpoints obtained using two criteria based on the receiver operating characteristic curve. , 2006, American journal of epidemiology.

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[33]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[34]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[35]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[36]  A. Enis Çetin,et al.  Online Detection of Fire in Video , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[38]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).