Detection of Wildfire Smoke Images Based on a Densely Dilated Convolutional Network

Recently, many researchers have attempted to use convolutional neural networks (CNNs) for wildfire smoke detection. However, the application of CNNs in wildfire smoke detection still faces several issues, e.g., the high false-alarm rate of detection and the imbalance of training data. To address these issues, we propose a novel framework integrating conventional methods into CNN for wildfire smoke detection, which consisted of a candidate smoke region segmentation strategy and an advanced network architecture, namely wildfire smoke dilated DenseNet (WSDD-Net). Candidate smoke region segmentation removed the complex backgrounds of the wildfire smoke images. The proposed WSDD-Net achieved multi-scale feature extraction by combining dilated convolutions with dense block. In order to solve the problem of the dataset imbalance, an improved cross entropy loss function, namely balanced cross entropy (BCE), was used instead of the original cross entropy loss function in the training process. The proposed WSDD-Net was evaluated according to two smoke datasets, i.e., WS and Yuan, and achieved a high AR (99.20%) and a low FAR (0.24%). The experimental results demonstrated that the proposed framework had better detection capabilities under different negative sample interferences.

[1]  Banghua Yang,et al.  Recognition of Fire Detection Based on Neural Network , 2010, LSMS/ICSEE.

[2]  Qixing Zhang,et al.  Wildland Forest Fire Smoke Detection Based on Faster R-CNN using Synthetic Smoke Images , 2018 .

[3]  Gao Xu,et al.  Video Smoke Detection Based on Deep Saliency Network , 2018, Fire Safety Journal.

[4]  Yuan-Fang Wang,et al.  Smoke Detection in Video , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[5]  LinLin Shen,et al.  Reverse active learning based atrous DenseNet for pathological image classification , 2019, BMC Bioinformatics.

[6]  Tao Wang,et al.  Recurrent convolutional network for video-based smoke detection , 2017, Multimedia Tools and Applications.

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[9]  Gao Xu,et al.  Domain Adaptation from Synthesis to Reality in Single-model Detector for Video Smoke Detection , 2017, ArXiv.

[10]  Yuan Wei,et al.  Color model and method for video fire flame and smoke detection using Fisher linear discriminant , 2013 .

[11]  A. Ghaffari,et al.  Performance comparison of neural network training algorithms in modeling of bimodal drug delivery. , 2006, International journal of pharmaceutics.

[12]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[13]  ByoungChul Ko,et al.  Fire detection based on vision sensor and support vector machines , 2009 .

[14]  S. S. Vinsley,et al.  Multi Feature Analysis of Smoke in YUV Color Space for Early Forest Fire Detection , 2016 .

[15]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[16]  Junguo Zhang,et al.  An Integrated Wildlife Recognition Model Based on Multi-Branch Aggregation and Squeeze-And-Excitation Network , 2019, Applied Sciences.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[19]  Liang Zhao,et al.  Fire smoke detection algorithm based on motion characteristic and convolutional neural networks , 2017, Multimedia Tools and Applications.

[20]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[21]  Tao Mei,et al.  High-order local ternary patterns with locality preserving projection for smoke detection and image classification , 2016, Inf. Sci..

[22]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Rubén San-Segundo,et al.  Parkinson’s Disease Detection from Drawing Movements Using Convolutional Neural Networks , 2019, Electronics.

[25]  Jong-Myon Kim,et al.  An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems , 2011 .

[26]  Zhiyong Yuan,et al.  Dynamic texture based smoke detection using Surfacelet transform and HMT model , 2015 .

[27]  Jun Fang,et al.  A Saliency-Based Method for Early Smoke Detection in Video Sequences , 2016 .

[28]  Jonathan Rubin,et al.  Ischemic Stroke Lesion Segmentation in CT Perfusion Scans using Pyramid Pooling and Focal Loss , 2018, BrainLes@MICCAI.

[29]  Zhenxue Chen,et al.  Real-time pedestrian detection with deep supervision in the wild , 2019, Signal Image Video Process..

[30]  Feiniu Yuan,et al.  A Deep Normalization and Convolutional Neural Network for Image Smoke Detection , 2017, IEEE Access.

[31]  M. Shrivastava,et al.  Hybrid Deep VGG-NET Convolutional Classifier for Video Smoke Detection , 2019, Computer Modeling in Engineering & Sciences.

[32]  Amel Benazza-Benyahia,et al.  Early smoke detection in forest areas from DCT based compressed video , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[33]  Qixing Zhang,et al.  Smoke Detection on Video Sequences Using 3D Convolutional Neural Networks , 2019, Fire Technology.

[34]  Wentao Mao,et al.  Fire Recognition Based On Multi-Channel Convolutional Neural Network , 2018 .

[35]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Zhijie Zhang,et al.  An Improved Probabilistic Approach for Fire Detection in Videos , 2014 .