Tackling Small Data Challenges in Visual Fire Detection: A Deep Convolutional Generative Adversarial Network Approach

Fire detection technologies remain a critical component of building automation. With the recent significant advances in computer vision, visual fire detection methods have been developed and integrated into building surveillance systems. Overfitting and accuracy challenges remain in fire detection when training datasets are limited. In this work, we tackle these challenges by developing a deep convolutional generative adversarial network (DCGAN) for highly accurate visual fire detection when training images are limited. Our model addresses three types of errors in visual fire detection with small training datasets: model overfitting, fire probability overestimation, and fire probability underestimation. The DCGAN includes a generator of fake fire images for self-supervised learning (SSL) and a discriminator for image classification. We designed computational experiments with high-quality datasets to test and validate our model against other supervised learning approaches. We also benchmarked the performance of the DCGAN against a best-in-class deep visual fire detection model. The results show that our model significantly outperforms other fire detection models on all performance metrics when trained with the same small dataset. The results demonstrate that the DCGAN effectively mitigates the three types of error when the training dataset is limited.

[1]  Jun Zhu,et al.  Efficient Video Fire Detection Exploiting Motion-Flicker-Based Dynamic Features and Deep Static Features , 2020, IEEE Access.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  M. Ekpanyapong,et al.  Fire detection for early fire alarm based on optical flow video processing , 2012, 2012 9th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[4]  Jiaolong Xu,et al.  Deep Convolutional Neural Networks for Forest Fire Detection , 2016 .

[5]  Jong-Hyun Kim,et al.  Fire Sprite Animation Using Fire-Flake Texture and Artificial Motion Blur , 2019, IEEE Access.

[6]  Fei Zhang,et al.  Information-Guided Flame Detection Based on Faster R-CNN , 2020, IEEE Access.

[7]  Ali Rafiee,et al.  Fire and smoke detection using wavelet analysis and disorder characteristics , 2011, 2011 3rd International Conference on Computer Research and Development.

[8]  David Lopez-Paz,et al.  Optimizing the Latent Space of Generative Networks , 2017, ICML.

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Jeff Donahue,et al.  Large Scale GAN Training for High Fidelity Natural Image Synthesis , 2018, ICLR.

[11]  Samridhi Jha Data Infrastructure for Machine Learning , 2019 .

[12]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[13]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[14]  Gabriel Roque,et al.  LPWAN Based IoT Surveillance System for Outdoor Fire Detection , 2020, IEEE Access.

[15]  Wentao Mao,et al.  Fire Recognition Based On Multi-Channel Convolutional Neural Network , 2018 .

[16]  Zhi-Hua Zhou,et al.  A brief introduction to weakly supervised learning , 2018 .

[17]  Venkat N. Gudivada,et al.  Data Quality Considerations for Big Data and Machine Learning: Going Beyond Data Cleaning and Transformations , 2017 .

[18]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[19]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[20]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[21]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[22]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Diederik P. Kingma,et al.  An Introduction to Variational Autoencoders , 2019, Found. Trends Mach. Learn..

[24]  Qixing Zhang,et al.  Adversarial Adaptation From Synthesis to Reality in Fast Detector for Smoke Detection , 2019, IEEE Access.

[25]  Turgay Çelik,et al.  Fire and smoke detection without sensors: Image processing based approach , 2007, 2007 15th European Signal Processing Conference.

[26]  Sung Wook Baik,et al.  Early fire detection using convolutional neural networks during surveillance for effective disaster management , 2017, Neurocomputing.

[27]  Xin Chen,et al.  Flame detection using deep learning , 2018, 2018 4th International Conference on Control, Automation and Robotics (ICCAR).

[28]  Mohamed Elhoseny,et al.  Efficient Fire Detection for Uncertain Surveillance Environment , 2019, IEEE Transactions on Industrial Informatics.

[29]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[30]  Taeyong Kim,et al.  Non-Temporal Lightweight Fire Detection Network for Intelligent Surveillance Systems , 2019, IEEE Access.

[31]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[32]  Sung Wook Baik,et al.  Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Nicu Sebe,et al.  Training Adversarial Discriminators for Cross-Channel Abnormal Event Detection in Crowds , 2017, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[36]  Andrezza Kyunmi Kim,et al.  Review of Recent Developments in Fire Detection Technologies , 2003 .

[37]  Yihua Hu,et al.  A Review for Solar Panel Fire Accident Prevention in Large-Scale PV Applications , 2020, IEEE Access.

[38]  Lin Du,et al.  Fire Detection and Recognition Optimization Based on Virtual Reality Video Image , 2020, IEEE Access.

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[41]  Rishabh Sharma,et al.  FireNet: A Specialized Lightweight Fire & Smoke Detection Model for Real-Time IoT Applications , 2019, ArXiv.