Real-time video fire/smoke detection based on CNN in antifire surveillance systems

This work presents a real-time video-based fire and smoke detection using YOLOv2 Convolutional Neural Network (CNN) in antifire surveillance systems. YOLOv2 is designed with light-weight neural network architecture to account the requirements of embedded platforms. The training stage is processed off-line with indoor and outdoor fire and smoke image sets in different indoor and outdoor scenarios. Ground truth labeler app is used to generate the ground truth data from the training set. The trained model was tested and compared to the other state-of-the-art methods. We used a large scale of fire/smoke and negative videos in different environments, both indoor (e.g., a railway carriage, container, bus wagon, or home/office) or outdoor (e.g., storage or parking area). YOLOv2 is a better option compared to the other approaches for real-time fire/smoke detection. This work has been deployed in a low-cost embedded device (Jetson Nano), which is composed of a single, fixed camera per scene, working in the visible spectral range. There are not specific requirements for the video camera. Hence, when the proposed solution is applied for safety on-board vehicles, or in transport infrastructures, or smart cities, the camera installed in closed-circuit television surveillance systems can be reused. The achieved experimental results show that the proposed solution is suitable for creating a smart and real-time video-surveillance system for fire/smoke detection.

[1]  Yaohong Qu,et al.  Early Forest Fire Region Segmentation Based on Deep Learning , 2019, 2019 Chinese Control And Decision Conference (CCDC).

[2]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Shixiao Wu,et al.  Using Popular Object Detection Methods for Real Time Forest Fire Detection , 2018, 2018 11th International Symposium on Computational Intelligence and Design (ISCID).

[4]  Deok-Jin Lee,et al.  Deep Learning-Based Real-Time Multiple-Object Detection and Tracking from Aerial Imagery via a Flying Robot with GPU-Based Embedded Devices , 2019, Sensors.

[5]  S. R. Vijayalakshmi,et al.  Smoke detection in video images using background subtraction method for early fire alarm system , 2017, 2017 2nd International Conference on Communication and Electronics Systems (ICCES).

[6]  A. Enis Çetin,et al.  Covariance matrix-based fire and flame detection method in video , 2012, Machine Vision and Applications.

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Nikolaos Grammalidis,et al.  Real time video fire detection using spatio-temporal consistency energy , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[9]  Sergio Saponara,et al.  AdViSED: Advanced Video SmokE Detection for Real-Time Measurements in Antifire Indoor and Outdoor Systems , 2020, Energies.

[10]  Alessia Saggese,et al.  Improving Fire Detection Reliability by a Combination of Videoanalytics , 2014, ICIAR.

[11]  Pu Li,et al.  Image fire detection algorithms based on convolutional neural networks , 2020, Case Studies in Thermal Engineering.

[12]  Dewi Putrie Lestari,et al.  Fire Hotspots Detection System on CCTV Videos Using You Only Look Once (YOLO) Method and Tiny YOLO Model for High Buildings Evacuation , 2019, 2019 2nd International Conference of Computer and Informatics Engineering (IC2IE).

[13]  Rishabh Sharma,et al.  FireNet: A Specialized Lightweight Fire & Smoke Detection Model for Real-Time IoT Applications , 2019, ArXiv.

[14]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[15]  Luca Fanucci,et al.  Early video smoke detection system to improve fire protection in rolling stocks , 2014, Photonics Europe.

[16]  François Chollet,et al.  Deep Learning with Python , 2017 .

[17]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[18]  Kyriaki Kaza,et al.  Fire Detection from Images Using Faster R-CNN and Multidimensional Texture Analysis , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Joonwhoan Lee,et al.  A Video-Based Fire Detection Using Deep Learning Models , 2019, Applied Sciences.

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Kang-Hyun Jo,et al.  Fast Smoke Detection for Video Surveillance Using CUDA , 2018, IEEE Transactions on Industrial Informatics.

[22]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Turgay Çelik,et al.  Fire and smoke detection without sensors: Image processing based approach , 2007, 2007 15th European Signal Processing Conference.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Sergio Saponara,et al.  Distributed Video Antifire Surveillance System Based on IoT Embedded Computing Nodes , 2019, ApplePies.

[26]  Ali Rafiee,et al.  Fire and smoke detection using wavelet analysis and disorder characteristics , 2011, 2011 3rd International Conference on Computer Research and Development.

[27]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Shiqian Wu,et al.  Real-time image smoke detection using staircase searching-based dual threshold AdaBoost and dynamic analysis , 2015, IET Image Process..

[29]  Xin Chen,et al.  Flame detection using deep learning , 2018, 2018 4th International Conference on Control, Automation and Robotics (ICCAR).