Early fire detection using convolutional neural networks during surveillance for effective disaster management

Abstract Fire disasters are man-made disasters, which cause ecological, social, and economic damage. To minimize these losses, early detection of fire and an autonomous response are important and helpful to disaster management systems. Therefore, in this article, we propose an early fire detection framework using fine-tuned convolutional neural networks for CCTV surveillance cameras, which can detect fire in varying indoor and outdoor environments. To ensure the autonomous response, we propose an adaptive prioritization mechanism for cameras in the surveillance system. Finally, we propose a dynamic channel selection algorithm for cameras based on cognitive radio networks, ensuring reliable data dissemination. Experimental results verify the higher accuracy of our fire detection scheme compared to state-of-the-art methods and validate the applicability of our framework for effective fire disaster management.

[1]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Basit Shafiq,et al.  Spatial Computing and Social Media in the Context of Disaster Management , 2012, IEEE Intelligent Systems.

[3]  Dengyi Zhang,et al.  Contour Based Forest Fire Detection Using FFT and Wavelet , 2008, 2008 International Conference on Computer Science and Software Engineering.

[4]  Sung Wook Baik,et al.  Visual saliency models for summarization of diagnostic hysteroscopy videos in healthcare systems , 2016, SpringerPlus.

[5]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[6]  R.C. Luo,et al.  Autonomous Fire-Detection System Using Adaptive Sensory Fusion for Intelligent Security Robot , 2007, IEEE/ASME Transactions on Mechatronics.

[7]  Sung Wook Baik,et al.  A novel magic LSB substitution method (M-LSB-SM) using multi-level encryption and achromatic component of an image , 2015, Multimedia Tools and Applications.

[8]  Yi Deng,et al.  urvey of data management and analysis in disaster situations , 2010 .

[9]  Debarati Guha-Sapir,et al.  Annual Disaster Statistical Review 2009The numbers and trends , 2010 .

[10]  Asrar U. H. Sheikh,et al.  A comparative study of spectrum awareness techniques for cognitive radio oriented wireless networks , 2013, Phys. Commun..

[11]  A. Enis Çetin,et al.  Covariance matrix-based fire and flame detection method in video , 2012, Machine Vision and Applications.

[12]  Martin Mueller,et al.  Optical Flow Estimation for Flame Detection in Videos , 2013, IEEE Transactions on Image Processing.

[13]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Surbhi Narwani Real-Time Fire Detection for Video Surveillance Applications Using a Combination of Experts Based On Color , Shape and Motion , 2016 .

[15]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[16]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[17]  Ashfaqur Rahman,et al.  Detection of Multiple Dynamic Textures Using Feature Space Mapping , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Shi-Wei Lo,et al.  Cyber Surveillance for Flood Disasters , 2015, Sensors.

[19]  ByoungChul Ko,et al.  Modeling and Formalization of Fuzzy Finite Automata for Detection of Irregular Fire Flames , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[21]  Ali Rafiee,et al.  Fire and smoke detection using wavelet analysis and disorder characteristics , 2011, 2011 3rd International Conference on Computer Research and Development.

[22]  K. B. Letaief,et al.  Optimization of cooperative spectrum sensing with energy detection in cognitive radio networks , 2009, IEEE Transactions on Wireless Communications.

[23]  Jing Pan,et al.  Learning Pooling for Convolutional Neural Network , 2017, Neurocomputing.

[24]  Steven Verstockt,et al.  Video driven fire spread forecasting (f) using multi-modal LWIR and visual flame and smoke data , 2013, Pattern Recognit. Lett..

[25]  Xu Ying,et al.  Collaborative Multi-hop Routing in Cognitive Wireless Networks , 2015, Wireless Personal Communications.

[26]  Narendra Ahuja,et al.  Vision based fire detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[27]  Alessia Saggese,et al.  Improving Fire Detection Reliability by a Combination of Videoanalytics , 2014, ICIAR.

[28]  Alessia Saggese,et al.  Real-Time Fire Detection for Video-Surveillance Applications Using a Combination of Experts Based on Color, Shape, and Motion , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  José Fernando Rodrigues,et al.  BoWFire: Detection of Fire in Still Images by Integrating Pixel Color and Texture Analysis , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[30]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[31]  Ivan Laptev,et al.  ContextLocNet: Context-Aware Deep Network Models for Weakly Supervised Localization , 2016, ECCV.

[32]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[33]  Sung Wook Baik,et al.  Mobile-Cloud Assisted Video Summarization Framework for Efficient Management of Remote Sensing Data Generated by Wireless Capsule Sensors , 2014, Sensors.

[34]  Marco Bibuli,et al.  Low cost optronic obstacle detection sensor for unmanned surface vehicles , 2015, 2015 IEEE Sensors Applications Symposium (SAS).

[35]  Yong Yan,et al.  An Autoadaptive Edge-Detection Algorithm for Flame and Fire Image Processing , 2012, IEEE Transactions on Instrumentation and Measurement.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Ebroul Izquierdo,et al.  A Probabilistic Approach for Vision-Based Fire Detection in Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[39]  Moulay A. Akhloufi,et al.  On the use of stereovision to develop a novel instrumentation system to extract geometric fire fronts characteristics , 2011 .

[40]  Baihua Li,et al.  A Fast Image Retrieval Method Designed for Network Big Data , 2017, IEEE Transactions on Industrial Informatics.

[41]  Hélène Laurent,et al.  Investigation of a novel image segmentation method dedicated to forest fire applications , 2013 .

[42]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[43]  Sung Wook Baik,et al.  Efficient visual attention driven framework for key frames extraction from hysteroscopy videos , 2017, Biomed. Signal Process. Control..

[44]  Rui Chi,et al.  Real-time multi-feature based fire flame detection in video , 2017, IET Image Process..

[45]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[46]  Sung Wook Baik,et al.  Saliency-directed prioritization of visual data in wireless surveillance networks , 2015, Inf. Fusion.

[47]  Markus Loepfe,et al.  An image processing technique for fire detection in video images , 2006 .

[48]  Li Sun,et al.  Event-based large scale surveillance video summarization , 2016, Neurocomputing.

[49]  Özgür B. Akan,et al.  Delay-sensitive and multimedia communication in cognitive radio sensor networks , 2012, Ad Hoc Networks.

[50]  Wonyong Sung,et al.  Fixed point optimization of deep convolutional neural networks for object recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[51]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[52]  Moulay A. Akhloufi,et al.  Benchmarking of wildland fire colour segmentation algorithms , 2015, IET Image Process..

[53]  Zhihan Lv,et al.  Internet cross-media retrieval based on deep learning , 2017, J. Vis. Commun. Image Represent..

[54]  Mubarak Shah,et al.  Flame recognition in video , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[55]  Chia-Chen Lin,et al.  Blind Dual Watermarking for Color Images’ Authentication and Copyright Protection , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Dongil Han,et al.  Development of Early Tunnel Fire Detection Algorithm Using the Image Processing , 2006, ISVC.

[57]  ByoungChul Ko,et al.  Fire detection based on vision sensor and support vector machines , 2009 .

[58]  Sung Wook Baik,et al.  Image steganography using uncorrelated color space and its application for security of visual contents in online social networks , 2016, Future Gener. Comput. Syst..

[59]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[60]  Sung Wook Baik,et al.  Image steganography for authenticity of visual contents in social networks , 2017, Multimedia Tools and Applications.

[61]  Ramadhan J. Mstafa,et al.  A video steganography algorithm based on Kanade-Lucas-Tomasi tracking algorithm and error correcting codes , 2015, Multimedia Tools and Applications.