Efficient Fire Detection for Uncertain Surveillance Environment

Tactile Internet can combine multiple technologies by enabling intelligence via mobile edge computing and data transmission over a 5G network. Recently, several convolutional neural networks (CNN) based methods via edge intelligence are utilized for fire detection in certain environment with reasonable accuracy and running time. However, these methods fail to detect fire in uncertain Internet of Things (IoT) environment having smoke, fog, and snow. Furthermore, achieving good accuracy with reduced running time and model size is challenging for resource constrained devices. Therefore, in this paper, we propose an efficient CNN based system for fire detection in videos captured in uncertain surveillance scenarios. Our approach uses light-weight deep neural networks with no dense fully connected layers, making it computationally inexpensive. Experiments are conducted on benchmark fire datasets and the results reveal the better performance of our approach compared to state-of-the-art. Considering the accuracy, false alarms, size, and running time of our system, we believe that it is a suitable candidate for fire detection in uncertain IoT environment for mobile and embedded vision applications during surveillance.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Debarati Guha-Sapir,et al.  Annual Disaster Statistical Review 2009The numbers and trends , 2010 .

[3]  Sung Wook Baik,et al.  Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features , 2018, IEEE Access.

[4]  Stavros A. Koubias,et al.  Architecture Design and Implementation of an Ad-Hoc Network for Disaster Relief Operations , 2007, IEEE Transactions on Industrial Informatics.

[5]  Sung Wook Baik,et al.  Object-oriented convolutional features for fine-grained image retrieval in large surveillance datasets , 2018, Future Gener. Comput. Syst..

[6]  Debarati Guha-Sapir,et al.  Estimating populations affected by disasters : A review of methodological issues and research gaps , 2015 .

[7]  Sung Wook Baik,et al.  Efficient visual attention driven framework for key frames extraction from hysteroscopy videos , 2017, Biomed. Signal Process. Control..

[8]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[9]  Sung Wook Baik,et al.  Secure Surveillance Framework for IoT Systems Using Probabilistic Image Encryption , 2018, IEEE Transactions on Industrial Informatics.

[10]  Farhat Fnaiech,et al.  Convolutional neural network for video fire and smoke detection , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[11]  Ebroul Izquierdo,et al.  A Probabilistic Approach for Vision-Based Fire Detection in Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Martin Maier,et al.  The tactile internet: vision, recent progress, and open challenges , 2016, IEEE Communications Magazine.

[13]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[14]  Shahid Mumtaz,et al.  Massive Internet of Things for Industrial Applications: Addressing Wireless IIoT Connectivity Challenges and Ecosystem Fragmentation , 2017, IEEE Industrial Electronics Magazine.

[15]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[16]  Gerhard Fettweis,et al.  5G-Enabled Tactile Internet , 2016, IEEE Journal on Selected Areas in Communications.

[17]  Alessia Saggese,et al.  Improving Fire Detection Reliability by a Combination of Videoanalytics , 2014, ICIAR.

[18]  Dongil Han,et al.  Development of Early Tunnel Fire Detection Algorithm Using the Image Processing , 2006, ISVC.

[19]  Athanasios V. Vasilakos,et al.  A survey on trust management for Internet of Things , 2014, J. Netw. Comput. Appl..

[20]  Martin Mueller,et al.  Optical Flow Estimation for Flame Detection in Videos , 2013, IEEE Transactions on Image Processing.

[21]  Sung Wook Baik,et al.  Privacy-preserving image retrieval for mobile devices with deep features on the cloud , 2018, Comput. Commun..

[22]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[25]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[26]  Shahid Mumtaz,et al.  Guest Editorial 5G and Beyond Mobile Technologies and Applications for Industrial IoT (IIoT) , 2018, IEEE Transactions on Industrial Informatics.

[27]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Moulay A. Akhloufi,et al.  On the use of stereovision to develop a novel instrumentation system to extract geometric fire fronts characteristics , 2011 .

[29]  Ali Rafiee,et al.  Fire and smoke detection using wavelet analysis and disorder characteristics , 2011, 2011 3rd International Conference on Computer Research and Development.

[30]  Kyoung-Don Kang,et al.  Cost-Effective Security Support in Real-Time Video Surveillance , 2015, IEEE Transactions on Industrial Informatics.

[31]  Surbhi Narwani Real-Time Fire Detection for Video Surveillance Applications Using a Combination of Experts Based On Color , Shape and Motion , 2016 .

[32]  Hélène Laurent,et al.  Investigation of a novel image segmentation method dedicated to forest fire applications , 2013 .

[33]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[34]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[35]  Sung Wook Baik,et al.  CNN-based anti-spoofing two-tier multi-factor authentication system , 2019, Pattern Recognit. Lett..

[36]  A. Enis Çetin,et al.  Covariance matrix-based fire and flame detection method in video , 2012, Machine Vision and Applications.

[37]  Kang-Hyun Jo,et al.  Fast Smoke Detection for Video Surveillance Using CUDA , 2018, IEEE Transactions on Industrial Informatics.

[38]  Gerhard P. Fettweis,et al.  The Tactile Internet: Applications and Challenges , 2014, IEEE Vehicular Technology Magazine.

[39]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[40]  Sung Wook Baik,et al.  Early fire detection using convolutional neural networks during surveillance for effective disaster management , 2017, Neurocomputing.

[41]  Markus Loepfe,et al.  An image processing technique for fire detection in video images , 2006 .

[42]  Sung Wook Baik,et al.  Efficient Conversion of Deep Features to Compact Binary Codes Using Fourier Decomposition for Multimedia Big Data , 2018, IEEE Transactions on Industrial Informatics.

[43]  Sung Wook Baik,et al.  Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[44]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[45]  Mohsen Guizani,et al.  Aerial Control System for Spectrum Efficiency in UAV-to-Cellular Communications , 2018, IEEE Communications Magazine.

[46]  Alessia Saggese,et al.  Real-Time Fire Detection for Video-Surveillance Applications Using a Combination of Experts Based on Color, Shape, and Motion , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  José Fernando Rodrigues,et al.  BoWFire: Detection of Fire in Still Images by Integrating Pixel Color and Texture Analysis , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[48]  Sung Wook Baik,et al.  Raspberry Pi assisted face recognition framework for enhanced law-enforcement services in smart cities , 2017, Future Gener. Comput. Syst..