Fire detection for video surveillance applications using ICA K-medoids-based color model and efficient spatio-temporal visual features

Abstract Automated detection of fire flames in videos shot from a surveillance camera is an active research topic, as fire detection must be accurate and fast. The present study proposes and evaluates an efficient fire detection method. The contributions of this method lies in threefold: (1) a robust ICA (Imperialist Competitive Algorithm) K-medoids-based color model first is developed to reliably detect all candidate fire regions in a scene; (2) a motion-intensity-aware motion detection technique is introduced to simply extract the regions containing movement together with the motion intensity rate of every moving pixel, which are then used to analyze the characteristics of the fire; (3) a set of new spatio-temporal features having the distinct characteristics of fire flames are extracted from the candidate fire regions which are fed into a support vector machine classifier in order to distinguish real fire regions from non-real ones. The experimental results for a set of benchmark fire video datasets and videos provided in this research confirm that the proposed method outperforms state-of-the-art fire detection approaches, providing high detection accuracy and a low false detection rate.

[1]  Gwanggil Jeon,et al.  Vision-Based Fire Detection Algorithm Using Optical Flow , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[2]  Mahdi Hashemzadeh,et al.  Content-aware image resizing: An improved and shadow-preserving seam carving method , 2019, Signal Process..

[3]  Sung Wook Baik,et al.  Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Turgay Çelik,et al.  Fire Pixel Classification using Fuzzy Logic and Statistical Color Model , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  Bo Jiang,et al.  Towards a solid solution of real-time fire and flame detection , 2015, Multimedia Tools and Applications.

[6]  Bob Zhang,et al.  Background modeling methods in video analysis: A review and comparative evaluation , 2016, CAAI Trans. Intell. Technol..

[7]  Ashish Ghosh,et al.  Real-time record sensitive background classifier (RSBC) , 2019, Expert Syst. Appl..

[8]  ByoungChul Ko,et al.  Fire detection based on vision sensor and support vector machines , 2009 .

[9]  Hakil Kim,et al.  Adaptive flame detection using randomness testing and robust features , 2013 .

[10]  Martin Mueller,et al.  Optical Flow Estimation for Flame Detection in Videos , 2013, IEEE Transactions on Image Processing.

[11]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Primož Podržaj,et al.  Intelligent Space as a Framework for Fire Detection and Evacuation , 2008 .

[13]  Toby P. Breckon,et al.  A non-temporal texture driven approach to real-time fire detection , 2011, 2011 18th IEEE International Conference on Image Processing.

[14]  Mahdi Hashemzadeh,et al.  Combining keypoint-based and segment-based features for counting people in crowded scenes , 2016, Inf. Sci..

[15]  Mahdi Hashemzadeh Hiding information in videos using motion clues of feature points , 2018, Comput. Electr. Eng..

[16]  Xiaoqiao Meng,et al.  Real-time forest fire detection with wireless sensor networks , 2005, Proceedings. 2005 International Conference on Wireless Communications, Networking and Mobile Computing, 2005..

[17]  Miguel A. Molina-Cabello,et al.  Smart motion detection sensor based on video processing using self-organizing maps , 2016, Expert Syst. Appl..

[18]  Giuseppe Polese,et al.  A Normalization Framework for Multimedia Databases , 2007, IEEE Transactions on Knowledge and Data Engineering.

[19]  Yang Yang,et al.  Flame detection algorithm based on a saliency detection technique and the uniform local binary pattern in the YCbCr color space , 2016, Signal Image Video Process..

[20]  Caro Lucas,et al.  Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition , 2007, 2007 IEEE Congress on Evolutionary Computation.

[21]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[22]  Sung Wook Baik,et al.  Early fire detection using convolutional neural networks during surveillance for effective disaster management , 2017, Neurocomputing.

[23]  Markus Loepfe,et al.  An image processing technique for fire detection in video images , 2006 .

[24]  R.C. Luo,et al.  Autonomous Fire-Detection System Using Adaptive Sensory Fusion for Intelligent Security Robot , 2007, IEEE/ASME Transactions on Mechatronics.

[25]  Seungryong Kim,et al.  Fast illumination-robust foreground detection using hierarchical distribution map for real-time video surveillance system , 2016, Expert Syst. Appl..

[26]  Ashfaqur Rahman,et al.  Detection of Multiple Dynamic Textures Using Feature Space Mapping , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  ByoungChul Ko,et al.  Modeling and Formalization of Fuzzy Finite Automata for Detection of Irregular Fire Flames , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Xi Zhang,et al.  A real-time video fire flame and smoke detection algorithm , 2013 .

[29]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[30]  Shang-Pin Ma,et al.  Robust Little Flame Detection on Real-Time Video Surveillance System , 2012, 2012 Third International Conference on Innovations in Bio-Inspired Computing and Applications.

[31]  Chee Peng Lim,et al.  A new PSO-based approach to fire flame detection using K-Medoids clustering , 2017, Expert Syst. Appl..

[32]  Kasim Tasdemir,et al.  Video based wildfire detection at night , 2009 .

[33]  Mahdi Hashemzadeh,et al.  Combining velocity and Location-Specific Spatial Clues in Trajectories for Counting Crowded Moving Objects , 2013, Int. J. Pattern Recognit. Artif. Intell..

[34]  Moulay A. Akhloufi,et al.  Computer vision for wildfire research: An evolving image dataset for processing and analysis , 2017 .

[35]  Toby P. Breckon,et al.  Experimentally Defined Convolutional Neural Network Architecture Variants for Non-Temporal Real-Time Fire Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[36]  Mahdi Hashemzadeh,et al.  A Machine Vision System for Detecting Fertile Eggs in the Incubation Industry , 2016, Int. J. Comput. Intell. Syst..

[37]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[38]  Mahdi Hashemzadeh,et al.  A fast and accurate moving object tracker in active camera model , 2017, Multimedia Tools and Applications.

[39]  Hakil Kim,et al.  Fast fire flame detection in surveillance video using logistic regression and temporal smoothing , 2016 .

[40]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[41]  Xiangyu Wang,et al.  What is a visual language? , 2017, J. Vis. Lang. Comput..

[42]  Steven Verstockt,et al.  Video fire detection - Review , 2013, Digit. Signal Process..

[43]  Ivan Laptev,et al.  ContextLocNet: Context-Aware Deep Network Models for Weakly Supervised Localization , 2016, ECCV.

[44]  P Jenifer Notice of Violation of IEEE Publication PrinciplesEffective visual fire detection in video sequences using probabilistic approach , 2011, 2011 International Conference on Emerging Trends in Electrical and Computer Technology.

[45]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[46]  Hwa-Young Jeong,et al.  RGB Color Model Based the Fire Detection Algorithm in Video Sequences on Wireless Sensor Network , 2014, Int. J. Distributed Sens. Networks.

[47]  A. Enis Çetin,et al.  Covariance matrix-based fire and flame detection method in video , 2012, Machine Vision and Applications.

[48]  Mubarak Shah,et al.  Flame recognition in video , 2002, Pattern Recognit. Lett..

[49]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Sung Wook Baik,et al.  Object-oriented convolutional features for fine-grained image retrieval in large surveillance datasets , 2018, Future Gener. Comput. Syst..

[51]  Hasan Demirel,et al.  Fire detection in video sequences using a generic color model , 2009 .

[52]  Serdar Korukoglu,et al.  Moving object detection and tracking by using annealed background subtraction method in videos: Performance optimization , 2012, Expert Syst. Appl..

[53]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[54]  Ali Rafiee,et al.  Fire and smoke detection using wavelet analysis and disorder characteristics , 2011, 2011 3rd International Conference on Computer Research and Development.

[55]  Mahdi Hashemzadeh,et al.  Counting moving people in crowds using motion statistics of feature-points , 2013, Multimedia Tools and Applications.

[56]  Xiaojun Qi,et al.  A computer vision-based method for fire detection in color videos , 2009 .

[57]  A. Enis Çetin,et al.  Flame detection in video using hidden Markov models , 2005, IEEE International Conference on Image Processing 2005.

[58]  Wei Gao,et al.  Fire flame detection based on GICA and target tracking , 2013 .

[59]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[60]  Ebroul Izquierdo,et al.  A Probabilistic Approach for Vision-Based Fire Detection in Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[61]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[62]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[63]  Mahdi Hashemzadeh,et al.  Exemplar-based facial expression recognition , 2018, Inf. Sci..

[64]  Juan A. Sigüenza,et al.  Intelligent video surveillance beyond robust background modeling , 2018, Expert Syst. Appl..

[65]  Gennaro Costagliola,et al.  Visual language implementation through standard compiler-compiler techniques , 2007, J. Vis. Lang. Comput..

[66]  Shi-Kuo Chang,et al.  Picture processing grammar and its applications , 1971, Inf. Sci..

[67]  Chris T. Kiranoudis,et al.  A background subtraction algorithm for detecting and tracking vehicles , 2011, Expert Syst. Appl..

[68]  Lei Gao,et al.  Video fire detection based on Gaussian Mixture Model and multi-color features , 2017, Signal Image Video Process..

[69]  Alessia Saggese,et al.  Real-Time Fire Detection for Video-Surveillance Applications Using a Combination of Experts Based on Color, Shape, and Motion , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[70]  Ebroul Izquierdo,et al.  Efficient visual fire detection applied for video retrieval , 2008, 2008 16th European Signal Processing Conference.

[71]  Jong-Myon Kim,et al.  Fire flame detection in video sequences using multi-stage pattern recognition techniques , 2012, Eng. Appl. Artif. Intell..