Fire Detection from Images Using Faster R-CNN and Multidimensional Texture Analysis

In this paper, we propose a novel image-based fire detection approach, which combines the power of modern deep learning networks with multidimensional texture analysis based on higher-order linear dynamical systems. The candidate fire regions are identified by a Faster R-CNN network trained for the task of fire detection using a set of annotated images containing actual fire as well as selected negatives. The candidate fire regions are projected to a Grassmannian space and each image is represented as a cloud of points on the manifold. Finally, a vector representation approach is applied aiming to aggregate the Grassmannian points based on a locality criterion on the manifold. For evaluating the performance of the proposed methodology, we performed experiments with annotated images of two different databases containing fire and fire-coloured objects. Experimental results demonstrate the potential of the proposed methodology compared to other state of the art approaches.

[1]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[2]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Nikolaos Grammalidis,et al.  A multi-sensor network for the protection of cultural heritage , 2011, 2011 19th European Signal Processing Conference.

[7]  Qixing Zhang,et al.  Wildland Forest Fire Smoke Detection Based on Faster R-CNN using Synthetic Smoke Images , 2018 .

[8]  Nikolaos Grammalidis,et al.  Higher Order Linear Dynamical Systems for Smoke Detection in Video Surveillance Applications , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Xin Chen,et al.  Flame detection using deep learning , 2018, 2018 4th International Conference on Control, Automation and Robotics (ICCAR).

[10]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[11]  Ivan Laptev,et al.  Efficient Feature Extraction, Encoding, and Classification for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Ole-Christoffer Granmo,et al.  Deep Convolutional Neural Networks for Fire Detection in Images , 2017, EANN.

[13]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Nikolaos Grammalidis,et al.  Real time video fire detection using spatio-temporal consistency energy , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[15]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  José Fernando Rodrigues,et al.  Fire Detection from Social Media Images by Means of Instance-Based Learning , 2015, ICEIS.

[17]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[18]  Nikos Grammalidis,et al.  Classification of Multidimensional Time-Evolving Data Using Histograms of Grassmannian Points , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Nikos Grammalidis,et al.  Flame Detection for Video-based Early Fire Warning Systems and 3D Visualization of Fire Propagation , 2012 .

[20]  Jay Lee,et al.  Detecting events from the social media through exemplar-enhanced supervised learning , 2018, Int. J. Digit. Earth.

[21]  Gerd Stumme,et al.  Mining social media to inform peatland fire and haze disaster management , 2017, Social Network Analysis and Mining.

[22]  G. Sjoden Gram-Schmidt Orthogonalization and Fourier Series , 2009 .

[23]  Moulay A. Akhloufi,et al.  Computer vision for wildfire research: An evolving image dataset for processing and analysis , 2017 .

[24]  J. Manuel,et al.  Forest fires under climate, social and economic changes in Europe, the Mediterranean and other fire-affected areas of the world , 2014 .