Wildfire smoke detection based on local extremal region segmentation and surveillance

Abstract A novel video-based method is proposed for long-distance wildfire smoke detection. Since the long-distance wildfire smoke usually moves slowly and lacks salient features in the video, the detection is still a challenging problem. Unlike many traditional video-based methods that usually rely on the smoke color or motion for initial smoke region segmentation, we use the Maximally Stable Extremal Region (MSER) detection method to extract local extremal regions of the smoke. This makes the initial segmentation of possible smoke region less dependent on the motion and color information. Potential smoke regions are then selected from all the possible regions by using some static visual features of the smoke, helping to eliminate the non-smoke regions as many as possible. Once a potential smoke region is found, we keep tracking it by searching the best-matched extremal regions in the subsequent frames. At the same time, the propagating motions of the potential smoke region are monitored based on a novel cumulated region approach, which can be effectively used to identify the distinctive expanding and rising motions of smoke. This approach can also make the final smoke motion identification insensitive to image shaking. It was proved that the proposed method is able to reliably detect the long-distance wildfire smoke and simultaneously produce very few false alarms in actual applications.

[1]  David Nistér,et al.  Linear Time Maximally Stable Extremal Regions , 2008, ECCV.

[2]  A. Enis Çetin,et al.  Contour based smoke detection in video using wavelets , 2006, 2006 14th European Signal Processing Conference.

[3]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[4]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[5]  Philippe Guillemant,et al.  Real-time identification of smoke images by clustering motions on a fractal curve with a temporal embedding method , 2001 .

[6]  ByoungChul Ko,et al.  Spatiotemporal bag-of-features for early wildfire smoke detection , 2013, Image Vis. Comput..

[7]  Darko Stipanicev,et al.  Visual spatial-context based wildfire smoke sensor , 2012, Machine Vision and Applications.

[8]  Steven Verstockt,et al.  Silhouette-based multi-sensor smoke detection , 2011, Machine Vision and Applications.

[9]  Begoña C. Arrue,et al.  Computer vision techniques for forest fire perception , 2008, Image Vis. Comput..

[10]  Thomas B. Moeslund,et al.  Thermal cameras and applications: a survey , 2013, Machine Vision and Applications.

[11]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[12]  Jong-Myon Kim,et al.  An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems , 2011 .

[13]  Zhiyong Yuan,et al.  Dynamic texture based smoke detection using Surfacelet transform and HMT model , 2015 .

[14]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[15]  A. Enis Çetin,et al.  Wildfire detection using LMS based active learning , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Michel Couprie,et al.  Building the Component Tree in Quasi-Linear Time , 2006, IEEE Transactions on Image Processing.

[17]  ByoungChul Ko,et al.  Wildfire smoke detection using temporospatial features and random forest classifiers , 2012 .

[18]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[20]  Chao-Ho Chen,et al.  The smoke detection for early fire-alarming system base on video processing , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[21]  Darko Stipaničev,et al.  HISTOGRAM-BASED SMOKE SEGMENTATION IN FOREST FIRE DETECTION SYSTEM , 2009 .

[22]  Simone Calderara,et al.  Reliable smoke detection in the domains of image energy and color , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  Aníbal Ollero,et al.  An Intelligent System for False Alarm Reduction in Infrared Forest-Fire Detection , 2000, IEEE Intell. Syst..

[24]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.