An Improved Forest Fire Detection Method Based on the Detectron2 Model and a Deep Learning Approach

With an increase in both global warming and the human population, forest fires have become a major global concern. This can lead to climatic shifts and the greenhouse effect, among other adverse outcomes. Surprisingly, human activities have caused a disproportionate number of forest fires. Fast detection with high accuracy is the key to controlling this unexpected event. To address this, we proposed an improved forest fire detection method to classify fires based on a new version of the Detectron2 platform (a ground-up rewrite of the Detectron library) using deep learning approaches. Furthermore, a custom dataset was created and labeled for the training model, and it achieved higher precision than the other models. This robust result was achieved by improving the Detectron2 model in various experimental scenarios with a custom dataset and 5200 images. The proposed model can detect small fires over long distances during the day and night. The advantage of using the Detectron2 algorithm is its long-distance detection of the object of interest. The experimental results proved that the proposed forest fire detection method successfully detected fires with an improved precision of 99.3%.

[1]  M. Mukhiddinov,et al.  Development of Language Models for Continuous Uzbek Speech Recognition System , 2023, Sensors.

[2]  T. Whangbo,et al.  Improved Face Detection Method via Learning Small Faces on Hard Images Based on a Deep Learning Approach , 2023, Sensors.

[3]  J. Chedjou,et al.  Improved Agricultural Field Segmentation in Satellite Imagery Using TL-ResUNet Architecture , 2022, Sensors.

[4]  M. Mukhiddinov,et al.  A Wildfire Smoke Detection System Using Unmanned Aerial Vehicle Images Based on the Optimized YOLOv5 , 2022, Sensors.

[5]  M. Mukhiddinov,et al.  Development of Real-Time Landmark-Based Emotion Recognition CNN for Masked Faces , 2022, Sensors.

[6]  I. Tarimer,et al.  Effect of Feature Selection on the Accuracy of Music Popularity Classification Using Machine Learning Algorithms , 2022, Electronics.

[7]  T. Whangbo,et al.  Modeling and Applying Implicit Dormant Features for Recommendation via Clustering and Deep Factorization , 2022, Sensors.

[8]  T. Whangbo,et al.  Improved Feature Parameter Extraction from Speech Signals Using Machine Learning Algorithm , 2022, Sensors.

[9]  Fazal Haque Malik,et al.  The Impact of Agile Methodology on Project Success, with a Moderating Role of Person’s Job Fit in the IT Industry of Pakistan , 2022, Applied Sciences.

[10]  T. Whangbo,et al.  Improved Real-Time Fire Warning System Based on Advanced Technologies for Visually Impaired People , 2022, Sensors.

[11]  T. Whangbo,et al.  Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images , 2022, Sensors.

[12]  Leonardo Martins,et al.  Real-Time Integration of Segmentation Techniques for Reduction of False Positive Rates in Fire Plume Detection Systems during Forest Fires , 2022, Remote. Sens..

[13]  Jinsoo Cho,et al.  Automatic Speech Recognition Method Based on Deep Learning Approaches for Uzbek Language , 2022, Sensors.

[14]  M. Mukhiddinov,et al.  Automatic Fire Detection and Notification System Based on Improved YOLOv4 for the Blind and Visually Impaired , 2022, Sensors.

[15]  Mukhriddin Mukhiddinov,et al.  An improvement for the automatic classification method for ultrasound images used on CNN , 2021, Int. J. Wavelets Multiresolution Inf. Process..

[16]  Kaidi Zhang,et al.  Fire detection using vision transformer on power plant , 2022, Energy Reports.

[17]  Ugur Ayvaz,et al.  Automatic Speaker Recognition Using Mel-Frequency Cepstral Coefficients Through Machine Learning , 2022, Computers, Materials & Continua.

[18]  M. Mukhiddinov,et al.  Fire Detection Method in Smart City Environments Using a Deep-Learning-Based Approach , 2021, Electronics.

[19]  A. Abdusalomov,et al.  LDA-Based Topic Modeling Sentiment Analysis Using Topic/Document/Sentence (TDS) Model , 2021, Applied Sciences.

[20]  Taeg Keun Whangbo,et al.  3D Volume Reconstruction from MRI Slices based on VTK , 2021, 2021 International Conference on Information and Communication Technology Convergence (ICTC).

[21]  F. Guede-Fernández,et al.  A Deep Learning Based Object Identification System for Forest Fire Detection , 2021, Fire.

[22]  Taeg Keun Whangbo,et al.  An Improvement of the Fire Detection and Classification Method Using YOLOv3 for Surveillance Systems , 2021, Sensors.

[23]  Vishal M. Patel,et al.  Medical Transformer: Gated Axial-Attention for Medical Image Segmentation , 2021, MICCAI.

[24]  Yushi Chen,et al.  Spatial-Spectral Transformer for Hyperspectral Image Classification , 2021, Remote. Sens..

[25]  Matthieu Cord,et al.  Training data-efficient image transformers & distillation through attention , 2020, ICML.

[26]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[27]  Moulay A. Akhloufi,et al.  Wildfire Segmentation Using Deep Vision Transformers , 2021, Remote. Sens..

[28]  Taeg Keun Whangbo,et al.  Evolving Hierarchical and Tag Information via the Deeply Enhanced Weighted Non-Negative Matrix Factorization of Rating Predictions , 2020, Symmetry.

[29]  Young Im Cho,et al.  Automatic Fire and Smoke Detection Method for Surveillance Systems Based on Dilated CNNs , 2020, Atmosphere.

[30]  Young Im Cho,et al.  Improvement of the end-to-end scene text recognition method for "text-to-speech" conversion , 2020, Int. J. Wavelets Multiresolution Inf. Process..

[31]  Brian J. Reich,et al.  A deep learning approach to identify smoke plumes in satellite imagery in near real-time for health risk communication , 2020, Journal of Exposure Science & Environmental Epidemiology.

[32]  Young Im Cho,et al.  Automatic Moving Shadow Detection and Removal Method for Smart City Environments , 2020 .

[33]  Baining Guo,et al.  Learning Texture Transformer Network for Image Super-Resolution , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Pu Li,et al.  Image fire detection algorithms based on convolutional neural networks , 2020, Case Studies in Thermal Engineering.

[35]  Nicolas Usunier,et al.  End-to-End Object Detection with Transformers , 2020, ECCV.

[36]  Taeg Keun Whangbo,et al.  Automatic Salient Object Extraction Based on Locally Adaptive Thresholding to Generate Tactile Graphics , 2020, Applied Sciences.

[37]  Diaa Badawi,et al.  Computationally Efficient Wildfire Detection Method Using a Deep Convolutional Network Pruned via Fourier Analysis , 2020, Sensors.

[38]  Baijian Yang,et al.  Deep Learning Based Wildfire Event Object Detection from 4K Aerial Images Acquired by UAS , 2020, AI.

[39]  Roman Marsalek,et al.  Deep Convolutional Neural Network for Fire Detection , 2020, 2020 30th International Conference Radioelektronika (RADIOELEKTRONIKA).

[40]  Byoung Chul Ko,et al.  Two-Step Real-Time Night-Time Fire Detection in an Urban Environment Using Static ELASTIC-YOLOv3 and Temporal Fire-Tube , 2020, Sensors.

[41]  Mark Crowley,et al.  A review of machine learning applications in wildfire science and management , 2020, Environmental Reviews.

[42]  Taeg Keun Whangbo,et al.  Detection and Removal of Moving Object Shadows Using Geometry and Color Information for Indoor Video Streams , 2019 .

[43]  Jun Jo,et al.  A deep learning approach for early wildfire detection from hyperspectral satellite images , 2019, 2019 7th International Conference on Robot Intelligence Technology and Applications (RiTA).

[44]  Junguo Zhang,et al.  Detection of Wildfire Smoke Images Based on a Densely Dilated Convolutional Network , 2019, Electronics.

[45]  Taeg Keun Whangbo,et al.  Fully Automatic Stroke Symptom Detection Method Based on Facial Features and Moving Hand Differences , 2019, 2019 International Symposium on Multimedia and Communication Technology (ISMAC).

[46]  Joonwhoan Lee,et al.  A Video-Based Fire Detection Using Deep Learning Models , 2019, Applied Sciences.

[47]  Chen Chen,et al.  SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention , 2019, Remote. Sens..

[48]  Kyriaki Kaza,et al.  Fire Detection from Images Using Faster R-CNN and Multidimensional Texture Analysis , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  Yang Wang,et al.  Cross-Modal Self-Attention Network for Referring Image Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Andrew Zisserman,et al.  Video Action Transformer Network , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Shixiao Wu,et al.  Using Popular Object Detection Methods for Real Time Forest Fire Detection , 2018, 2018 11th International Symposium on Computational Intelligence and Design (ISCID).

[52]  D. Roy,et al.  The Collection 6 MODIS burned area mapping algorithm and product , 2018, Remote sensing of environment.

[53]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[54]  Chen Sun,et al.  Revisiting Unreasonable Effectiveness of Data in Deep Learning Era , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[55]  Taeg Keun Whangbo,et al.  An improvement for the foreground recognition method using shadow removal technique for indoor environments , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[56]  Taeg Keun Whangbo,et al.  A Review on various widely used shadow detection methods to identify a shadow from image , 2016 .

[57]  Moulay A. Akhloufi,et al.  Automatic fire pixel detection using image processing: a comparative analysis of rule-based and machine learning-based methods , 2016, Signal Image Video Process..

[58]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  A. Abdusalomov,et al.  Robust Shadow Removal Technique For Improving Image Enhancement Based On Segmentation Method , 2016 .

[60]  Nikolaos Grammalidis,et al.  Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[61]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[62]  Stephen Dovers,et al.  Evaluating benefits and costs of wildland fires: critical review and future applications , 2014 .

[63]  Ahmad A. A. Alkhatib A Review on Forest Fire Detection Techniques , 2014, Int. J. Distributed Sens. Networks.

[64]  M. Sreeraj,et al.  Object detection and classification in surveillance system , 2013, 2013 IEEE Recent Advances in Intelligent Computational Systems (RAICS).

[65]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[66]  Qiang Wang,et al.  Large Space Fire Image Processing of Improving Canny Edge Detector Based on Adaptive Smoothing , 2010, 2010 International Conference on Innovative Computing and Communication and 2010 Asia-Pacific Conference on Information Technology and Ocean Engineering.

[67]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[68]  Josep Piñol,et al.  Climate Warming, Wildfire Hazard, and Wildfire Occurrence in Coastal Eastern Spain , 1998 .