Multimodal Wildland Fire Smoke Detection

Research has shown that climate change creates warmer temperatures and drier conditions, leading to longer wildfire seasons and increased wildfire risks in the United States. These factors have, in turn, led to increases in the frequency, extent, and severity of wildfires in recent years. Given the danger posed by wildland fires to people, property, wildlife, and the environment, there is an urgent need to provide tools for effective wildfire management. Early detection of wildfires is essential to minimizing potentially catastrophic destruction. To that end, in this paper, we present our work on integrating multiple data sources into SmokeyNet, a deep learning model using spatiotemporal information to detect smoke from wildland fires. We present Multimodal SmokeyNet and SmokeyNet Ensemble for multimodal wildland fire smoke detection using satellite-based fire detections, weather sensor measurements, and optical camera images. An analysis is provided to compare these multimodal approaches to the baseline SmokeyNet in terms of accuracy metrics, as well as time-to-detect, which is important for the early detection of wildfires. Our results show that incorporating weather data in SmokeyNet improves performance numerically in terms of both F1 and time-to-detect over the baseline with a single data source. With a time-to-detect of only a few minutes, SmokeyNet can be used for automated early notification of wildfires, providing a useful tool in the fight against destructive wildfires.

[1]  G. Cottrell,et al.  FIgLib & SmokeyNet: Dataset and Deep Learning Model for Real-Time Wildland Fire Smoke Detection , 2021, Remote. Sens..

[2]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[3]  A. P. Williams,et al.  Impact of anthropogenic climate change on wildfire across western US forests , 2016, Proceedings of the National Academy of Sciences.

[4]  Oa Us Epa Climate Change Indicators: Wildfires , 2016 .

[5]  A. Westerling Increasing western US forest wildfire activity: sensitivity to changes in the timing of spring , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  I. Parberry,et al.  Cartesian Coordinate Systems , 2011 .

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Donald J. Wuebbles,et al.  Climate Science Special Report: Fourth National Climate Assessment, Volume I , 2017 .

[11]  L. Crowder,et al.  Climate Science Special Report: Fourth National Climate Assessment (NCA4), Volume I , 2017 .

[12]  David R. Easterling,et al.  Impacts, Risks, and Adaptation in the United States: Fourth National Climate Assessment, Volume II , 2017 .

[13]  Alisa Favinger,et al.  The Polar Coordinate System , 2008 .

[14]  Bruce G. Terrell,et al.  National Oceanic and Atmospheric Administration , 2020, Federal Regulatory Guide.

[15]  Eielson Afb UNITED STATES ENVIRONMENTAL PROTECTION AGENCY - _ , 1993 .

[16]  A. Krizhevsky ImageNet Classification with Deep Convolutional Neural Networks , 2022 .