Classification of Video Observation Data for Volcanic Activity Monitoring Using Computer Vision and Modern Neural NetWorks (on Klyuchevskoy Volcano Example)

Currently, video observation systems are actively used for volcano activity monitoring. Video cameras allow us to remotely assess the state of a dangerous natural object and to detect thermal anomalies if technical capabilities are available. However, continuous use of visible band cameras instead of special tools (for example, thermal cameras), produces large number of images, that require the application of special algorithms both for preliminary filtering out the images with area of interest hidden due to weather or illumination conditions, and for volcano activity detection. Existing algorithms use preselected regions of interest in the frame for analysis. This region could be changed occasionally to observe events in a specific area of the volcano. It is a problem to set it in advance and keep it up to date, especially for an observation network with multiple cameras. The accumulated perennial archives of images with documented eruptions allow us to use modern deep learning technologies for whole frame analysis to solve the specified task. The article presents the development of algorithms to classify volcano images produced by video observation systems. The focus is on developing the algorithms to create a labelled dataset from an unstructured archive using existing and authors proposed techniques. The developed solution was tested using the archive of the video observation system for the volcanoes of Kamchatka, in particular the observation data for the Klyuchevskoy volcano. The tests show the high efficiency of the use of convolutional neural networks in volcano image classification, and the accuracy of classification achieved 91%. The resulting dataset consisting of 15,000 images and labelled in three classes of scenes is the first dataset of this kind of Kamchatka volcanoes. It can be used to develop systems for monitoring other stratovolcanoes that occupy most of the video frame.

[1]  En Zhu,et al.  Deep Clustering with Convolutional Autoencoders , 2017, ICONIP.

[2]  Kerstin Stebel,et al.  Measurement of three dimensional volcanic plume properties using multiple ground based infrared cameras , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  A.А. Sorokin,et al.  The Signal automated information system: research and operational monitoring of dangerous natural phenomena in the Russian Far East , 2019 .

[4]  R. Grainger,et al.  Simultaneous retrieval of volcanic sulphur dioxide and plume height from hyperspectral data using artificial neural networks , 2014 .

[5]  Jeffrey B. Johnson,et al.  Volcano video data characterized and classified using computer vision and machine learning algorithms , 2020 .

[6]  Qunying Huang,et al.  Disaster Image Classification by Fusing Multimodal Social Media Data , 2021, ISPRS Int. J. Geo Inf..

[7]  Hala H. Zayed,et al.  Day/Night Detector for Vehicle Tracking in Traffic Monitoring Systems , 2016 .

[8]  Shuguang Wu,et al.  Landslide Deformation Prediction Based on a GNSS Time Series Analysis and Recurrent Neural Network Model , 2021, Remote. Sens..

[9]  Fabio Sansivero,et al.  Processing Thermal Infrared Imagery Time-Series from Volcano Permanent Ground-Based Monitoring Network. Latest Methodological Improvements to Characterize Surface Temperatures Behavior of Thermal Anomaly Areas , 2019, Remote. Sens..

[10]  Alessandro Piscini,et al.  Volcanic hot spot detection from optical multispectral remote sensing data using artificial neural networks , 2014 .

[11]  A. A. Sorokin,et al.  АНАЛИЗ ИЗОБРАЖЕНИЙ ДЛЯ ОПРЕДЕЛЕНИЯ ВИДИМОСТИ ВУЛКАНОВ , 2018 .

[12]  Bruno Ando,et al.  An advanced video-based system for monitoring active volcanoes , 2006, Comput. Geosci..

[13]  Dong L. Wu,et al.  Geometric estimation of volcanic eruption column height from GOES-R near-limb imagery – Part 2: Case studies , 2021, Atmospheric Chemistry and Physics.

[14]  Vincent Barra,et al.  An algorithm for the detection and characterisation of volcanic plumes using thermal camera imagery , 2018 .

[15]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[16]  Jieqing Tan,et al.  A Novel Handwritten Digit Classification System Based on Convolutional Neural Network Approach , 2021, Sensors.

[17]  G. Morra,et al.  Machine learning as a detection method of Strombolian eruptions in infrared images from Mount Erebus, Antarctica , 2020 .

[18]  Zhong Lu,et al.  Remote Sensing of Volcanic Processes and Risk , 2020, Remote. Sens..

[19]  Ehsan Harirchian,et al.  A Synthesized Study Based on Machine Learning Approaches for Rapid Classifying Earthquake Damage Grades to RC Buildings , 2021, Applied Sciences.

[20]  Cuiping Shi,et al.  A Waste Classification Method Based on a Multilayer Hybrid Convolution Neural Network , 2021, Applied Sciences.

[21]  S. Raghukanth,et al.  Prediction of Ground Motion Intensity Measures Using an Artificial Neural Network , 2021, Pure and Applied Geophysics.