Deep learning universal crater detection using Segment Anything Model (SAM)

Craters are amongst the most important morphological features in planetary exploration. To that extent, detecting, mapping and counting craters is a mainstream process in planetary science, done primarily manually, which is a very laborious and time-consuming process. Recently, machine learning (ML) and computer vision have been successfully applied for both detecting craters and estimating their size. Existing ML approaches for automated crater detection have been trained in specific types of data e.g. digital elevation model (DEM), images and associated metadata for orbiters such as the Lunar Reconnaissance Orbiter Camera (LROC) etc.. Due to that, each of the resulting ML schemes is applicable and reliable only to the type of data used during the training process. Data from different sources, angles and setups can compromise the reliability of these ML schemes. In this paper we present a universal crater detection scheme that is based on the recently proposed Segment Anything Model (SAM) from META AI. SAM is a prompt-able segmentation system with zero-shot generalization to unfamiliar objects and images without the need for additional training. Using SAM we can successfully identify crater-looking objects in any type of data (e,g, raw satellite images Level-1 and 2 products, DEMs etc.) for different setups (e.g. Lunar, Mars) and different capturing angles. Moreover, using shape indexes, we only keep the segmentation masks of crater-like features. These masks are subsequently fitted with an ellipse, recovering both the location and the size/geometry of the detected craters.

[1]  Seyyed Amir Hadi Minoofam,et al.  TRCLA: A Transfer Learning Approach to Reduce Negative Transfer for Cellular Learning Automata , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jin Liu,et al.  MRISNet:Deep-learning-based Martian instance segmentation against blur , 2022, Earth Science Informatics.

[3]  M. Niethammer,et al.  SimpleClick: Interactive Image Segmentation with Simple Vision Transformers , 2022, 2023 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Shuang Liu,et al.  Classification of Knee Osteoarthritis Based on Transfer Learning Model and Magnetic Resonance Images , 2022, 2022 International Conference on Machine Learning, Control, and Robotics (MLCR).

[5]  D. Buscombe,et al.  A Reproducible and Reusable Pipeline for Segmentation of Geoscientific Imagery , 2022, Earth and Space Science.

[6]  Xueming Xiao,et al.  A hybrid attention semantic segmentation network for unstructured terrain on Mars , 2022, Acta Astronautica.

[7]  M. Lavagna,et al.  Optical navigation for Lunar landing based on Convolutional Neural Network crater detector , 2022, Aerospace Science and Technology.

[8]  Jingdao Chen,et al.  Mars Terrain Segmentation with Less Labels , 2022, 2022 IEEE Aerospace Conference (AERO).

[9]  E. Slob,et al.  Deep learning–based nondestructive evaluation of reinforcement bars using ground‐penetrating radar and electromagnetic induction data , 2021, Comput. Aided Civ. Infrastructure Eng..

[10]  Ross B. Girshick,et al.  Masked Autoencoders Are Scalable Vision Learners , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Konstantin Sofiiuk,et al.  Reviving Iterative Training with Mask Guidance for Interactive Segmentation , 2021, 2022 IEEE International Conference on Image Processing (ICIP).

[12]  Tingting He,et al.  Multi-type Microbial Relation Extraction by Transfer Learning , 2021, 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[13]  Hisayuki Sasaoka,et al.  Basic Study for Transfer Learning for Autonomous Driving in Car Race of Model Car , 2021, 2021 6th International Conference on Business and Industrial Research (ICBIR).

[14]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[15]  Hujun Yin,et al.  Deep Learning-based Aerial Image Segmentation with Open Data for Disaster Impact Assessment , 2020, Neurocomputing.

[16]  Yong Ho Song,et al.  Binarized Encoder-Decoder Network and Binarized Deconvolution Engine for Semantic Segmentation , 2021, IEEE Access.

[17]  L. Kexin,et al.  Application of Generative Adversarial Network in Semantic Segmentation , 2020, 2020 17th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[18]  J. Benediktsson,et al.  Lunar impact crater identification and age estimation with Chang’E data by deep and transfer learning , 2020, Nature Communications.

[19]  Jonghyun Lee,et al.  Bathymetric Inversion and Uncertainty Estimation from Synthetic Surf-Zone Imagery with Machine Learning , 2020, Remote. Sens..

[20]  Yu Zhou,et al.  Deep learning-based method for SEM image segmentation in mineral characterization, an example from Duvernay Shale samples in Western Canada Sedimentary Basin , 2020, Comput. Geosci..

[21]  Lena M. Downes,et al.  Deep Learning Crater Detection for Lunar Terrain Relative Navigation , 2020 .

[22]  Ross B. Girshick,et al.  LVIS: A Dataset for Large Vocabulary Instance Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Christopher Lee,et al.  Automated crater detection on Mars using deep learning , 2019, Planetary and Space Science.

[24]  Touqeer Ahmad,et al.  Crater Detection Using Unsupervised Algorithms and Convolutional Neural Networks , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Mohamad Ali-Dib,et al.  Lunar crater identification via deep learning , 2018, Icarus.

[26]  Lisa R. Gaddis,et al.  The compositions of the lunar crust and upper mantle: Spectral analysis of the inner rings of lunar impact basins , 2019, Planetary and Space Science.

[27]  Longin Jan Latecki,et al.  Dense Deconvolutional Network for Semantic Segmentation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[28]  J. Grant,et al.  The science process for selecting the landing site for the 2020 Mars rover , 2018, Planetary and Space Science.

[29]  M. Lüthje,et al.  Deep-learning seismic facies on state-of-the-art CNN architectures , 2018, SEG Technical Program Expanded Abstracts 2018.

[30]  Long Xiao,et al.  Geological Characteristics of Von Kármán Crater, Northwestern South Pole‐Aitken Basin: Chang'E‐4 Landing Site Region , 2018, Journal of Geophysical Research: Planets.

[31]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Terrence Fong,et al.  Automatic Crater Detection Using Convex Grouping and Convolutional Neural Networks , 2015, ISVC.

[34]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Yambem Jina Chanu,et al.  Image Segmentation Using K -means Clustering Algorithm and Subtractive Clustering Algorithm , 2015 .

[36]  Wei Li,et al.  A machine learning approach to crater detection from topographic data , 2014 .

[37]  R. Marco Figuera,et al.  Illumination conditions at the lunar south pole using high resolution Digital Terrain Models from LOLA , 2014 .

[38]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[39]  Clark R. Chapman,et al.  The variability of crater identification among expert and community crater analysts , 2014, 1404.1334.

[40]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Sven Lončarić,et al.  LU60645GT and MA132843GT catalogues of Lunar and Martian impact craters developed using a Crater Shape-based interpolation crater detection algorithm for topography data , 2012 .

[42]  Kai Xu,et al.  Image segmentation based on histogram analysis utilizing the cloud model , 2011, Comput. Math. Appl..

[43]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[44]  Pedro Pina,et al.  MA130301GT catalogue of Martian impact craters and advanced evaluation of crater detection algorithms using diverse topography and image datasets , 2011 .

[45]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[46]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  John Wright,et al.  Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Rie Honda,et al.  Learning to Detect Small Impact Craters , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[49]  William K. Hartmann,et al.  Cratering Chronology and the Evolution of Mars , 2001 .

[50]  M.J. Bottema,et al.  Circularity of objects in images , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[51]  R. Grieve Impact cratering , 1981, Nature.