Crater Detection and Registration of Planetary Images Through Marked Point Processes, Multiscale Decomposition, and Region-Based Analysis

Because of the large variety of planetary sensors and spacecraft already collecting data and with many new and improved sensors being planned for future missions, planetary science needs to integrate numerous multimodal image sources, and, as a consequence, accurate and robust registration algorithms are required. In this article, we develop a new framework for crater detection based on marked point processes (MPPs) that can be used for planetary image registration. MPPs were found to be effective for various object detection tasks in Earth observation, and a new MPP model is proposed here for detecting craters in planetary data. The resulting spatial features are exploited for registration, together with fitness functions based on the MPP energy, on the mean directed Hausdorff distance, and on the mutual information. Two different methods—one based on birth–death processes and region-of-interest analysis and the other based on graph cuts and decimated wavelets—are developed within the proposed framework. Experiments with a large set of images, including 13 thermal infrared and visible images of the Mars surface, 20 semisimulated multitemporal pairs of images of the Mars surface, and a real multitemporal image pair of the Lunar surface, demonstrate the effectiveness of the proposed framework in terms of crater detection performance as well as for subpixel registration accuracy.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  Clayton T. Morrison,et al.  A Bayesian Approach to Subkilometer Crater Shape Analysis Using Individual HiRISE Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jon Atli Benediktsson,et al.  Crater detection based on marked point processes , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[4]  Tingting Lv,et al.  Crater Detection via Convolutional Neural Networks , 2016, ArXiv.

[5]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[6]  Ákos Utasi,et al.  A 3-D marked point process model for multi-view people detection , 2011, CVPR 2011.

[7]  G. Michael,et al.  Coordinate registration by automated crater recognition , 2003 .

[8]  A. M. Cross,et al.  Detection of circular geological features using the Hough transform , 1988 .

[9]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[10]  T. Encrenaz,et al.  Mars Surface Diversity as Revealed by the OMEGA/Mars Express Observations , 2005, Science.

[11]  Yu Song,et al.  Directed mean Hausdorff distance of parameterized freeform shapes in 3D: a case study , 2003, The Visual Computer.

[12]  Josiane Zerubia,et al.  A Marked Point Process of Rectangles and Segments for Automatic Analysis of Digital Elevation Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Josiane Zerubia,et al.  Unsupervised marked point process model for boat extraction in harbors from high resolution optical remotely sensed images , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[15]  Bo Wu,et al.  Active Machine Learning Approach for Crater Detection From Planetary Imagery and Digital Elevation Models , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[17]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[18]  Charles Audet,et al.  Analysis of Generalized Pattern Searches , 2000, SIAM J. Optim..

[19]  Navin Goyal,et al.  An Efficient Approximation Algorithm for Point Pattern Matching Under Noise , 2006, LATIN.

[20]  Rie Honda,et al.  Mining of Topographic Feature from Heterogeneous Imagery and Its Application to Lunar Craters , 2002, Progress in Discovery Science.

[21]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Josiane Zerubia,et al.  Tree crown extraction using marked point processes , 2004, 2004 12th European Signal Processing Conference.

[26]  Josiane Zerubia,et al.  Automatic Flamingo detection using a multiple birth and death process , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Brian M. Hynek,et al.  A new global database of Mars impact craters ≥1 km: 2. Global crater properties and regional variations of the simple‐to‐complex transition diameter , 2012 .

[28]  Rie Honda,et al.  Learning to Detect Small Impact Craters , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[29]  James B. Garvin,et al.  Geometric properties of Martian impact craters: Preliminary results from the Mars Orbiter Laser Altimeter , 1998 .

[30]  Jon Atli Benediktsson,et al.  Automatic Extraction of Ellipsoidal Features for Planetary Image Registration , 2012, IEEE Geoscience and Remote Sensing Letters.

[31]  Kim,et al.  Impact crateer detection on optical images and DEMs , 2003 .

[32]  Touqeer Ahmad,et al.  Crater Detection Using Unsupervised Algorithms and Convolutional Neural Networks , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Erwan Mazarico,et al.  Global Distribution of Large Lunar Craters: Implications for Resurfacing and Impactor Populations , 2010, Science.

[34]  Guojun Lu,et al.  A Novel Multi-Modal Image Registration Method Based on Corners , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[35]  Sven Loncaric,et al.  Method for Crater Detection From Martian Digital Topography Data Using Gradient Value/Orientation, Morphometry, Vote Analysis, Slip Tuning, and Calibration , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Athira Haridas,et al.  Study of morphology and degradation of lunar craters using Chandrayaan–1 data , 2019, Planetary and Space Science.

[37]  Mehrdad Moshir,et al.  A Robust Algorithm for the Pointing Refinement and Registration of Astronomical Images , 2004 .

[38]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[39]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[40]  Danyang Liu,et al.  Boundary Detection of Dispersal Impact Craters Based on Morphological Characteristics Using Lunar Digital Elevation Model , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  David M. Mount,et al.  Ecient Algorithms for Robust Feature Matching , 1998 .

[43]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[44]  Josiane Zerubia,et al.  A Marked Point Process Model with Strong Prior Shape Information for the Extraction of Multiple, Arbitrarily-Shaped Objects , 2009, 2009 Fifth International Conference on Signal Image Technology and Internet Based Systems.

[45]  J.F. Andrus,et al.  Digital Image Registration Method Using Boundary Maps , 1975, IEEE Transactions on Computers.

[46]  Xavier Descombes,et al.  Stochastic geometry for image analysis , 2011 .

[47]  Xavier Descombes,et al.  Graph Cut Based Segmentation of Predefined Shapes: Applications to Biological Imaging , 2013, ICPRAM.

[48]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Pedro Pina,et al.  MA130301GT catalogue of Martian impact craters and advanced evaluation of crater detection algorithms using diverse topography and image datasets , 2011 .

[50]  Aoxue Li,et al.  Region-of-Interest Extraction Based on Saliency Analysis of Co-Occurrence Histogram in High Spatial Resolution Remote Sensing Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[51]  Jun Wang,et al.  A Novel Saliency Detection Method for Lunar Remote Sensing Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[52]  Pedro Pina,et al.  Automatic Crater Detection in Large Scale on Lunar Maria , 2015 .

[53]  Erick R. Malaret,et al.  Lessons Learned for NASA Missions Delivering Data to the Planetary Data System , 2012 .

[54]  Pedro Pina,et al.  Crater Delineation by Dynamic Programming , 2015, IEEE Geoscience and Remote Sensing Letters.

[55]  Eric Mjolsness,et al.  Training of a crater detection algorithm for Mars crater imagery , 2002, Proceedings, IEEE Aerospace Conference.

[56]  Charles J. Geyer,et al.  Likelihood inference for spatial point processes , 2019, Stochastic Geometry.

[57]  Jun Li,et al.  Lunar Crater Detection Based on Terrain Analysis and Mathematical Morphology Methods Using Digital Elevation Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Bin Li,et al.  Registration of multi-sensor images based on enhanced STAR algorithm , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[59]  Donghua Zhou,et al.  Saliency detection and edge feature matching approach for crater extraction , 2015 .

[60]  Saburo Tsuji,et al.  Detection of Ellipses by a Modified Hough Transformation , 1978, IEEE Transactions on Computers.

[61]  Ardeshir Goshtasby,et al.  A Region-Based Approach to Digital Image Registration with Subpixel Accuracy , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Jacqueline Le Moigne,et al.  Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery , 2005, IEEE Transactions on Image Processing.

[63]  Josiane Zerubia,et al.  A fast Multiple Birth and Cut algorithm using belief propagation , 2011, 2011 18th IEEE International Conference on Image Processing.

[64]  Christian Wöhler,et al.  Hybrid method for crater detection based on topography reconstruction from optical images and the new LU78287GT catalogue of Lunar impact craters , 2014 .

[65]  Tomasz F. Stepinski,et al.  Automatic detection of sub-km craters in high resolution planetary images , 2009 .

[66]  David M. Mount,et al.  Improved Approximation Bounds for Planar Point Pattern Matching , 2005, Algorithmica.

[67]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[68]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[69]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Thomas S. Huang,et al.  Optimizing Image Registration by Mutually Exclusive Scale Components , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[71]  Josiane Zerubia,et al.  Multiple Birth and Cut Algorithm for Point Process Optimization , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[72]  Pedro Pina,et al.  Impact Crater Recognition on Mars Based on a Probability Volume Created by Template Matching , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[73]  Xavier Descombes,et al.  Double Annealing Regimes in the Multiple Birth-and-Death Stochastic Algorithms , 2012 .

[74]  Xavier Descombes,et al.  Multiple objects detection in biological images using a marked point process framework. , 2017, Methods.

[75]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Takehisa Yairi,et al.  Automated crater detection algorithms from a machine learning perspective in the convolutional neural network era , 2019, Advances in Space Research.

[77]  Pedro Pina,et al.  Crater Detection by a Boosting Approach , 2009, IEEE Geoscience and Remote Sensing Letters.

[78]  Josiane Zerubia,et al.  Road network extraction in remote sensing by a Markov object process , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[79]  Christopher Lee,et al.  Automated crater detection on Mars using deep learning , 2019, Planetary and Space Science.

[80]  Hui A Contour-Based Approach to Multisensor Image Registration , 1995 .

[81]  Clark F. Olson,et al.  Optical landmark detection for spacecraft navigation , 2003 .

[82]  Xavier Descombes,et al.  Author manuscript, published in "Journal of Mathematical Imaging and Vision (2009)" Object , 2008 .

[83]  John W. Keller,et al.  Lunar Reconnaissance Orbiter (LRO): Observations for Lunar Exploration and Science , 2010 .

[84]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Larry H. Matthies,et al.  Crater detection for autonomous landing on asteroids , 2001, Image Vis. Comput..

[86]  Gerald Weber,et al.  Matching Convex Shapes with Respect to the Symmetric Difference , 1996, Algorithmica.

[87]  L. Goddard Information Theory , 1962, Nature.

[88]  A. Ardeshir Goshtasby,et al.  Point pattern matching using convex hull edges , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[89]  Csaba Benedek Efficient building change detection in sparsely populated areas using Coupled Marked Point Processes , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[90]  Josiane Zerubia,et al.  Marked point process in image analysis , 2002, IEEE Signal Process. Mag..

[91]  Juntao Yang,et al.  Coarse-to-Fine Extraction of Small-Scale Lunar Impact Craters From the CCD Images of the Chang’E Lunar Orbiters , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[92]  J. Muller,et al.  Automated crater detection, a new tool for Mars cartography and chronology , 2005 .

[93]  Joseph S. B. Mitchell,et al.  Approximate Geometric Pattern Matching Under Rigid Motions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.