Autonomous Exploration of Small Bodies Toward Greater Autonomy for Deep Space Missions

Autonomy is becoming increasingly important for the robotic exploration of unpredictable environments. One such example is the approach, proximity operation, and surface exploration of small bodies. In this article, we present an overview of an estimation framework to approach and land on small bodies as a key functional capability for an autonomous small-body explorer. We use a multi-phase perception/estimation pipeline with interconnected and overlapping measurements and algorithms to characterize and reach the body, from millions of kilometers down to its surface. We consider a notional spacecraft design that operates across all phases from approach to landing and to maneuvering on the surface of the microgravity body. This SmallSat design makes accommodations to simplify autonomous surface operations. The estimation pipeline combines state-of-the-art techniques with new approaches to estimating the target’s unknown properties across all phases. Centroid and light-curve algorithms estimate the body–spacecraft relative trajectory and rotation, respectively, using a priori knowledge of the initial relative orbit. A new shape-from-silhouette algorithm estimates the pole (i.e., rotation axis) and the initial visual hull that seeds subsequent feature tracking as the body gets more resolved in the narrow field-of-view imager. Feature tracking refines the pole orientation and shape of the body for estimating initial gravity to enable safe close approach. A coarse-shape reconstruction algorithm is used to identify initial landable regions whose hazardous nature would subsequently be assessed by dense 3D reconstruction. Slope stability, thermal, occlusion, and terra-mechanical hazards would be assessed on densely reconstructed regions and continually refined prior to landing. We simulated a mission scenario for approaching a hypothetical small body whose motion and shape were unknown a priori, starting from thousands of kilometers down to 20 km. Results indicate the feasibility of recovering the relative body motion and shape solely relying on onboard measurements and estimates with their associated uncertainties and without human input. Current work continues to mature and characterize the algorithms for the last phases of the estimation framework to land on the surface.

[1]  Luigi Glielmo,et al.  A Survey on Model-Based Mission Planning and Execution for Autonomous Spacecraft , 2018, IEEE Systems Journal.

[2]  William M. Owen,et al.  Methods of optical navigation , 2011 .

[3]  Saptarshi Bandyopadhyay,et al.  Architecture Trades for Accessing Small Bodies with an Autonomous Small Spacecraft , 2020, 2020 IEEE Aerospace Conference.

[4]  C. A. Grasso,et al.  The fully programmable spacecraft: procedural sequencing for JPL deep space missions using VML (Virtual Machine Language) , 2002, Proceedings, IEEE Aerospace Conference.

[6]  P. Pandurang Nayak,et al.  Spacecraft Autonomy Flight Experience: The DS1 Remote Agent Experiment , 1999 .

[7]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[8]  Marco Pavone,et al.  Design, Control, and Experimentation of Internally-Actuated Rovers for the Exploration of Low-Gravity Planetary Bodies , 2015, FSR.

[9]  Tara Estlin,et al.  The CLARAty architecture for robotic autonomy , 2001, 2001 IEEE Aerospace Conference Proceedings (Cat. No.01TH8542).

[10]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[11]  M. McHenry,et al.  A ROS-based Simulator for Testing the Enhanced Autonomous Navigation of the Mars 2020 Rover , 2020, 2020 IEEE Aerospace Conference.

[12]  K. Forbes Calibration, Recognition, and Shape from Silhouettes of Stones , 2007 .

[13]  Operation of MINERVA rover in Hayabusa Asteroid Mission , 2006 .

[14]  Rob Sherwood,et al.  The EO-1 autonomous science agent , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[15]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[16]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[17]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  P. Pandurang Nayak,et al.  Validating the DS-1 Remote Agent Experiment , 1999 .

[19]  M. Yamada,et al.  The surface composition of asteroid 162173 Ryugu from Hayabusa2 near-infrared spectroscopy , 2019, Science.

[20]  Marco Pavone,et al.  Design, Control, and Experimentation of Internally‐Actuated Rovers for the Exploration of Low‐gravity Planetary Bodies , 2016, FSR.

[21]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, SM '03.

[22]  B. Hapke Bidirectional reflectance spectroscopy , 1984 .

[23]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[24]  M. Lauer,et al.  OPTICAL MEASUREMENTS FOR ROSETTA NAVIGATION NEAR THE COMET , 2015 .

[25]  Benjamin Morrell Autonomous Feature Tracking for Autonomous Approach to a Small Body , 2020 .

[26]  Lorraine M. Fesq,et al.  Autonomy for Space Robots: Past, Present, and Future , 2021, Current Robotics Reports.

[27]  Shyam Bhaskaran,et al.  Autonomous navigation for Deep Space Missions , 2012 .

[28]  Daniel J. Scheeres,et al.  Characterizing and navigating small bodies with imaging data , 2006 .

[29]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, ACM Symposium on Solid Modeling and Applications.

[30]  Derek C. Richardson,et al.  AIDA DART asteroid deflection test: Planetary defense and science objectives , 2018, Planetary and Space Science.

[31]  Joseph A. Burns,et al.  Asteroid Nutation Angles , 1973 .

[32]  Stephan Ulamec,et al.  Capabilities of Philae, the Rosetta Lander , 2009 .

[33]  C. Tomasi Detection and Tracking of Point Features , 1991 .

[34]  Karri Muinonen,et al.  Optimization Methods for Asteroid Lightcurve Inversion. II. The Complete Inverse Problem , 2001 .

[35]  Petr Pravec,et al.  The asteroid lightcurve database , 2009 .

[36]  Maxwell B. Fairbairn,et al.  Planetary Photometry: The Lommel-Seeliger Law , 2005 .

[37]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[38]  Mark Perry,et al.  Artificial Intelligence, Robotics and Automation in Space , 1999 .

[39]  M. Pavone,et al.  Expected science return of spatially-extended in-situ exploration at small Solar system bodies , 2012, 2012 IEEE Aerospace Conference.

[40]  Shyam Bhaskaran,et al.  Navigation of the Deep Space 1 spacecraft at Borrelly , 2002 .

[41]  D. N. DellaGiustina,et al.  Properties of rubble-pile asteroid (101955) Bennu from OSIRIS-REx imaging and thermal analysis , 2019, Nature Astronomy.

[42]  E. Ofek,et al.  ASTEROID LIGHT CURVES FROM THE PALOMAR TRANSIENT FACTORY SURVEY: ROTATION PERIODS AND PHASE FUNCTIONS FROM SPARSE PHOTOMETRY , 2015, 1504.04041.

[43]  R. P. D. Santayana,et al.  FAR APPROACH OPTICAL NAVIGATION AND COMET PHOTOMETRY FOR THE ROSETTA MISSION , 2022 .

[44]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[45]  Veverka,et al.  Radio science results during the NEAR-shoemaker spacecraft rendezvous with eros , 2000, Science.

[46]  Descent and touchdown dynamics for sample collection in hayabusa mission , 2006 .

[47]  Roland Siegwart,et al.  Voxblox: Incremental 3D Euclidean Signed Distance Fields for on-board MAV planning , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[48]  Soon-Jo Chung,et al.  AAS 20-125 OPTICAL NAVIGATION FOR AUTONOMOUS APPROACH OF UNEXPLORED SMALL BODIES , 2020 .

[49]  Matthew McAdam,et al.  The viewing-from-above bias and the silhouette illusion , 2010, i-Perception.

[50]  Joseph E. Riedel,et al.  Deep Impact Autonomous Navigation : the trials of targeting the unknown , 2006 .

[51]  Manabu Yamada,et al.  Image-based autonomous navigation of Hayabusa2 using artificial landmarks: The design and brief in-flight results of the first landing on asteroid Ryugu , 2020, Astrodynamics.

[52]  Andrew E. Johnson,et al.  Real-time Terrain Relative Navigation Test Results from a Relevant Environment for Mars Landing , 2015 .

[53]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking , 2005, International Journal of Computer Vision.

[54]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Lok Ming Lui,et al.  Spherical Conformal Parameterization of Genus-0 Point Clouds for Meshing , 2015, SIAM J. Imaging Sci..

[56]  Mauro Massari,et al.  Adaptive Generalized ZEM-ZEV Feedback Guidance for Planetary Landing via a Deep Reinforcement Learning Approach , 2020, ArXiv.

[57]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Soon-Jo Chung,et al.  Spacecraft Pose Estimation from Monocular Images Using Neural Network Based Keypoints and Visibility Maps , 2020 .

[59]  B. Hapke Bidirectional reflectance spectroscopy 7: The single particle phase function hockey stick relation , 2012 .

[60]  Alexander May,et al.  Lessons learned from OSIRIS-REx autonomous navigation using natural feature tracking , 2017, 2017 IEEE Aerospace Conference.

[61]  Julia M. Badger,et al.  Autonomous Systems Taxonomy , 2018 .

[62]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part I: Theory and Algorithms , 2005, International Journal of Computer Vision.

[63]  David Sternberg,et al.  Extended Mission Technology Demonstrations Using the ASTERIA Spacecraft , 2019, 2019 IEEE Aerospace Conference.

[64]  Christopher A. Grasso,et al.  Configuring the Deep Impact AutoNav System for Lunar, Comet and Mars Landing , 2008 .

[65]  Ari K. Jónsson,et al.  Universal Executive and PLEXIL: Engine and Language for Robust Spacecraft Control and Operations , 2006 .

[66]  I. Nesnas,et al.  Silhouette-Based 3D Shape Reconstruction of a Small Body from a Spacecraft , 2019, 2019 IEEE Aerospace Conference.

[67]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[68]  D. Scheeres Orbital motion in strongly perturbed environments : applications to asteroid, comet and planetary satellite orbiters , 2012 .

[69]  Christopher A. Grasso,et al.  Optical Navigation Plan and Strategy for the Lunar Lander Altair; OpNav for Lunar and other Crewed and Robotic Exploration Applications , 2010 .

[70]  Rachid Alami,et al.  An Architecture for Autonomy , 1998, Int. J. Robotics Res..

[71]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .