Autonomous Spacecraft Inspection with Free-Flying Drones

This paper describes a proof-of-concept mission demonstrating a multi-agent system performing visual inspection of damage sustained by a spacecraft. Free-flying satellites, simulated by unmanned aerial vehicles (UAVs), autonomously fly around a mock space module maximizing the search space for damage detection. The free-flyers are responsible for independently coordinating their flights to avoid collision with the space module and each other, while executing mission tasks. Damage analysis on the surface of the mock space module is performed in real-time using video from each free-flyer. Three-dimensional modeling is deployed offline to supplement and improve damage detection. This approach demonstrates the feasibility of deploying real space systems for damage detection, where 2D analysis can quickly determine region of interest and 3D visualization can produce a human-navigable virtual environment with depth perspective for further investigation.

[1]  Izhak Rubin,et al.  A framework and analysis for cooperative search using UAV swarms , 2004, SAC '04.

[2]  Farid García,et al.  Segmentation of images by color features: A survey , 2018, Neurocomputing.

[3]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[4]  Qingquan Li,et al.  A Novel 3D Building Damage Detection Method Using Multiple Overlapping UAV Images , 2014 .

[5]  M. Student,et al.  Sobel Edge Detection Algorithm , 2013 .

[6]  Louis J. Glaab,et al.  Sense and Avoid Characterization of the Independent Configurable Architecture for Reliable Operations of Unmanned Systems , 2019 .

[7]  Sanja Seljan,et al.  Photogrammetric 3D Scanning of Physical Objects: Tools and Workflow , 2019 .

[8]  César Muñoz,et al.  A Decentralized Framework to Support UAS Merging and Spacing Operations in Urban Canyons , 2020, 2020 International Conference on Unmanned Aircraft Systems (ICUAS).

[9]  Kristina Lerman,et al.  A Review of Probabilistic Macroscopic Models for Swarm Robotic Systems , 2004, Swarm Robotics.

[10]  C. Muñoz,et al.  A Path Planning Algorithm to Enable Well-Clear Low Altitude UAS Operation Beyond Visual Line of Sight , 2017 .

[11]  Brandon Arritt,et al.  Damage Detection in Bolted Space Structures , 2010 .

[12]  Brandon Arritt,et al.  Embedded nonlinear ultrasonics for structural health monitoring of satellite joints , 2008, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[13]  Erol Sahin,et al.  Swarm Robotics: From Sources of Inspiration to Domains of Application , 2004, Swarm Robotics.

[14]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[15]  César A. Muñoz,et al.  Independent Configurable Architecture for Reliable Operation of Unmanned Systems with Distributed Onboard Services , 2018, 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC).

[16]  Zhigang Shen,et al.  Real-time 3D Reconstruction on Construction Site using Visual SLAM and UAV , 2017, ArXiv.

[17]  Jonathan P. How,et al.  Search and Rescue Under the Forest Canopy Using Multiple UAS , 2020, ISER.

[18]  Norman Kerle,et al.  UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning , 2014 .

[19]  David McComas,et al.  NASA/GSFC's Flight Software Core Flight System , 2013 .

[20]  Q. Guo,et al.  An integrated UAV-borne lidar system for 3D habitat mapping in three forest ecosystems across China , 2017 .

[21]  Astha Baxi,et al.  A Review on Otsu Image Segmentation Algorithm , 2013 .

[22]  Nicholas L. Johnson,et al.  Orbital Debris: the Growing Threat to Space Operations , 2010 .

[23]  Guido Morgenthal,et al.  Quality Assessment of Unmanned Aerial Vehicle (UAV) Based Visual Inspection of Structures , 2014 .

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.