Building Energy-Cost Maps From Aerial Images and Ground Robot Measurements With Semi-Supervised Deep Learning

Planning energy-efficient paths is an important capability in many robotics applications. Obtaining an energy-cost map for a given environment enables planning such paths between any given pair of locations within the environment. However, efficiently building an energy map is challenging, especially for large environments. Some of the prior work uses physics-based laws (friction and gravity force) to model energy costs across environments. These methods work well for uniform surfaces, but they do not generalize well to uneven terrains. In this letter, we present a method to address this mapping problem in a data-driven fashion for the cases where an aerial image of the environment can be obtained. To efficiently build an energy-cost map, we train a neural network that learns to predict the complete energy maps by combining aerial images and sparse ground robot energy-consumption measurements. Field experiments are performed to validate our results. We show that our method can efficiently build an energy-cost map accurately even across different types of ground robots.

[1]  Alessandro Giusti,et al.  Learning Ground Traversability From Simulations , 2017, IEEE Robotics and Automation Letters.

[2]  Volkan Isler,et al.  Air To Ground Collaboration For Energy-efficient Path Planning For Ground Robots , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Xi Chen,et al.  Geometric and visual terrain classification for autonomous mobile navigation , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Y. Charlie Hu,et al.  Energy-efficient motion planning for mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Dong Sun,et al.  Minimizing Energy Consumption of Wheeled Mobile Robots via Optimal Motion Planning , 2014, IEEE/ASME Transactions on Mechatronics.

[6]  Volkan Isler,et al.  Environment and Solar Map Construction for Solar-Powered Mobile Systems , 2016, IEEE Transactions on Robotics.

[7]  Zheng Sun,et al.  On finding energy-minimizing paths on terrains , 2005, IEEE Transactions on Robotics.

[8]  Milan Simic,et al.  Sampling-Based Robot Motion Planning: A Review , 2014, IEEE Access.

[9]  Pratap Tokekar,et al.  Energy-Efficient Path Planning for Solar-Powered Mobile Robots , 2012, ISER.

[10]  Pratap Tokekar,et al.  Energy-optimal trajectory planning for car-like robots , 2014, Auton. Robots.

[11]  Robin De Keyser,et al.  Heuristic approaches in robot path planning: A survey , 2016, Robotics Auton. Syst..

[12]  Davide Scaramuzza,et al.  Active Autonomous Aerial Exploration for Ground Robot Path Planning , 2017, IEEE Robotics and Automation Letters.

[13]  Fawzi Nashashibi,et al.  Sparse and Dense Data with CNNs: Depth Completion and Semantic Segmentation , 2018, 2018 International Conference on 3D Vision (3DV).

[14]  Nak Young Chong,et al.  Estimating Achievable Range of Ground Robots Operating on Single Battery Discharge for Operational Efficacy Amelioration , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Steven M. LaValle,et al.  Efficient nearest neighbor searching for motion planning , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[16]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Sven Koenig,et al.  Fast replanning for navigation in unknown terrain , 2005, IEEE Transactions on Robotics.

[20]  Volkan Isler,et al.  Energy-efficient Path Planning for Ground Robots by Combining Air and Ground Measurements , 2019, CoRL.

[21]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.