Automatic Parameter Tuning of Motion Planning Algorithms

Motion planning algorithms attempt to find a good compromise between planning time and quality of solution. Due to their heuristic nature, they are typically configured with several parameters. In this paper we demonstrate that, in many scenarios, the widely used default parameter values are not ideal. However, finding the best parameters to optimise some metric(s) is not trivial because the size of the parameter space can be large. We evaluate and compare the efficiency of four different methods (i.e. random sampling, AUC-Bandit, random forest, and bayesian optimisation) to tune the parameters of two motion planning algorithms, BKPIECE and RRT-connect. We present a table-top-reaching scenario where the seven degrees-of-freedom KUKA LWR robotic arm has to move from an initial to a goal pose in the presence of several objects in the environment. We show that the best methods for BKPIECE (AUC-Bandit) and RRT-Connect (random forest) improve the performance by 4.5x and 1.26x on average respectively. Then, we generate a set of random scenarios of increasing complexity, and we observe that optimal parameters found in simple environments perform well in more complex scenarios. Finally, we find that the time required to evaluate parameter configurations can be reduced by more than 2/3 with low error. Overall, our results demonstrate that for a variety of motion planning problems it is possible to find solutions that significantly improve the performance over default configurations while requiring very reasonable computation times.

[1]  Yiming Yang,et al.  EXOTica: An Extensible Optimization Toolset for Prototyping and Benchmarking Motion Planning and Control , 2018, Studies in Computational Intelligence.

[2]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[3]  Jeremy Singer,et al.  Solving the task variant allocation problem in distributed robotics , 2018, Autonomous Robots.

[4]  Emmanuel G. Collins,et al.  Motion Planning for Mobile Robots Via Sampling-Based Model Predictive Optimization , 2011 .

[5]  Robert Babuska,et al.  Automated tuning and configuration of path planning algorithms , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Shoaib Kamil,et al.  OpenTuner: An extensible framework for program autotuning , 2014, 2014 23rd International Conference on Parallel Architecture and Compilation (PACT).

[7]  Jeremy Singer,et al.  Task Variant Allocation in Distributed Robotics , 2016, Robotics: Science and Systems.

[8]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[9]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[10]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[11]  Carolyn Pillers Dobler,et al.  The Practice of Statistics , 2001, Technometrics.

[12]  Milan Simic,et al.  Sampling-Based Robot Motion Planning: A Review , 2014, IEEE Access.

[13]  Michael F. P. O'Boyle,et al.  Integrating algorithmic parameters into benchmarking and design space exploration in 3D scene understanding , 2016, 2016 International Conference on Parallel Architecture and Compilation Techniques (PACT).

[14]  Lydia E. Kavraki,et al.  Kinodynamic Motion Planning by Interior-Exterior Cell Exploration , 2008, WAFR.

[15]  Kris K. Hauser,et al.  An empirical study of optimal motion planning , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[17]  Lydia E. Kavraki,et al.  Benchmarking Motion Planning Algorithms: An Extensible Infrastructure for Analysis and Visualization , 2014, IEEE Robotics & Automation Magazine.

[18]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Sethu Vijayakumar,et al.  Automatic configuration of ROS applications for near-optimal performance , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).