Fault Tolerant Free Gait and Footstep Planning for Hexapod Robot Based on Monte-Carlo Tree

Legged robots can pass through complex field environments by selecting gaits and discrete footholds carefully. Traditional methods plan gait and foothold separately and treat them as the single-step optimal process. However, such processing causes its poor passability in a sparse foothold environment. This paper novelly proposes a coordinative planning method for hexapod robots that regards the planning of gait and foothold as a sequence optimization problem with the consideration of dealing with the harshness of the environment as leg fault. The Monte Carlo tree search algorithm(MCTS) is used to optimize the entire sequence. Two methods, FastMCTS, and SlidingMCTS are proposed to solve some defeats of the standard MCTS applicating in the field of legged robot planning. The proposed planning algorithm combines the fault-tolerant gait method to improve the passability of the algorithm. Finally, compared with other planning methods, experiments on terrains with different densities of footholds and artificially-designed challenging terrain are carried out to verify our methods. All results show that the proposed method dramatically improves the hexapod robot's ability to pass through sparse footholds environment.

[1]  Peter Fankhauser,et al.  Robust Rough-Terrain Locomotion with a Quadrupedal Robot , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Piotr Skrzypczynski,et al.  Rough terrain mapping and classification for foothold selection in a walking robot , 2010, 2010 IEEE Safety Security and Rescue Robotics.

[3]  Kemal Leblebicioglu,et al.  Free gait generation with reinforcement learning for a six-legged robot , 2008, Robotics Auton. Syst..

[4]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[5]  Vítor Matos,et al.  Gait transition and modulation in a quadruped robot: A brainstem-like modulation approach , 2011, Robotics Auton. Syst..

[6]  Pablo González de Santos,et al.  Generating continuous free crab gaits for quadruped robots on irregular terrain , 2005, IEEE Transactions on Robotics.

[7]  S. T. Venkataraman,et al.  A simple legged locomotion gait model , 1997, Robotics Auton. Syst..

[8]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[9]  Jose A. Cobano,et al.  Continuous free-crab gaits for hexapod robots on a natural terrain with forbidden zones: An application to humanitarian demining , 2010, Robotics Auton. Syst..

[10]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[11]  C. Laschi,et al.  Bioinspired underwater legged robot for seabed exploration with low environmental disturbance , 2020, Science Robotics.

[12]  Zhen Liu,et al.  Static Force Analysis of Foot of Electrically Driven Heavy-Duty Six-Legged Robot under Tripod Gait , 2018 .

[13]  Stefan Schaal,et al.  Learning locomotion over rough terrain using terrain templates , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Danwei Wang,et al.  Central Pattern Generator Inspired Control for Adaptive Walking of Biped Robots , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Piotr Skrzypczynski,et al.  Adaptive Motion Planning for Autonomous Rough Terrain Traversal with a Walking Robot , 2016, J. Field Robotics.

[16]  Navinda Kottege,et al.  Weaver: Hexapod robot for autonomous navigation on unstructured terrain , 2018, J. Field Robotics.

[17]  Guangjun Liu,et al.  Low Impact Force and Energy Consumption Motion Planning for Hexapod Robot with Passive Compliant Ankles , 2019, J. Intell. Robotic Syst..

[18]  Jerry E. Pratt,et al.  A Controller for the LittleDog Quadruped Walking on Rough Terrain , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Alois Knoll,et al.  Tactical cooperative planning for autonomous highway driving using Monte-Carlo Tree Search , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[20]  Brett R Fajen,et al.  Visual control of foot placement when walking over complex terrain , 2014, Journal of experimental psychology. Human perception and performance.

[21]  Guangjun Liu,et al.  State estimation of a heavy-duty hexapod robot with passive compliant ankles based on the leg kinematics and IMU data fusion , 2018 .

[22]  Lutfi Taner Tunc,et al.  Experimental study on investigation of dynamics of hexapod robot for mobile machining , 2015 .

[23]  Martin Buehler,et al.  Reliable stair climbing in the simple hexapod 'RHex' , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  Pieter Abbeel,et al.  Hierarchical Apprenticeship Learning with Application to Quadruped Locomotion , 2007, NIPS.

[25]  Stefan Schaal,et al.  Learning, planning, and control for quadruped locomotion over challenging terrain , 2011, Int. J. Robotics Res..

[26]  Reid G. Simmons,et al.  Perception, Planning, and Control for Autonomous Walking With the Ambler Planetary Rover , 1996, Int. J. Robotics Res..

[27]  Robert B. McGhee,et al.  Adaptive Locomotion of a Multilegged Robot over Rough Terrain , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Mohammad Naghshvar,et al.  Risk-averse Behavior Planning for Autonomous Driving under Uncertainty , 2018, ArXiv.

[29]  Jan Wietrzykowski,et al.  Employing Natural Terrain Semantics in Motion Planning for a Multi-Legged Robot , 2018, Journal of Intelligent & Robotic Systems.

[30]  Shigeo Hirose,et al.  A Study of Design and Control of a Quadruped Walking Vehicle , 1984 .

[31]  Joonho Lee,et al.  DeepGait: Planning and Control of Quadrupedal Gaits Using Deep Reinforcement Learning , 2020, IEEE Robotics and Automation Letters.

[32]  Carlos Mastalli,et al.  Simultaneous Contact, Gait, and Motion Planning for Robust Multilegged Locomotion via Mixed-Integer Convex Optimization , 2017, IEEE Robotics and Automation Letters.

[33]  Grantham Pang,et al.  Comparison between different model of hexapod robot in fault-tolerant gait , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[34]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[35]  Kourosh Naderi,et al.  Discovering and synthesizing humanoid climbing movements , 2017, ACM Trans. Graph..

[36]  Luigi Fortuna,et al.  An adaptive, self-organizing dynamical system for hierarchical control of bio-inspired locomotion , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[38]  Alan Fern,et al.  Monte-Carlo Planning for Agile Legged Locomotion , 2018, ICAPS.

[39]  Shik Ml,et al.  Control of walking and running by means of electric stimulation of the midbrain , 1966 .

[40]  E. Kugushev,et al.  Problems of Selecting A Galt For An Integrated Locomotion Robot , 1975, IJCAI.