Terrain mapping with a pan and tilt stereo camera for locomotion on a quadruped robot

Legged robots are expected to have superior mobility on rough terrain than wheeled robots. The main reason is that legged locomotion is more adaptable to a wide range of terrain types as the robot can decompose its path into a sequence of footholds and can use different locomotion strategies. In order to accomplish most of the locomotion tasks the robot requires high level control (i.e., to adjust the locomotion parameters and to choose optimal footholds) which depends on real-time localization and accurate terrain mapping. In this paper, we propose a SLAM solution using a pan and tilt stereo camera mounted on an hydraulically actuated quadruped robot that builds a map and keeps track of the robot’s position. Since the computation needs to be carried out on board and the robot is subject to considerable motion during its locomotion (regular vibrations, impacts or slippages), we developed a dedicated implementation based on fast stereo depth computation, GPU based map building and mechanical motion compensation. Combined with a foothold planning framework presented in our previous work [1], this localization and mapping ability allows to perform locomotion in a fully planned manner. Successful results of foothold planning with our quadruped robot show the effectiveness of our method.

[1]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Paul Filitchkin,et al.  Feature-based terrain classification for LittleDog , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Larry H. Matthies,et al.  High fidelity day/night stereo mapping with vegetation and negative obstacle detection for vision-in-the-loop walking , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[5]  Ferdinando Cannella,et al.  Design of HyQ – a hydraulically and electrically actuated quadruped robot , 2011 .

[6]  Wei Wang,et al.  Obstacle crossing with stereo vision for a quadruped robot , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[7]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[8]  Zhenghao Shi,et al.  A comparison of digital speckle filters , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Andrew Y. Ng,et al.  Stereo vision and terrain modeling for quadruped robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Darwin G. Caldwell,et al.  Path planning with force-based foothold adaptation and virtual model control for torque controlled quadruped robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Heiko Hirschmüller,et al.  Stereo camera based navigation of mobile robots on rough terrain , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Douglas Hackett,et al.  An overview of the Defense Advanced Research Projects Agency’s Learning Locomotion program , 2011, Int. J. Robotics Res..

[13]  Larry H. Matthies,et al.  Robust multi-sensor, day/night 6-DOF pose estimation for a dynamic legged vehicle in GPS-denied environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  Darwin G. Caldwell,et al.  Vision enhanced reactive locomotion control for trotting on rough terrain , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[15]  Richard Szeliski,et al.  Symmetric Sub-Pixel Stereo Matching , 2002, ECCV.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Stefan Schaal,et al.  Learning, planning, and control for quadruped locomotion over challenging terrain , 2011, Int. J. Robotics Res..

[18]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .