Quadruped robot trotting over irregular terrain assisted by stereo-vision

Legged robots have the potential to navigate in challenging terrain, and thus to exceed the mobility of wheeled vehicles. However, their control is more difficult as legged robots need to deal with foothold computation, leg trajectories and posture control in order to achieve successful navigation. In this paper, we present a new framework for the hydraulic quadruped robot HyQ, which performs goal-oriented navigation on unknown rough terrain using inertial measurement data and stereo-vision. This work uses our previously presented reactive controller framework with balancing control and extends it with visual feedback to enable closed-loop gait adjustment. On one hand, the camera images are used to keep the robot walking towards a visual target by correcting its heading angle if the robot deviates from it. On the other hand, the stereo camera is used to estimate the size of the obstacles on the ground plane and thus the terrain roughness. The locomotion controller then adjusts the step height and the velocity according to the size of the obstacles. This results in a robust and autonomous goal-oriented navigation over difficult terrain while subject to disturbances from the ground irregularities or external forces. Indoor and outdoor experiments with our quadruped robot show the effectiveness of this framework.

[1]  Paul Filitchkin,et al.  Feature-based terrain classification for LittleDog , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Claudio Semini.  HyQ - Design and Development of a Hydraulically Actuated Quadruped Robot , 2010 .

[3]  Ferdinando Cannella,et al.  Design of HyQ – a hydraulically and electrically actuated quadruped robot , 2011 .

[4]  N. Artner.  A Comparison of Mean Shift Tracking Methods ∗ , 2008 .

[5]  Wei Wang,et al.  Obstacle crossing with stereo vision for a quadruped robot , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[6]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[7]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[8]  Don Ray Murray,et al.  Using Real-Time Stereo Vision for Mobile Robot Navigation , 2000, Auton. Robots.

[9]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Darwin G. Caldwell,et al.  Dynamic torque control of a hydraulic quadruped robot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Douglas Hackett,et al.  An overview of the Defense Advanced Research Projects Agency’s Learning Locomotion program , 2011, Int. J. Robotics Res..

[13]  Andrew Y. Ng,et al.  Stereo vision and terrain modeling for quadruped robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Larry H. Matthies,et al.  High fidelity day/night stereo mapping with vegetation and negative obstacle detection for vision-in-the-loop walking , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Darwin G. Caldwell,et al.  Vision enhanced reactive locomotion control for trotting on rough terrain , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[16]  Heiko Hirschmüller,et al.  Stereo camera based navigation of mobile robots on rough terrain , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[18]  Stefan Schaal,et al.  Learning, planning, and control for quadruped locomotion over challenging terrain , 2011, Int. J. Robotics Res..

[19]  Darwin G. Caldwell,et al.  DESIGN AND SCALING OF VERSATILE QUADRUPED ROBOTS , 2012 .

[20]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[21]  D. G. Caldwell,et al.  Quadrupedal trotting with active compliance , 2013, 2013 IEEE International Conference on Mechatronics (ICM).

[22]  Jonas Buchli,et al.  Is Active Impedance the Key to a Breakthrough for Legged Robots? , 2013, ISRR.

[23]  Darwin G. Caldwell,et al.  LOCAL REFLEX GENERATION FOR OBSTACLE NEGOTIATION IN QUADRUPEDAL LOCOMOTION , 2013 .

[24]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[25]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[26]  Hiroaki Kitano,et al.  Development of an Autonomous Quadruped Robot for Robot Entertainment , 1998, Auton. Robots.

[27]  Darwin G. Caldwell,et al.  A reactive controller framework for quadrupedal locomotion on challenging terrain , 2013, 2013 IEEE International Conference on Robotics and Automation.

[28]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.