Control framework for cooperative object transportation by two humanoid robots

Abstract This paper aims at proposing a comprehensive control framework designed for cooperative transportation of a heavy load by two humanoid robots. First, a simplified dynamic model of the cooperative task is developed and the system stability is rigorously analyzed. Next, a centralized controller is formulated, this formulation provides an optimal control of the system by considering the robots dynamical stability while satisfying the robot–object–robot constraints. Finally, the controller is integrated with an arm controller and a local planner module forming a complete framework for cooperative transportation tasks. The approach is thoroughly analyzed and validated in simulation, and experiments are carried out on a team of two Nao humanoid robots transporting a range of objects placed on a small table. The experimental results pointed out the robustness of the approach as the robots successfully accomplished the transportation tasks in a stable way, moreover the transported objects masses were up to half the mass of one of the robot. Besides increasing the robot payload, some of the transported objects are relatively large and it is simply impossible for a single robot to transport them.

[1]  Benjamin J. Stephens,et al.  Humanoid push recovery , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[2]  Atsushi Konno,et al.  Symmetry position/force hybrid control for cooperative object transportation using multiple humanoid robots , 2016, Adv. Robotics.

[3]  Pierre-Brice Wieber,et al.  Trajectory Free Linear Model Predictive Control for Stable Walking in the Presence of Strong Perturbations , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[4]  David Vogt,et al.  Inferring guidance information in cooperative human-robot tasks , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[5]  Hitoshi Iba,et al.  Cooperative Transportation by Humanoid Robots: Learning to Correct Positioning , 2003, HIS.

[6]  Abderrahmane Kheddar,et al.  Humanoid Robot Locomotion and Manipulation Step Planning , 2012, Adv. Robotics.

[7]  Maren Bennewitz,et al.  Anytime search-based footstep planning with suboptimality bounds , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[8]  Christian Kirches,et al.  qpOASES: a parametric active-set algorithm for quadratic programming , 2014, Mathematical Programming Computation.

[9]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Fumio Kanehiro,et al.  Cooperative works by a human and a humanoid robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[11]  Alessandro De Luca,et al.  Control of generalized contact motion and force in physical human-robot interaction , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Wael Suleiman,et al.  External force observer for medium-sized humanoid robots , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[13]  Wael Suleiman,et al.  Control strategy and implementation for a humanoid robot pushing a heavy load on a rolling cart , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Hyunchul Choi,et al.  Trajectory-free reactive stepping of humanoid robots using momentum control , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[15]  Pierre-Brice Wieber,et al.  Walking pattern generators designed for physical collaboration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Don Joven Agravante,et al.  Collaborative human-humanoid carrying using vision and haptic sensing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Jean-Bernard Hayet,et al.  Cooperative Vision-Based Object Transportation by Two Humanoid Robots in a Cluttered Environment , 2017, Int. J. Humanoid Robotics.

[18]  Shuuji Kajita,et al.  A Humanoid Robot Carrying a Heavy Object , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Alexander Leonessa,et al.  Walking stabilization using step timing and location adjustment on the humanoid robot, Atlas , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Andrei Herdt,et al.  Online Walking Motion Generation with Automatic Footstep Placement , 2010, Adv. Robotics.

[21]  Wael Suleiman,et al.  Autonomous SLAM based humanoid navigation in a cluttered environment while transporting a heavy load , 2018, Robotics Auton. Syst..

[22]  Alessandro De Luca,et al.  Estimation of contact forces using a virtual force sensor , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Atsushi Konno,et al.  Symmetry cooperative object transportation by multiple humanoid robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Wael Suleiman,et al.  Kalman Filter Based Observer for an External Force Applied to Medium-sized Humanoid Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Jean-Bernard Hayet,et al.  Cooperative SLAM-based object transportation by two humanoid robots in a cluttered environment , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[26]  François Keith,et al.  Proactive behavior of a humanoid robot in a haptic transportation task with a human partner , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[27]  Kazuhito Yokoi,et al.  Introduction to Humanoid Robotics , 2014, Springer Tracts in Advanced Robotics.

[28]  Johannes Garimort,et al.  Humanoid navigation with dynamic footstep plans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Olivier Stasse,et al.  Fast foot prints re-planning and motion generation during walking in physical human-humanoid interaction , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[30]  Marilena Vendittelli,et al.  Interaction Force Reconstruction for Humanoid Robots , 2017, IEEE Robotics and Automation Letters.

[31]  Daniel D. Lee,et al.  Cooperative humanoid stretcher manipulation and locomotion , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[32]  Jian Huang,et al.  Integrating dynamic walking and arm impedance control for cooperative transportation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Pierre-Brice Wieber,et al.  Analysis of the discontinuities in prioritized tasks-space control under discreet task scheduling operations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.