Emergence of complex behaviors from coordinated predictive control in humanoid robotics. (Émergence de comportements complexes par commande prédictive coordonnée en robotique humanoïde)

Rising to the challenge of motor control for systems involved in multi-objective and highly-constrained activities is a requirement to enable the emergence of efficient and robust behaviors; the elaboration of complex motor coordination strategies is critical in ensuring performance, feasibility and safety.Although multi-objective predictive approaches enable the definition of complex and constrained strategies coordinating the motor activity of the system, their computational cost is a critical drawback from practical applications.The work presented in this dissertation aims at considering multi-objective predictive control for feasible and practical applications to humanoid robotics.A control architecture is proposed to this purpose as a multi-objective, two-layered controller exploiting the respective advantages of predictive and instantaneous formulations.The contribution of this work takes the form of the validation of the benefits from such an approach in its development for practical challenges and applications, in simulation and real-time implementation, on the iCub and TORO robots and virtual human models.Computational demand of the predictive level is contained with the introduction of reduced multi-objective predictive problems, enabling computationally-favorable formulations of the control problem using mixed-integer programming and sequential and parallel distributions.Despite the resulting approximations on the dynamics of the system at the predictive level, complex behaviors are emerging, exploiting elaborate coordination strategies between conflicting objectives and constraints to increase performance and robustness against disturbances.

[1]  Andrew P. Murray,et al.  Estimation of the centre of mass from motion capture and force plate recordings: A study on the elderly , 2011 .

[2]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[3]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[4]  Wayne J. Book,et al.  Environment estimation for enhanced impedance control , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[5]  Jong Hyeon Park,et al.  Impedance control for biped robot locomotion , 2001, IEEE Trans. Robotics Autom..

[6]  Pierre-Brice Wieber,et al.  Online walking gait generation with adaptive foot positioning through Linear Model Predictive control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Philippe Bidaud,et al.  LQP-Based Controller Design for Humanoid Whole-Body Motion , 2010 .

[8]  Anders Rantzer,et al.  Dynamic dual decomposition for distributed control , 2009, 2009 American Control Conference.

[9]  Jong Hyeon Park,et al.  An online trajectory modifier for the base link of biped robots to enhance locomotion stability , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Andrei Herdt,et al.  Online Walking Motion Generation with Automatic Footstep Placement , 2010, Adv. Robotics.

[11]  François Keith,et al.  Dynamic Whole-Body Motion Generation Under Rigid Contacts and Other Unilateral Constraints , 2013, IEEE Transactions on Robotics.

[12]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[13]  Oussama Khatib,et al.  A whole-body control framework for humanoids operating in human environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Shaoyuan Li,et al.  Networked model predictive control based on neighbourhood optimization for serially connected large-scale processes , 2007 .

[15]  Nicolas Mansard,et al.  Task Sequencing for High-Level Sensor-Based Control , 2007, IEEE Transactions on Robotics.

[16]  Kikuo Fujimura,et al.  The intelligent ASIMO: system overview and integration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Guy Bessonnet,et al.  Forces acting on a biped robot. Center of pressure-zero moment point , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Q. Chu,et al.  Combined Feedback Linearization and Constrained Model Predictive Control for Entry Flight , 2006 .

[19]  Andrew J. Chipperfield,et al.  Stabilized MPC formulations for robust reconfigurable flight control , 2005 .

[20]  Pauline Maurice,et al.  Virtual ergonomics for the design of collaborative robots. (Ergonomie en environnement virtuel pour la conception de robots collaboratifs) , 2015 .

[21]  Sergey V. Drakunov,et al.  Capture Point: A Step toward Humanoid Push Recovery , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[22]  M. Vukobratovic,et al.  On the stability of anthropomorphic systems , 1972 .

[23]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[24]  T. Flash,et al.  Planning Movements in a Simple Redundant Task , 2002, Current Biology.

[25]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[26]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[27]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[28]  P. Bidaud,et al.  Stability Measure of Postural Dynamic Equilibrium Based on Residual Radius , 2008 .

[29]  Oussama Khatib,et al.  Muscle force transmission to operational space accelerations during elite golf swings , 2012, 2012 IEEE International Conference on Robotics and Automation.

[30]  Panagiotis D. Christofides,et al.  Distributed model predictive control of nonlinear process systems , 2009 .

[31]  C. R. Cutler,et al.  Dynamic matrix control¿A computer control algorithm , 1979 .

[32]  J. F. Soechting,et al.  Coordination of arm and wrist motion during a reaching task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Giulio Sandini,et al.  The iCub Cognitive Humanoid Robot: An Open-System Research Platform for Enactive Cognition , 2006, 50 Years of Artificial Intelligence.

[34]  J. Randall Flanagan,et al.  Anticipatory postural adjustments in stance and grip , 1997, Experimental Brain Research.

[35]  Bart De Schutter,et al.  On hybrid systems and closed-loop MPC systems , 2002, IEEE Trans. Autom. Control..

[36]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[37]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[38]  Jason Jianjun Gu,et al.  Multi-criteria kinematics control for the PA10-7C robot arm with robust singularities , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[39]  Atsuo Takanishi,et al.  Balance and impedance control for biped humanoid robot locomotion , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[40]  Pierre-Brice Wieber,et al.  Stabilization of the Capture Point Dynamics for Bipedal Walking Based on Model Predictive Control , 2012, SyRoCo.

[41]  Dragomir N. Nenchev,et al.  Ankle and hip strategies for balance recovery of a biped subjected to an impact , 2008, Robotica.

[42]  Vincent Padois,et al.  Generalized hierarchical control , 2015, Autonomous Robots.

[43]  T. A. Badgwell,et al.  An Overview of Industrial Model Predictive Control Technology , 1997 .

[44]  Alin Albu-Schäffer,et al.  Overview of the torque-controlled humanoid robot TORO , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[45]  Vincent Padois,et al.  Unified preview control for humanoid postural stability and upper-limb interaction adaptation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Vincent Padois,et al.  Emergence of humanoid walking behaviors from mixed-integer model predictive control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Pierre-Brice Wieber,et al.  Prioritizing linear equality and inequality systems: Application to local motion planning for redundant robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[48]  Dragoslav D. Šiljak,et al.  Decentralized control and computations: status and prospects , 1996 .

[49]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[50]  Vincent De Sapio,et al.  Human Motion Reconstruction by Direct Control of Marker Trajectories , 2008 .

[51]  Pierre-Brice Wieber,et al.  Trajectory Free Linear Model Predictive Control for Stable Walking in the Presence of Strong Perturbations , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[52]  Oussama Khatib,et al.  Synthesis and control of whole-body behaviors in humanoid systems , 2007 .

[53]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .

[54]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Alberto Bemporad,et al.  Discrete-Time Non-smooth Nonlinear MPC: Stability and Robustness , 2007 .

[56]  Philippe Bidaud,et al.  Human Activity-Understanding: A Multilayer Approach Combining Body Movements and Contextual Descriptors Analysis , 2015 .

[57]  Bruce H. Krogh,et al.  Distributed model predictive control , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[58]  B. Hommel Action control according to TEC (theory of event coding) , 2009, Psychological research.

[59]  Alberto Bemporad,et al.  Model predictive control based on linear programming - the explicit solution , 2002, IEEE Transactions on Automatic Control.

[60]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[61]  David W. Clarke,et al.  Generalized predictive control - Part I. The basic algorithm , 1987, Autom..

[62]  Vincent Padois,et al.  Motion safety and constraints compatibility for multibody robots , 2012, Auton. Robots.

[63]  Anders Rantzer,et al.  Distributed Model Predictive Control with suboptimality and stability guarantees , 2010, 49th IEEE Conference on Decision and Control (CDC).

[64]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[65]  Christopher G. Atkeson,et al.  Push Recovery by stepping for humanoid robots with force controlled joints , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[66]  Sofiane Achiche,et al.  From Inverse Kinematics to Optimal Control , 2014 .

[67]  G. Dantzig,et al.  THE DECOMPOSITION ALGORITHM FOR LINEAR PROGRAMS , 1961 .

[68]  Vincent Padois,et al.  Synthesis of complex humanoid whole-body behavior: A focus on sequencing and tasks transitions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[69]  Alin Albu-Schäffer,et al.  Bipedal walking control based on Capture Point dynamics , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Olivier Stasse,et al.  Fast foot prints re-planning and motion generation during walking in physical human-humanoid interaction , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[71]  Ambarish Goswami,et al.  Postural Stability of Biped Robots and the Foot-Rotation Indicator (FRI) Point , 1999, Int. J. Robotics Res..

[72]  Hema Swetha Koppula,et al.  Learning human activities and object affordances from RGB-D videos , 2012, Int. J. Robotics Res..

[73]  Sukyung Park,et al.  Leg stiffness increases with speed to modulate gait frequency and propulsion energy. , 2011, Journal of biomechanics.

[74]  P. Rives,et al.  Une nouvelle approche de la relation vision-commande en robotique , 1990 .

[75]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[76]  Benjamin J. Stephens,et al.  Humanoid push recovery , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[77]  J.T. Gravdahl,et al.  MPC for Large-Scale Systems via Model Reduction and Multiparametric Quadratic Programming , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[78]  Jovan Popovic,et al.  Multiobjective control with frictional contacts , 2007, SCA '07.

[79]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[80]  Riccardo Scattolini,et al.  Architectures for distributed and hierarchical Model Predictive Control - A review , 2009 .

[81]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[82]  Shinichiro Nakaoka,et al.  BLUE: A bipedal robot with variable stiffness and damping , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[83]  Vincent Padois,et al.  A distributed model predictive control approach for robust postural stability of a humanoid robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[84]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[85]  Igor Skrjanc,et al.  Tracking-error model-based predictive control for mobile robots in real time , 2007, Robotics Auton. Syst..

[86]  Geoff R Fernie,et al.  Change-in-support reactions for balance recovery. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[87]  Stephen J. Wright,et al.  Distributed MPC Strategies With Application to Power System Automatic Generation Control , 2008, IEEE Transactions on Control Systems Technology.

[88]  Mohammad Aldeen,et al.  Stabilization of decentralized control systems , 1997 .

[89]  Kanya Tanaka,et al.  Decentralized model predictive control via dual decomposition , 2008, 2008 47th IEEE Conference on Decision and Control.

[90]  Prahlad Vadakkepat,et al.  Disturbance rejection by online ZMP compensation , 2008, Robotica.

[91]  Yoshihiko Nakamura,et al.  Dynamics Computation of MusculoSkeletal Human Model Based on E cient Algorithm for Closed Kinematic Chains , 2003 .

[92]  Jay H. Lee,et al.  Model predictive control: Review of the three decades of development , 2011 .

[93]  Andrzej J. Osiadacz Integer and combinatorial optimization, George L. Nemhauser and Laurence A. Wolsey, Wiley-Interscience Series in Discrete Mathematics and Optimization, New York, 1988, ISBN 0-471-82819-X, 763pp, £71.90 , 1990 .

[94]  Vincent Padois,et al.  Automatic selection of ergonomie indicators for the design of collaborative robots: A virtual-human in the loop approach , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[95]  Masayuki Inaba,et al.  Bracing behavior in humanoid through preview control of impact disturbance , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[96]  A. Miguel The emergence of design in pedestrian dynamics: locomotion, self-organization, walking paths and constructal law. , 2013, Physics of life reviews.

[97]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[98]  Joseph Mizrahi,et al.  Mechanical Impedance and Its Relations to Motor Control, Limb Dynamics, and Motion Biomechanics , 2015, Journal of Medical and Biological Engineering.

[99]  Oussama Khatib,et al.  A Unified Approach to Integrate Unilateral Constraints in the Stack of Tasks , 2009, IEEE Transactions on Robotics.

[100]  E. Kerrigan Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .

[101]  Xu Cheng,et al.  Stability-constrained model predictive control with state estimation , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[102]  Aswin N. Venkat Distributed Model Predictive Control: Theory and Applications , 2006 .

[103]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[104]  Panagiotis D. Christofides,et al.  Distributed model predictive control: A tutorial review and future research directions , 2013, Comput. Chem. Eng..

[105]  S. Shankar Sastry,et al.  Decentralized nonlinear model predictive control of multiple flying robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[106]  J. Richalet,et al.  Model predictive heuristic control: Applications to industrial processes , 1978, Autom..

[107]  Kazuhito Yokoi,et al.  Combining suppression of the disturbance and reactive stepping for recovering balance , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.