Simulation Based Fault Detection and Design Modification for Highly Dynamic Robotic Systems

of Dissertation Simulation Based Fault Detection and Design Modification for Highly Dynamic Robotic Systems The current approach to creating and improving robots and their control systems follows a cycle where complex mechanisms and controllers are iteratively designed, briefly debugged in a simulated environment, built, tested and then redesigned to address anomalous behaviors that were observed during in situ testing. During the initial cycles of this procedure, when unvetted control systems are tested on physical hardware, easily avoidable errors (e.g., unexpected collisions from inexact link geometry measurements or parasitic oscillation in actuators and passive elements) can have catastrophic consequences. Although testing robots in situ can be costly, often entirely new phenomena emerge from situated testing that were not observed throughout early computerized simulation-based testing. The discovery of such unanticipated behavior is currently considered a normal occurrence during robotics testing in situ. This anticipated unanticipated behavior—the expectance of the unknown during robot operation—is due in part to the increased complexity of robotic systems (e.g., uneven terrain, impacting collision, unpredictable contact conditions) compared to typical automotive or aerospace applications that rely heavily on simulation-based testing before physical testing. I have investigated a statistical approach to simulation, where the indeterminacy of physical models or uncertainty in the structure of a mechanism or its environment is represented as a collection of particles in many parallel simulations. The aim of this approach is to inform roboticists of the possible unknown or unexpected behaviors that a robotic system may exhibit in order to address these faults before they have been observed on the physical system. Our approach excites many of the errors caused by modeling, sensory, actuation, and communication error or uncertainty and can assist roboticists in determining whether certain robot designs, control systems, or modeling assumptions might result in hard-to-predict behavior; I use this information to predict the robustness or brittleness control policies and then validate the predictions in situ, on low-cost quadrupedal robots. This dissertation presents tools for automating and or simplifying a roboticist’s typical workflow

[1]  Siddhartha S. Srinivasa,et al.  Pose estimation for contact manipulation with manifold particle filters , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  W. Blajer,et al.  Multibody modeling of human body for the inverse dynamics analysis of sagittal plane movements , 2007 .

[3]  Siddhartha S. Srinivasa,et al.  Convergent Planning , 2016, IEEE Robotics and Automation Letters.

[4]  Vladlen Koltun,et al.  Animating human lower limbs using contact-invariant optimization , 2013, ACM Trans. Graph..

[5]  Jong-Shi Pang,et al.  Differential variational inequalities , 2008, Math. Program..

[6]  Alberto Bemporad,et al.  Robust model predictive control: A survey , 1998, Robustness in Identification and Control.

[7]  François Keith,et al.  Dynamic Whole-Body Motion Generation Under Rigid Contacts and Other Unilateral Constraints , 2013, IEEE Transactions on Robotics.

[8]  C. E. Lemke,et al.  Bimatrix Equilibrium Points and Mathematical Programming , 1965 .

[9]  Antonis Papachristodoulou,et al.  Robust Stability Analysis of Nonlinear Hybrid Systems , 2009, IEEE Transactions on Automatic Control.

[10]  J. Trinkle,et al.  On Dynamic Multi‐Rigid‐Body Contact Problems with Coulomb Friction , 1995 .

[11]  Jeffrey C. Trinkle,et al.  A dynamic Bayesian approach to real-time estimation and filtering in grasp acquisition , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Claude Lacoursière,et al.  Splitting Methods for Dry Frictional Contact Problems in Rigid Multibody Systems: Preliminary Performance Results , 2003 .

[13]  Roland Siegwart,et al.  Control of dynamic gaits for a quadrupedal robot , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Katta G. Murty,et al.  Linear complementarity, linear and nonlinear programming , 1988 .

[15]  Marc H. Raibert,et al.  Legged Robots That Balance , 1986, IEEE Expert.

[16]  Dylan A. Shell,et al.  Modeling Contact Friction and Joint Friction in Dynamic Robotic Simulation Using the Principle of Maximum Dissipation , 2010, WAFR.

[17]  Stefan Schaal,et al.  Inverse dynamics control of floating-base robots with external constraints: A unified view , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  A. Karpathy,et al.  Locomotion skills for simulated quadrupeds , 2011, ACM Trans. Graph..

[19]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[20]  Scott Kuindersma,et al.  An efficiently solvable quadratic program for stabilizing dynamic locomotion , 2013, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Anders Rantzer,et al.  Convex Programs for Temporal Verification of Nonlinear Dynamical Systems , 2007, SIAM J. Control. Optim..

[22]  D. Limón,et al.  Input-to-state stable MPC for constrained discrete-time nonlinear systems with bounded additive uncertainties , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[23]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[24]  Stefan Schaal,et al.  Optimal distribution of contact forces with inverse-dynamics control , 2013, Int. J. Robotics Res..

[25]  Mihai Anitescu,et al.  A constraint‐stabilized time‐stepping approach for rigid multibody dynamics with joints, contact and friction , 2004 .

[26]  Jong-Shi Pang,et al.  Linear Complementarity Systems: Zeno States , 2005, SIAM J. Control. Optim..

[27]  William H. Press,et al.  Numerical recipes in C , 2002 .

[28]  Bernhard Sendhoff,et al.  Creating Brain-Like Intelligence , 2009, Creating Brain-Like Intelligence.

[29]  Emanuel Todorov,et al.  Ensemble-CIO: Full-body dynamic motion planning that transfers to physical humanoids , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Stefan Schaal,et al.  Inverse dynamics control of floating base systems using orthogonal decomposition , 2010, 2010 IEEE International Conference on Robotics and Automation.

[31]  Mark R. Cutkosky,et al.  Simulation-based tools for evaluating underactuated hand designs , 2013, 2013 IEEE International Conference on Robotics and Automation.

[32]  Leslie Pack Kaelbling,et al.  Belief space planning assuming maximum likelihood observations , 2010, Robotics: Science and Systems.

[33]  Stefan Schaal,et al.  Learning, planning, and control for quadruped locomotion over challenging terrain , 2011, Int. J. Robotics Res..

[34]  Richard W. Longman,et al.  Open-loop stable running , 2005, Robotica.

[35]  Michael Nikolaou,et al.  Chance‐constrained model predictive control , 1999 .

[36]  Kuan-Ting Yu,et al.  More than a million ways to be pushed. A high-fidelity experimental dataset of planar pushing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Evan Drumwright,et al.  Inverse Dynamics for a Quadruped Robot Locomoting Along Slippery Surfaces , 2013 .

[38]  S. Sastry,et al.  Near – Simultaneous Footfalls Lend Stability to Multi – Legged Gaits , 2015 .

[39]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[40]  Evan Drumwright,et al.  Making Time Make Sense in Robotic Simulation , 2014, SIMPAR.

[41]  Peter K. Allen,et al.  Pose error robust grasping from contact wrench space metrics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[42]  C. Lacoursière Ghosts and machines : regularized variational methods for interactive simulations of multibodies with dry frictional contacts , 2007 .

[43]  Nancy M. Amato,et al.  Algorithmic Foundations of Robotics XIV, Proceedings of the Fourteenth Workshop on the Algorithmic Foundations of Robotics, WAFR 2021, Oulu, Finland, June 21-23, 2021 , 2021, WAFR.

[44]  Daniel I. Goldman,et al.  Scattering of a legged robot in a heterogeneous granular terrain , 2015 .

[45]  Pieter Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2010, Int. J. Robotics Res..

[46]  Russ Tedrake,et al.  Stability Analysis and Control of Rigid-Body Systems With Impacts and Friction , 2016, IEEE Transactions on Automatic Control.

[47]  Katie Byl,et al.  Robust Policies via Meshing for Metastable Rough Terrain Walking , 2014, Robotics: Science and Systems.

[48]  H. Hatze The fundamental problem of myoskeletal inverse dynamics and its implications. , 2002, Journal of biomechanics.

[49]  Richard W. Cottle,et al.  Linear Complementarity Problem , 2009, Encyclopedia of Optimization.

[50]  Roy Featherstone,et al.  Rigid Body Dynamics Algorithms , 2007 .

[51]  James J. Kuffner,et al.  Physically Based Grasp Quality Evaluation Under Pose Uncertainty , 2013, IEEE Transactions on Robotics.

[52]  Manuela M. Veloso,et al.  Efficient physics-based planning: sampling search via non-deterministic tactics and skills , 2009, AAMAS.

[53]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[54]  Inman Harvey,et al.  Why Morphology Matters , 2014 .

[55]  Christer Ericson,et al.  Real-Time Collision Detection , 2004 .

[56]  N. Wouw,et al.  Stability and Convergence of Mechanical Systems with Unilateral Constraints , 2008 .

[57]  R. Siegwart,et al.  Hybrid Operational Space Control for Compliant Quadruped Robots , 2012 .

[58]  Evan Drumwright,et al.  State estimation of a wild robot toward validation of rigid body simulation , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[59]  Michael E. Hahn,et al.  The Potential for Error With Use of Inverse Dynamic Calculations in Gait Analysis of Individuals With Lower Limb Loss: A Review of Model Selection and Assumptions , 2010 .

[60]  David E. Stewart,et al.  Rigid-Body Dynamics with Friction and Impact , 2000, SIAM Rev..

[61]  Weiwei Huang,et al.  3D walking based on online optimization , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[62]  Mark R. Cutkosky,et al.  Design and testing of a selectively compliant underactuated hand , 2014, Int. J. Robotics Res..

[63]  Roy Featherstone,et al.  An Empirical Study of the Joint Space Inertia Matrix , 2004, Int. J. Robotics Res..

[64]  A. Chatterjee On the Realism of Complementarity Conditions in Rigid Body Collisions , 1999 .

[65]  Evan Drumwright,et al.  Adaptive integration for controlling speed vs. accuracy in multi-rigid body simulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[66]  R. Sargent,et al.  An efficient implementation of the Lemke algorithm and its extension to deal with upper and lower bounds , 1978 .

[67]  O. Mangasarian,et al.  The Fritz John Necessary Optimality Conditions in the Presence of Equality and Inequality Constraints , 1967 .

[68]  N. Wouw,et al.  Stability properties of equilibrium sets of non-linear mechanical systems with dry friction and impact , 2008 .

[69]  J. Moreau Standard Inelastic Shocks and the Dynamics of Unilateral Constraints , 1985 .

[70]  Katie Byl,et al.  More solutions means more problems: Resolving kinematic redundancy in robot locomotion on complex terrain , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[71]  Jeffrey C. Trinkle,et al.  An implicit time-stepping scheme for rigid body dynamics with Coulomb friction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[72]  Stefan Schaal,et al.  STOMP: Stochastic trajectory optimization for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[73]  D. Stewart Convergence of a Time‐Stepping Scheme for Rigid‐Body Dynamics and Resolution of Painlevé's Problem , 1998 .

[74]  Evan Drumwright,et al.  Quadratic programming-based inverse dynamics control for legged robots with sticking and slipping frictional contacts , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[75]  Roy Featherstone,et al.  Robot Dynamics Algorithms , 1987 .

[76]  Emanuel Todorov,et al.  A convex, smooth and invertible contact model for trajectory optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[77]  Wolfram Burgard,et al.  A comparative study of contact models for contact-aware state estimation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[78]  Darwin G. Caldwell,et al.  A reactive controller framework for quadrupedal locomotion on challenging terrain , 2013, 2013 IEEE International Conference on Robotics and Automation.

[79]  Antonie J van den Bogert,et al.  A weighted least squares method for inverse dynamic analysis , 2008, Computer methods in biomechanics and biomedical engineering.

[80]  A. Ruina,et al.  A New Algebraic Rigid-Body Collision Law Based on Impulse Space Considerations , 1998 .

[81]  Mike Stilman,et al.  Robot Jenga: Autonomous and strategic block extraction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[82]  C. Glocker,et al.  A set-valued force law for spatial Coulomb-Contensou friction , 2003 .

[83]  Gerd Hirzinger,et al.  Posture and balance control for biped robots based on contact force optimization , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[84]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[85]  Brian Mirtich,et al.  Impulse-based dynamic simulation of rigid body systems , 1996 .

[86]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[87]  At L Hof,et al.  Handling of impact forces in inverse dynamics. , 2006, Journal of biomechanics.

[88]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[89]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[90]  Karl Iagnemma,et al.  Stochastic mobility-based path planning in uncertain environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[91]  C. Budd Non-Smooth Dynamical Systems and the Grazing Bifurcation , 1996 .

[92]  Robert W. Walters,et al.  Uncertainty analysis for fluid mechanics with applications , 2002 .

[93]  Aaron D. Ames,et al.  Human-inspired multi-contact locomotion with AMBER2 , 2014, 2014 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[94]  Y. Matsuoka,et al.  Biologically inspired grasp planning using only orthogonal approach angles , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[95]  Rustam Stolkin,et al.  Physical simulation for monocular 3D model based tracking , 2011, 2011 IEEE International Conference on Robotics and Automation.

[96]  John F. Hughes,et al.  Plausible motion simulation for computer graphics animation , 1996 .

[97]  Parviz E. Nikravesh,et al.  Computer-aided analysis of mechanical systems , 1988 .

[98]  Hadas Kress-Gazit,et al.  Analyzing and revising synthesized controllers for robots with sensing and actuation errors , 2015, Int. J. Robotics Res..

[99]  L. Blackmore A Probabilistic Particle Control Approach to Optimal, Robust Predictive Control , 2006 .

[100]  Antoine Cully,et al.  Abstract of: "Fast Damage Recovery in Robotics with the T-Resilience Algorithm" , 2018, ALIFE.

[101]  E. Hairer,et al.  Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems , 2010 .

[102]  Martijn Wisse,et al.  A Three-Dimensional Passive-Dynamic Walking Robot with Two Legs and Knees , 2001, Int. J. Robotics Res..

[103]  Linhong Ji,et al.  An Inverse Dynamical Model for Slip Gait , 2007, HCI.

[104]  Stefan Schaal,et al.  Risk sensitive nonlinear optimal control with measurement uncertainty , 2016, ArXiv.

[105]  Yu Zheng,et al.  Coping with the Grasping Uncertainties in Force-closure Analysis , 2005, Int. J. Robotics Res..

[106]  Christopher G. Atkeson,et al.  Push Recovery by stepping for humanoid robots with force controlled joints , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[107]  Alexandre M. Bayen,et al.  Computational techniques for the verification of hybrid systems , 2003, Proc. IEEE.

[108]  R. Bhatia Positive Definite Matrices , 2007 .

[109]  A. Ivanov On multiple impact , 1995 .

[110]  T. McMahon,et al.  A model of scale effects in mammalian quadrupedal running. , 2002, The Journal of experimental biology.

[111]  Matei T. Ciocarlie,et al.  GP-GPIS-OPT: Grasp planning with shape uncertainty using Gaussian process implicit surfaces and Sequential Convex Programming , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[112]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[113]  Eitan Grinspun,et al.  Reflections on simultaneous impact , 2012, ACM Trans. Graph..

[114]  Sriram Sankaranarayanan,et al.  Probabilistic Temporal Logic Falsification of Cyber-Physical Systems , 2013, TECS.

[115]  Hod Lipson,et al.  On the Difficulty of Co-Optimizing Morphology and Control in Evolved Virtual Creatures , 2016, ALIFE.

[116]  Hannes Sommer,et al.  Quadrupedal locomotion using hierarchical operational space control , 2014, Int. J. Robotics Res..

[117]  J. Baumgarte Stabilization of constraints and integrals of motion in dynamical systems , 1972 .

[118]  Dongbin Xiu,et al.  High-Order Collocation Methods for Differential Equations with Random Inputs , 2005, SIAM J. Sci. Comput..

[119]  Twan Koolen,et al.  Capturability-based analysis and control of legged locomotion, Part 1: Theory and application to three simple gait models , 2011, Int. J. Robotics Res..

[120]  David Baraff,et al.  Fast contact force computation for nonpenetrating rigid bodies , 1994, SIGGRAPH.

[121]  Emanuel Todorov,et al.  Convex and analytically-invertible dynamics with contacts and constraints: Theory and implementation in MuJoCo , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[122]  M. Anitescu,et al.  Formulating Dynamic Multi-Rigid-Body Contact Problems with Friction as Solvable Linear Complementarity Problems , 1997 .

[123]  D. Stewart,et al.  AN IMPLICIT TIME-STEPPING SCHEME FOR RIGID BODY DYNAMICS WITH INELASTIC COLLISIONS AND COULOMB FRICTION , 1996 .

[124]  Aaron D. Ames,et al.  Human-inspired control of bipedal robots via control lyapunov functions and quadratic programs , 2013, HSCC '13.

[125]  B. Brogliato Nonsmooth Impact Mechanics: Models, Dynamics and Control , 1996 .

[126]  R. Hunger Floating Point Operations in Matrix-Vector Calculus , 2022 .

[127]  Russ Tedrake,et al.  Direct Trajectory Optimization of Rigid Body Dynamical Systems through Contact , 2012, WAFR.

[128]  Shuai Li,et al.  State estimation for dynamic systems with intermittent contact , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[129]  Reid G. Simmons,et al.  Particle RRT for Path Planning with Uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[130]  Y Ishida,et al.  Impact And Friction Of Solids, Structures And Intelligent Machines: In Memoriam of P D Panagiotopoulos (1950–1998) , 2000 .

[131]  Pieter Abbeel,et al.  Gaussian belief space planning with discontinuities in sensing domains , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[132]  Doug L. James,et al.  Many-worlds browsing for control of multibody dynamics , 2007, SIGGRAPH 2007.

[133]  Olivier A. Bauchau,et al.  Efficient simulation of a dynamic system with LuGre friction , 2005 .

[134]  U. Ascher,et al.  Stabilization of Constrained Mechanical Systems with DAEs and Invariant Manifolds , 1995 .

[135]  Marco Colombetti,et al.  Robot shaping: developing situated agents through learning , 1992 .

[136]  H. Schattler,et al.  Analysis of local bifurcation mechanisms in large differential-algebraic systems such as the power system , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[137]  Christopher G. Atkeson,et al.  Dynamic Balance Force Control for compliant humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[138]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[139]  Joshua A. Levine,et al.  Sampling-based planning, control and verification of hybrid systems , 2000 .

[140]  Jun Nakanishi,et al.  A Unifying Methodology for Robot Control with Redundant DOFs , 2008 .

[141]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Non-linear Systems , 1998, Autom..

[142]  Joshua Evan Auerbach,et al.  On the Relationship Between Environmental and Mechanical Complexity in Evolved Robots , 2012, ALIFE.