Linear-Quadratic Optimal Control in Maximal Coordinates

The linear-quadratic regulator (LQR) is an efficient control method for linear and linearized systems. Typically, LQR is implemented in minimal coordinates (also called generalized or "joint" coordinates). However, other coordinates are possible and recent research suggests that there may be numerical and control-theoretic advantages when using higher-dimensional non-minimal state parameterizations for dynamical systems. One such parameterization is maximal coordinates, in which each link in a multi-body system is parameterized by its full six degrees of freedom and joints between links are modeled with algebraic constraints. Such constraints can also represent closed kinematic loops or contact with the environment. This paper investigates the difference between minimal- and maximal-coordinate LQR control laws. A case study of applying LQR to a simple pendulum and simulations comparing the basins of attraction of minimal- and maximal-coordinate LQR controllers suggest that maximal-coordinate LQR achieves greater robustness and improved performance compared to minimal-coordinate LQR when applied to nonlinear systems.

[1]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Andrew A. Goldenberg,et al.  Force and position control of manipulators during constrained motion tasks , 1989, IEEE Trans. Robotics Autom..

[3]  Hoai-Nam Nguyen,et al.  Fast Constrained LQR Based on MPC With Linear Decomposition , 2016, IEEE Transactions on Automatic Control.

[4]  Yangmin Li,et al.  Modeling and Control Analysis of a 3-PUPU Dual Compliant Parallel Manipulator for Micro Positioning and Active Vibration Isolation , 2012 .

[5]  Volker Mehrmann,et al.  Optimal control for unstructured nonlinear differential-algebraic equations of arbitrary index , 2008, Math. Control. Signals Syst..

[6]  Mark W. Spong,et al.  The swing up control problem for the Acrobot , 1995 .

[7]  E. Haug,et al.  A Recursive Formulation for Constrained Mechanical System Dynamics: Part II. Closed Loop Systems , 1987 .

[8]  Bor-Sen Chen,et al.  Tracking control designs for both holonomic and non-holonomic constrained mechanical systems: a unified viewpoint , 1993 .

[9]  Dongkyoung Chwa,et al.  Robust swing up and balancing control of the acrobot based on a disturbance observer , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[10]  Jeffrey C. Trinkle,et al.  Interactive Simulation of Rigid Body Dynamics in Computer Graphics , 2014, Eurographics.

[11]  Stefan Schaal,et al.  Inverse dynamics control of floating base systems using orthogonal decomposition , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Kar-Han Tan,et al.  High Precision Formation Control of Mobile Robots Using Virtual Structures , 1997, Auton. Robots.

[13]  J. Cuadrado,et al.  Assessment of Linearization Approaches for Multibody Dynamics Formulations , 2017 .

[14]  Colin Neil Jones,et al.  Solving the Infinite-Horizon Constrained LQR Problem Using Accelerated Dual Proximal Methods , 2015, IEEE Transactions on Automatic Control.

[15]  Jeffrey C. Trinkle,et al.  Interactive Simulation of Rigid Body Dynamics in Computer Graphics , 2012, Eurographics.

[16]  J. Lee,et al.  Force Equilibrium Approach for Linearization of Constrained Mechanical System Dynamics , 2003 .

[17]  Stephan K. Chalup,et al.  A small spiking neural network with LQR control applied to the acrobot , 2008, Neural Computing and Applications.

[18]  Todd D. Murphey,et al.  Structured Linearization of Discrete Mechanical Systems for Analysis and Optimal Control , 2017, IEEE Transactions on Automation Science and Engineering.

[19]  Zexiang Li,et al.  A unified geometric approach to modeling and control of constrained mechanical systems , 2002, IEEE Trans. Robotics Autom..

[20]  Ruth Canahuire,et al.  Trajectory tracking control of a 3 DOF delta robot: a PD and LQR comparison , 2016, 2016 IEEE XXIII International Congress on Electronics, Electrical Engineering and Computing (INTERCON).

[21]  José A. De Doná,et al.  Solution of the input-constrained LQR problem using dynamic programming , 2007, Syst. Control. Lett..

[22]  Xiaoqi Tang,et al.  A new automatic motion planning algorithm for a 4-degree-of-freedom parallel kinematic manipulator based on the centre sphere method , 2015 .

[23]  Richard Paul,et al.  Manipulator Cartesian Path Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  D. Negrut,et al.  A Practical Approach for the Linearization of the Constrained Multibody Dynamics Equations , 2006 .

[25]  A. A. Tunik.  Simplified Path Tracking Control Laws for Quad-rotor Considered as Nonholonomic System , 2018, 2018 IEEE 5th International Conference on Methods and Systems of Navigation and Motion Control (MSNMC).

[26]  Yilin Zhao,et al.  Kinematics, dynamics and control of wheeled mobile robots , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[27]  Scott Kuindersma,et al.  DIRTREL: Robust Trajectory Optimization with Ellipsoidal Disturbances and LQR Feedback , 2017, Robotics: Science and Systems.

[28]  Alan J. Laub,et al.  The linear-quadratic optimal regulator for descriptor systems , 1985, 1985 24th IEEE Conference on Decision and Control.

[29]  James B. Rawlings,et al.  Constrained linear quadratic regulation , 1998, IEEE Trans. Autom. Control..

[30]  Eric C. Kerrigan,et al.  Solving constrained LQR problems by eliminating the inputs from the QP , 2011, IEEE Conference on Decision and Control and European Control Conference.

[31]  Mehmet Mutlu,et al.  A comparative evaluation of adaptive and non-adaptive Sliding Mode, LQR & PID control for platform stabilization , 2012, 2012 IEEE International Conference on Control Applications.

[32]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[33]  Russell H. Taylor,et al.  Constrained Cartesian motion control for teleoperated surgical robots , 1996, IEEE Trans. Robotics Autom..

[34]  Edward J. Haug,et al.  A Recursive Formation for Constrained Mechanical Systems Dynamics: Part I, Open Loop Systems , 1987 .

[35]  N. McClamroch.  Feedback stabilization of control systems described by a class of nonlinear differential-algebraic equations , 1990 .

[36]  Nicholas Rotella,et al.  Balancing and walking using full dynamics LQR control with contact constraints , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[37]  P. Daoutidis,et al.  Feedback control of nonlinear differential-algebraic-equation systems , 1995 .

[38]  Tang Xiaoqi,et al.  A new automatic motion planning algorithm for a 4-degree-of-freedom parallel kinematic manipulator based on the centre sphere method , 2015 .

[39]  Russ Tedrake,et al.  The Surprising Effectiveness of Linear Models for Visual Foresight in Object Pile Manipulation , 2020, WAFR.

[40]  V. N. Sohoni,et al.  Automatic Linearization of Constrained Dynamical Models , 1986 .

[41]  Hariharan Krishnan,et al.  Tracking in nonlinear differential-algebraic control systems with applications to constrained robot systems , 1994, Autom..

[42]  Todd Murphey,et al.  Structured linearization of discrete mechanical systems on Lie groups: A synthesis of analysis and control , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[43]  Scott Kuindersma,et al.  Optimization and stabilization of trajectories for constrained dynamical systems , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Vincenzo Lippiello,et al.  Nonprehensile Manipulation of an Underactuated Mechanical System With Second-Order Nonholonomic Constraints: The Robotic Hula-Hoop , 2018, IEEE Robotics and Automation Letters.

[45]  R. März.  On linear differential-algebraic equations and linearizations , 1995 .

[46]  Zachary Manchester,et al.  ALTRO: A Fast Solver for Constrained Trajectory Optimization , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[47]  Sergey Jatsun,et al.  Modification of constrained LQR for control of walking in-pipe robots , 2017, 2017 Dynamics of Systems, Mechanisms and Machines (Dynamics).

[48]  Vincenzo Lippiello,et al.  Exploiting redundancy in Cartesian impedance control of UAVs equipped with a robotic arm , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Zachary Manchester,et al.  Linear-Time Variational Integrators in Maximal Coordinates , 2020, WAFR.

[50]  Jovitha Jerome,et al.  Robust LQR Controller Design for Stabilizing and Trajectory Tracking of Inverted Pendulum , 2013 .

[51]  Shahrum Shah Abdullah,et al.  PID plus LQR attitude control for hexarotor MAV in indoor environments , 2014, 2014 IEEE International Conference on Industrial Technology (ICIT).

[52]  Zijian Lin,et al.  LQR controller for car-like robot , 2016, 2016 35th Chinese Control Conference (CCC).

[53]  Pascal Bigras,et al.  A Multistage Position/Force Control for Constrained Robotic Systems With Friction: Joint-Space Decomposition, Linearization, and Multiobjective Observer/Controller Synthesis Using LMI Formalism , 2006, IEEE Transactions on Industrial Electronics.

[54]  Chen-Yuan Kuo,et al.  Robust position control of robotic manipulator in Cartesian coordinates , 1991, IEEE Trans. Robotics Autom..

[55]  Wang Lu-hao,et al.  LQR-Fuzzy Control for Double Inverted Pendulum , 2010, 2010 International Conference on Digital Manufacturing & Automation.

[56]  Jun Wang,et al.  Constrained Control of Autonomous Underwater Vehicles Based on Command Optimization and Disturbance Estimation , 2019, IEEE Transactions on Industrial Electronics.

[57]  Claire Tomlin,et al.  Efficient Computation of Feedback Control for Equality-Constrained LQR , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[58]  Ian Postlethwaite,et al.  A distributed control law with guaranteed LQR cost for identical dynamically coupled linear systems , 2011, Proceedings of the 2011 American Control Conference.

[59]  Mohd Ridzuan Ahmad,et al.  LQR, double-PID and pole placement stabilization and tracking control of single link inverted pendulum , 2015, 2015 IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[60]  R. Sargent,et al.  Optimal control of inequality constrained DAE systems , 2000 .

[61]  Weihai Chen,et al.  Cartesian coordinate control for redundant modular robots , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[62]  David Baraff,et al.  Linear-time dynamics using Lagrange multipliers , 1996, SIGGRAPH.

[63]  Sandra Hirche,et al.  Koopman Operator Dynamical Models: Learning, Analysis and Control , 2021, Annu. Rev. Control..

[64]  Colin Neil Jones,et al.  Constrained LQR using online decomposition techniques , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[65]  Jorge Angeles,et al.  Trajectory-Planning and Normalized-Variable Control for Parallel Pick-and-Place Robots , 2019, Journal of Mechanisms and Robotics.

[66]  C. David Remy,et al.  Modeling and Control of Soft Robots Using the Koopman Operator and Model Predictive Control , 2019, Robotics: Science and Systems.

[67]  Tsai.  On optimal control laws for a class of constrained dynamical systems (with application to control of bipedal locomotion) , 1976 .

[68]  Kevin M. Passino,et al.  c ○ 1997 Kluwer Academic Publishers. Printed in the Netherlands. Intelligent Control for an Acrobot , 1996 .

[69]  Galina A. Kurina,et al.  Feedback solutions of optimal control problems with DAE constraints , 2007, 2008 47th IEEE Conference on Decision and Control.

[70]  Josep M. Porta,et al.  A Singularity-Robust LQR Controller for Parallel Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[71]  M. Gerdts.  Direct Shooting Method for the Numerical Solution of Higher-Index DAE Optimal Control Problems , 2003 .

[72]  Amir Patel,et al.  Minor Change, Major Gains: The Effect of Orientation Formulation on Solving Time for Multi-Body Trajectory Optimization , 2020, IEEE Robotics and Automation Letters.

[73]  P. Daoutidis,et al.  Feedback regularization and control of nonlinear differential-algebraic-equation systems , 1996 .

[74]  Yangmin Li,et al.  Design and analysis of a novel 6-DOF redundant actuated parallel robot with compliant hinges for high precision positioning , 2010 .

[75]  Masayoshi Tomizuka,et al.  Autonomous Driving Motion Planning With Constrained Iterative LQR , 2019, IEEE Transactions on Intelligent Vehicles.

[76]  Todd D. Murphey,et al.  Model-Based Control Using Koopman Operators , 2017, Robotics: Science and Systems.

[77]  Volker Mehrmann,et al.  The linear quadratic optimal control problem for linear descriptor systems with variable coefficients , 1997, Math. Control. Signals Syst..