Using First Principles for Deep Learning and Model-Based Control of Soft Robots

Model-based optimal control of soft robots may enable compliant, underdamped platforms to operate in a repeatable fashion and effectively accomplish tasks that are otherwise impossible for soft robots. Unfortunately, developing accurate analytical dynamic models for soft robots is time-consuming, difficult, and error-prone. Deep learning presents an alternative modeling approach that only requires a time history of system inputs and system states, which can be easily measured or estimated. However, fully relying on empirical or learned models involves collecting large amounts of representative data from a soft robot in order to model the complex state space–a task which may not be feasible in many situations. Furthermore, the exclusive use of empirical models for model-based control can be dangerous if the model does not generalize well. To address these challenges, we propose a hybrid modeling approach that combines machine learning methods with an existing first-principles model in order to improve overall performance for a sampling-based non-linear model predictive controller. We validate this approach on a soft robot platform and demonstrate that performance improves by 52% on average when employing the combined model.

[1]  Oliver Brock,et al.  Efficient FEM-Based Simulation of Soft Robots Modeled as Kinematic Chains , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Wolfram Burgard,et al.  The limits and potentials of deep learning for robotics , 2018, Int. J. Robotics Res..

[3]  Alexander Liniger,et al.  Learning-Based Model Predictive Control for Autonomous Racing , 2019, IEEE Robotics and Automation Letters.

[4]  Marc D. Killpack,et al.  Real-Time Nonlinear Model Predictive Control of Robots Using a Graphics Processing Unit , 2020, IEEE Robotics and Automation Letters.

[5]  David Wingate,et al.  Learning nonlinear dynamic models of soft robots for model predictive control with neural networks , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[6]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[7]  Juraj Kabzan,et al.  Cautious Model Predictive Control Using Gaussian Process Regression , 2017, IEEE Transactions on Control Systems Technology.

[8]  Steven Lake Waslander,et al.  Deep Learning a Quadrotor Dynamic Model for Multi-Step Prediction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Thomas F. Allen,et al.  Closed-Form Non-Singular Constant-Curvature Continuum Manipulator Kinematics , 2020, 2020 3rd IEEE International Conference on Soft Robotics (RoboSoft).

[10]  Harry A. Pierson,et al.  Deep learning in robotics: a review of recent research , 2017, Adv. Robotics.

[11]  Keeheon Lee,et al.  The Computational Limits of Deep Learning , 2020, ArXiv.

[12]  Ching-Chih Tsai,et al.  Adaptive Predictive Control With Recurrent Neural Network for Industrial Processes: An Application to Temperature Control of a Variable-Frequency Oil-Cooling Machine , 2008, IEEE Transactions on Industrial Electronics.

[13]  John Till,et al.  Real-time dynamics of soft and continuum robots based on Cosserat rod models , 2019, Int. J. Robotics Res..

[14]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[15]  Marc D. Killpack,et al.  Parameterized and GPU-Parallelized Real-Time Model Predictive Control for High Degree of Freedom Robots , 2020, ArXiv.

[16]  Christian Duriez,et al.  Dynamically Closed-Loop Controlled Soft Robotic Arm using a Reduced Order Finite Element Model with State Observer , 2019, 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft).

[17]  Antonio Bicchi,et al.  On an Improved State Parametrization for Soft Robots With Piecewise Constant Curvature and Its Use in Model Based Control , 2020, IEEE Robotics and Automation Letters.

[18]  E Kaiser,et al.  Sparse identification of nonlinear dynamics for model predictive control in the low-data limit , 2017, Proceedings of the Royal Society A.

[19]  Angela P. Schoellig,et al.  Learning-based nonlinear model predictive control to improve vision-based mobile robot path-tracking in challenging outdoor environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Cecilia Laschi,et al.  Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators , 2019, IEEE Transactions on Robotics.

[21]  Stephen Piche,et al.  Nonlinear model predictive control using neural networks , 2000 .

[22]  Marcin Andrychowicz,et al.  Solving Rubik's Cube with a Robot Hand , 2019, ArXiv.

[23]  Marc D. Killpack,et al.  Real-time evolutionary model predictive control using a graphics processing unit , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[24]  Steven L. Brunton,et al.  Learning Discrepancy Models From Experimental Data , 2019, ArXiv.

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Mohi Khansari,et al.  RL-CycleGAN: Reinforcement Learning Aware Simulation-to-Real , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Ivan Koryakovskiy,et al.  Model-Plant Mismatch Compensation Using Reinforcement Learning , 2018, IEEE Robotics and Automation Letters.

[28]  Frank Allgöwer,et al.  Learning-Based Robust Model Predictive Control with State-Dependent Uncertainty , 2018 .

[29]  Marc D. Killpack,et al.  Model Reference Predictive Adaptive Control for Large-Scale Soft Robots , 2020, Frontiers in Robotics and AI.

[30]  Cecilia Laschi,et al.  Control Strategies for Soft Robotic Manipulators: A Survey. , 2018, Soft robotics.

[31]  David Walling,et al.  Combining Physically Based Modeling and Deep Learning for Fusing GRACE Satellite Data: Can We Learn From Mismatch? , 2019, Water Resources Research.

[32]  Cecilia Laschi,et al.  Learning dynamic models for open loop predictive control of soft robotic manipulators. , 2017, Bioinspiration & biomimetics.