Model-free control for soft manipulators based on reinforcement learning

Most control methods of soft manipulators are developed based on physical models derived from mathematical analysis or learning methods. However, due to internal nonlinearity and external uncertain disturbances, it is difficult to build an accurate model, further, these methods lack robustness and portability among different prototypes. In this work, we propose a model-free control method based on reinforcement learning and implement it on a multi-segment soft manipulator in 2D plane, which focuses on the learning of control strategy rather than the physical model. The control strategy is validated to be effective and robust in prototype experiments, where we design a simulation method to speed up the training process.

[1]  Pushparaj Mani Pathak,et al.  Kinematic Calibration of a Multisection Bionic Manipulator , 2015, IEEE/ASME Transactions on Mechatronics.

[2]  Cecilia Laschi,et al.  Soft robotics: a bioinspired evolution in robotics. , 2013, Trends in biotechnology.

[3]  Daniela Rus,et al.  Dynamics and trajectory optimization for a soft spatial fluidic elastomer manipulator , 2016, Int. J. Robotics Res..

[4]  Jochen J. Steil,et al.  Goal Babbling Permits Direct Learning of Inverse Kinematics , 2010, IEEE Transactions on Autonomous Mental Development.

[5]  Hao Jiang,et al.  A two-level approach for solving the inverse kinematics of an extensible soft arm considering viscoelastic behavior , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Darwin G. Caldwell,et al.  Kinematic-free position control of a 2-DOF planar robot arm , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Hao Jiang,et al.  Design and simulation analysis of a soft manipulator based on honeycomb pneumatic networks , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[8]  Jochen J. Steil,et al.  Efficient Exploratory Learning of Inverse Kinematics on a Bionic Elephant Trunk , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Matteo Cianchetti,et al.  Dynamic Model of a Multibending Soft Robot Arm Driven by Cables , 2014, IEEE Transactions on Robotics.

[10]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[11]  Cecilia Laschi,et al.  Neural Network and Jacobian Method for Solving the Inverse Statics of a Cable-Driven Soft Arm With Nonconstant Curvature , 2015, IEEE Transactions on Robotics.

[12]  Michael C. Yip,et al.  Model-Less Feedback Control of Continuum Manipulators in Constrained Environments , 2014, IEEE Transactions on Robotics.

[13]  Michael C. Yip,et al.  Model-Less Hybrid Position/Force Control: A Minimalist Approach for Continuum Manipulators in Unknown, Constrained Environments , 2016, IEEE Robotics and Automation Letters.