Assembly robots with optimized control stiffness through reinforcement learning

There is an increased demand for task automation in robots. Contact-rich tasks, wherein multiple contact transitions occur in a series of operations, are extensively being studied to realize high accuracy. In this study, we propose a methodology that uses reinforcement learning (RL) to achieve high performance in robots for the execution of assembly tasks that require precise contact with objects without causing damage. The proposed method ensures the online generation of stiffness matrices that help improve the performance of local trajectory optimization. The method has an advantage of rapid response owing to short sampling time of the trajectory planning. The effectiveness of the method was verified via experiments involving two contact-rich tasks. The results indicate that the proposed method can be implemented in various contact-rich manipulations. A demonstration video shows the performance. (this https URL)

[1]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[2]  Li Fei-Fei,et al.  Progressive Neural Architecture Search , 2017, ECCV.

[3]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[4]  Sergey Levine,et al.  Deep Reinforcement Learning for Industrial Insertion Tasks with Visual Inputs and Natural Reward Signals , 2019 .

[5]  Marcin Andrychowicz,et al.  Sim-to-Real Transfer of Robotic Control with Dynamics Randomization , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Homayoon Kazerooni,et al.  On the Stability of Robot Compliant Motion Control: Theory and Experiments , 1990 .

[7]  Razvan Pascanu,et al.  Sim-to-Real Robot Learning from Pixels with Progressive Nets , 2016, CoRL.

[8]  Ken Chen,et al.  Fast Skill Learning for Variable Compliance Robotic Assembly , 2019, ArXiv.

[9]  Oleg O. Sushkov,et al.  A Practical Approach to Insertion with Variable Socket Position Using Deep Reinforcement Learning , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[10]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[11]  Kouhei Ohnishi,et al.  Motion control for advanced mechatronics , 1996 .

[12]  Sangcheol Lee,et al.  Development of a new variable remote center compliance (VRCC) with modified elastomer shear pad (ESP) for robot assembly , 2005, IEEE Transactions on Automation Science and Engineering.

[13]  Prabir K. Pal,et al.  Intelligent and environment-independent Peg-In-Hole search strategies , 2013, 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE).

[14]  Dale Lawrence,et al.  Position-based impedance control - Achieving stability in practice , 1987 .

[15]  Silvio Savarese,et al.  Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[16]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[17]  Ken Chen,et al.  Learning-based Variable Compliance Control for Robotic Assembly , 2018 .

[18]  Marcelo H. Ang,et al.  Specifying and achieving passive compliance based on manipulator structure , 1995, IEEE Trans. Robotics Autom..

[19]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[20]  Giovanni De Magistris,et al.  Deep reinforcement learning for high precision assembly tasks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Alice M. Agogino,et al.  Reinforcement Learning on Variable Impedance Controller for High-Precision Robotic Assembly , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[22]  Toshiaki Tsuji,et al.  Force control of a jumping musculoskeletal robot with pneumatic artificial muscles , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Jan Peters,et al.  A Survey on Policy Search for Robotics , 2013, Found. Trends Robotics.