Imitation and Supervised Learning of Compliance for Robotic Assembly

We present the design of a learning-based compliance controller for assembly operations for industrial robots. We propose a solution within the general setting of learning from demonstration (LfD), where a nominal trajectory is provided through demonstration by an expert teacher. This can be used to learn a suitable representation of the skill that can be generalized to novel positions of one of the parts involved in the assembly, for example the hole in a peg-in-hole (PiH) insertion task. Under the expectation that this novel position might not be entirely accurately estimated by a vision or other sensing system, the robot will need to further modify the generated trajectory in response to force readings measured by means of a force-torque (F/T) sensor mounted at the wrist of the robot or another suitable location. Under the assumption of constant velocity of traversing the reference trajectory during assembly, we propose a novel accommodation force controller that allows the robot to safely explore different contact configurations. The data collected using this controller is used to train a Gaussian process model to predict the misalignment in the position of the peg with respect to the target hole. We show that the proposed learning-based approach can correct various contact configurations caused by misalignment between the assembled parts in a PiH task, achieving high success rate during insertion. We show results using an industrial manipulator arm, and demonstrate that the proposed method can perform adaptive insertion using force feedback from the trained machine learning models.

[1]  H. Harry Asada,et al.  Representation and learning of nonlinear compliance using neural nets , 1993, IEEE Trans. Robotics Autom..

[2]  Avinash C. Kak,et al.  A dynamic approach to high-precision parts mating , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[3]  Joshua B. Tenenbaum,et al.  Data-Efficient Learning for Complex and Real-Time Physical Problem Solving Using Augmented Simulation , 2021, IEEE Robotics and Automation Letters.

[4]  Jens Kober,et al.  Learning Assembly Tasks in a Few Minutes by Combining Impedance Control and Residual Recurrent Reinforcement Learning , 2021, Advanced Intelligent Systems.

[5]  Roland Carlyle Groome Force feedback steering of a teleoperator system. , 1972 .

[6]  Jimmy A. Jørgensen,et al.  Adaptation of manipulation skills in physical contact with the environment to reference force profiles , 2015, Auton. Robots.

[7]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Devesh K. Jha,et al.  Tactile-RL for Insertion: Generalization to Objects of Unknown Geometry , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Daniel E. Whitney,et al.  Historical Perspective and State of the Art in Robot Force Control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[10]  H. Harry Asada,et al.  Teaching and learning of compliance using neural nets: representation and generation of nonlinear compliance , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[11]  V. Gullapalli,et al.  Acquiring robot skills via reinforcement learning , 1994, IEEE Control Systems.

[12]  Wyatt S. Newman,et al.  Interpretation of force and moment signals for compliant peg-in-hole assembly , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[14]  Daniel E. Whitney,et al.  Force Feedback Control of Manipulator Fine Motions , 1977 .

[15]  Michael A. Peshkin,et al.  Programmed compliance for error corrective assembly , 1990, IEEE Trans. Robotics Autom..

[16]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[17]  Alberto Rodriguez,et al.  Tactile-Based Insertion for Dense Box-Packing , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Vincent Lepetit,et al.  A Summary of the 4th International Workshop on Recovering 6D Object Pose , 2018, ECCV Workshops.

[19]  Daniel E. Whitney,et al.  Research on Advanced Assembly Automation , 1977, Computer.

[20]  Devesh K. Jha,et al.  Semiparametrical Gaussian Processes Learning of Forward Dynamical Models for Navigating in a Circular Maze , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[21]  井上 博允,et al.  Force Feedback in Precise Assembly Tasks , 1975 .

[22]  Devesh K. Jha,et al.  Anomaly Detection for Insertion Tasks in Robotic Assembly Using Gaussian Process Models , 2019, 2019 18th European Control Conference (ECC).

[23]  Silvio Savarese,et al.  Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks , 2019, IEEE Transactions on Robotics.

[24]  Devesh K. Jha,et al.  Understanding Multi-Modal Perception Using Behavioral Cloning for Peg-In-a-Hole Insertion Tasks /Author=Romeres, Diego; Liu, Yifang; Jha, Devesh K.; Nikovski, Daniel N. /CreationDate=July 22, 2020 /Subject=Machine Learning, Robotics , 2020 .