Trajectory Sampling and Fitting Restoration Based on Machine Vision for Robot Fast Teaching

Industrial robot teaching movement methods can be roughly divided into two types: direct teaching and offline teaching. Because the offline teaching method requires modeling of the robot and its surroundings, the technical requirements of the operator are high and the process is time-consuming and energy-consuming, the direct teaching method is commonly used. However, when the trajectory of the robot movement is complicated, a large number of points need to be taught to ensure the accuracy of the movement. In order to improve the teaching efficiency, a rapid teaching method for industrial robots based on machine vision technology is proposed. This method requires the robot to move on a fixed plane and achieves rapid teaching by sampling and fitting the robot's end trajectory. Firstly, a robot visual teaching system composed of a robot movement control subsystem and a visual image acquisition and processing subsystem is set up, which solved the communication problem between B & R real-time operating system and Windows operating system. It realizes direct observation of movement trajectory by method of "eye-in-hand". Then, using the data points obtained by manual sampling, a cubic B-spline curve fitting algorithm is used to fit and restore a continuous and smooth trajectory curve. Using the camera's internal and external parameters and the hand-eye calibration results, the target set point sequence to which the robot end should move can be inversely calculated. Finally, the experiment discusses the influence of different sampling methods on the trajectory restoration result and obtains the optimal sampling method to improve the accuracy of trajectory restoration. Although this method cannot be applied to scenarios with strict location accuracy requirements, it can be applied to most welding and spraying tasks with general location accuracy requirements. At the same time, the binocular camera or RGB-D depth camera can be used to replace the monocular camera in this paper, so that the method can be extended to three-dimensional stereo application scenarios.

[1]  An algorithm for nonlinear L 1 curve-fitting based on the smooth approximation , 1995 .

[3]  Kazuo Tanie,et al.  Trajectory Control of a Wheel-type Mobile Robot Using B-spline Curve , 1990 .

[4]  Christoph Stiller,et al.  Camera calibration for lane and obstacle detection , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[5]  Ming-Chih Huang,et al.  The Pre-Processing of Data Points for Curve Fitting in Reverse Engineering , 2000 .

[6]  Xianmin Zhang,et al.  Calibration of a Robot Vision System Coupled with Structured Light: Method and Experiments , 2014, ICIRA.

[7]  K Herbuś,et al.  Verification of operation of the actuator control system using the integration the B&R Automation Studio software with a virtual model of the actuator system , 2017 .

[8]  Jianjun Yuan,et al.  Torque control based direct teaching for industrial robot considering temperature-load effects on joint friction , 2019, Ind. Robot.

[9]  Mehmet Hadi Gunes,et al.  Operating System Classification Performance of TCP/IP Protocol Headers , 2016, 2016 IEEE 41st Conference on Local Computer Networks Workshops (LCN Workshops).

[10]  Tao Tao,et al.  Development of a virtual teaching pendant system for serial robots based on ROS-I , 2017, 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[11]  Myung Jin Chung,et al.  Concepts of Augmented Image Space and Transformed Feature Space for Efficient Visual Servoing of an "Eye-in-Hand Robot" , 1991, Robotica.

[12]  Pedro Neto,et al.  CAD-based off-line robot programming , 2010, 2010 IEEE Conference on Robotics, Automation and Mechatronics.

[13]  Gregory S. Chirikjian,et al.  An information-theoretic approach to the correspondence-free AX=XB sensor calibration problem , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  James J. Little,et al.  Overcoming occlusions in eye-in-hand visual search , 2012, 2012 American Control Conference (ACC).

[15]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[16]  Dipl.-Inform. Karl-Heinz John,et al.  IEC 61131-3: Programming Industrial Automation Systems , 2001, Springer Berlin Heidelberg.

[17]  Éric Marchand,et al.  Eye-in-hand/eye-to-hand cooperation for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[18]  Samar Shailendra,et al.  Reliable robotic communication using multi-path TCP , 2017, 2017 9th International Conference on Communication Systems and Networks (COMSNETS).