An image processing algorithm for the automatic manipulation of tie rod

In this paper, we present a robust image processing algorithm for the automatic manipulation of tie rod in the automotive assembly process. A sensing system consisting of a camera and a slit laser is used to obtain 3D data for processing. It is attached to the robot’s arm. A nut runner is used as an end-effector of the robot to manipulate the bolt and nut on the tie rod. For the successful operation, a robust image processing algorithm that can cope with diverse illumination variations in manufacturing conditions is required. We present a robust algorithm for the extraction of laser contours on images. It consists of two steps where color and grey information is used to cope with clutters caused by laser reflections on metal surfaces. Experimental results using many images under real conditions show the robustness of the proposed algorithm.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Gary M. Bone,et al.  Vision-guided fixtureless assembly of automotive components , 2003 .

[3]  Ismael Lopez-Juarez,et al.  Machine vision approach for robotic assembly , 2005 .

[4]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[5]  James K. Mills,et al.  Three-dimensional localization of thin-walled sheet metal parts for robotic assembly , 2002, J. Field Robotics.

[6]  Douglas Lanman,et al.  Build your own 3D scanner: 3D photography for beginners , 2009, SIGGRAPH '09.

[7]  Jong-Eun Ha,et al.  Calibration of structured light stripe system using plane with slits , 2013 .

[8]  Jeremy S. Smith,et al.  Weld bead placement system for multipass welding , 1996 .

[9]  Y F Li,et al.  Determination of Stripe Edge Blurring for Depth Sensing , 2011, IEEE Sensors Journal.

[10]  Kenzo Nonami,et al.  Assembly manipulation of small objects by dual‐arm manipulator , 2011 .

[11]  Gerd Hirzinger,et al.  Flexible robot-assembly using a multi-sensory approach , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  De Xu,et al.  On-line Visual Measurement and Inspection of Weld Bead Using Structured Light , 2008, 2008 IEEE Instrumentation and Measurement Technology Conference.

[13]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[14]  Lei Zhang,et al.  Vision-Based Profile Generation Method of TWB for a New Automatic Laser Welding Line , 2007, 2007 IEEE International Conference on Automation and Logistics.

[15]  Ulrich Rembold,et al.  Development of an advanced robot for autonomous assembly , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.