Image Processing for Automated Welding Robot: Reducing Interference due to Fume in Camera Lenses

Welding is crucial for several industrial sectors. The problems associated with this laborious work and the worker's health are known for a long time. However, the welding is still highly dependent of a skilled human workforce. Researchers presented solutions to automate this process, many of them using robots equipped with cameras. Nevertheless, the fumes produced by the arc welding process adhere to the camera lens hinder the robot's perception. The fume is composed of by-products from melting metal becoming suspended in the air and adhering to surrounding surfaces. Thus, one of the main issues to be solved in the robotized welding with cameras is to deal with the fume adhered the camera lenses. In this paper, we propose a method to minimize the interference of the fumes present in the camera lens based on a fusion of image processing methods. The results shows the method is able to improve the groove detection allowing a better welding.

[1]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[2]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[3]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[4]  Christophe De Vleeschouwer,et al.  Single-Scale Fusion: An Effective Approach to Merging Images , 2017, IEEE Trans. Image Process..

[5]  Kun Zhou,et al.  Removal of dust artifacts in focal stack image sequences , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  P. Belhumeur,et al.  Removing image artifacts due to dirty camera lenses and thin occluders , 2009, SIGGRAPH 2009.

[7]  Qi Wu,et al.  Raindrop detection and removal using salient visual features , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Donghun Lee,et al.  Robots in the shipbuilding industry , 2014 .

[9]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[10]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[11]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[12]  Silvia Silva da Costa Botelho,et al.  Vision-based system for welding groove measurements for robotic welding applications , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Cosmin Ancuti,et al.  Decolorizing images for robust matching , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Rodrigo Zelir Azzolin,et al.  Automated seam tracking system based on passive monocular vision for automated linear robotic welding process , 2017, INDIN.

[15]  Katsushi Ikeuchi,et al.  Adherent Raindrop Modeling, Detectionand Removal in Video , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Rob Fergus,et al.  Restoring an Image Taken through a Window Covered with Dirt or Rain , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Kaleem Siddiqi,et al.  Removing Partial Occlusion from Blurred Thin Occluders , 2010, 2010 20th International Conference on Pattern Recognition.

[18]  Mohan S. Kankanhalli,et al.  Super-resolution de-fencing: Simultaneous fence removal and high-resolution image recovery using videos , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[19]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[20]  Stephen Lin,et al.  Removal of Image Artifacts Due to Sensor Dust , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Katsushi Ikeuchi,et al.  Raindrop Detection and Removal from Long Range Trajectories , 2014, ACCV.

[22]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Edwilson Silva Vaz Junior,et al.  Restoration of Images Affected by Welding Fume , 2018, SIBGRAPI.

[24]  Jing Tian,et al.  Dust particle detection in surveillance video using salient visual descriptors , 2017, Comput. Electr. Eng..