Fast and robust laser stripe extraction for 3D reconstruction in industrial environments

The use of 3D reconstruction based on active laser triangulation techniques is very complex in industrial environments. The main problem is that most of these techniques are based on laser stripe extraction methods which are highly sensitive to noise, which is virtually inevitable in these conditions. In industrial environments, variable luminance, reflections which show up in the images as noise, and uneven surfaces are common. These factors modify the shape of the laser profile. This work proposes a fast, accurate, and robust method to extract laser stripes in industrial environments. Specific procedures are proposed to extract the laser stripe projected on the background, using a boundary linking process, and on the foreground, using an improved Split-and-Merge approach with different approximation functions including linear, quadratic, and Akima splines. Also, a novel procedure to automatically define the region of interest in the image is proposed. The real-time performance of the proposed method is analyzed by measuring the time taken by the tasks involved in their application. Finally, the proposed extraction method is applied to two real applications: 3D reconstruction of steel strips and weld seam tracking.

[1]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[3]  Ho-Young Lee,et al.  Weld line detection and process control for welding automation , 2007 .

[4]  Lyuba Alboul,et al.  Methods for Indexing Stripes in Uncoded Structured Light Scanning Systems , 2004, WSCG.

[5]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[6]  Daniel F. García,et al.  Real-time flatness inspection of rolled products based on optical laser triangulation and three-dimensional surface reconstruction , 2010, J. Electronic Imaging.

[7]  王国荣,et al.  Study of image processing for V-shape groove and robotic weld seam tracking based on laser vision , 2008 .

[8]  Daniel F. Garcia,et al.  Low-Cost System for Weld Tracking Based on Artificial Vision , 2011 .

[9]  Joaquim Salvi,et al.  A review of laser scanning three-dimensional digitisers , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Osamu Matoba,et al.  Comparison of passive ranging integral imaging and active imaging digital holography for three-dimensional object recognition. , 2004, Applied optics.

[13]  Jorge L. C. Sanz Image Technology: Advances in Image Processing, Multimedia and Machine Vision , 1995 .

[14]  D.J. Kriegman,et al.  Stereo vision and navigation in buildings for mobile robots , 1989, IEEE Trans. Robotics Autom..

[15]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[16]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[17]  Joaquim Salvi,et al.  Laser stripe peak detector for 3D scanners. A FIR filter approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Luca Ballan,et al.  Multimodal 3D Shape Recovery from Texture, Silhouette and Shadow Information , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[19]  Joaquim Salvi,et al.  Laser stripe peak detector for 3D scanners. A FIR filter approach , 2004, ICPR 2004.

[20]  Bojko Vodanovic Structured light tracks seams , 1996 .

[21]  Robert B. Fisher,et al.  A Comparison of Algorithms for Subpixel Peak Detection , 1996 .

[22]  G. Pritschow,et al.  Robust laser-stripe sensor for automated weld-seam-tracking in the shipbuilding industry , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[23]  Hiroshi Akima,et al.  A New Method of Interpolation and Smooth Curve Fitting Based on Local Procedures , 1970, JACM.

[24]  Theodosios Pavlidis,et al.  Segmentation of Plane Curves , 1974, IEEE Transactions on Computers.

[25]  James George Dunham,et al.  Optimum Uniform Piecewise Linear Approximation of Planar Curves , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[27]  Urs Ramer,et al.  An iterative procedure for the polygonal approximation of plane curves , 1972, Comput. Graph. Image Process..

[28]  Radu Orghidan,et al.  Modelling and accuracy estimation of a new omnidirectional depth computation sensor , 2006, Pattern Recognit. Lett..

[29]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[30]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .