An improved 3D imaging system for dimensional quality inspection of rolled products in the metal industry

Measurement, inspection and quality control in industry have benefited from 3D techniques for imaging and visualization in recent years. The development of machine vision devices at decreased costs, as well as their miniaturization and integration in industrial processes, have accelerated the use of 3D imaging systems in industry. In this paper we describe how to improve the performance of a 3D imaging system for inline dimensional quality inspection of long, flat-rolled metal products manufactured in rolling mills we designed and developed in previous works. Two dimensional characteristics of rolled products are measured by the system: width and flatness. The system is based on active triangulation using a single-line pattern projected onto the surface of the product under inspection for range image acquisition. Taking the system calibration into account the range images are transformed into a calibrated point cloud representing the 3D surface reconstruction of the product. Two approaches to improve the line detection and extraction method used in the original system are discussed, one intended for high-speed processing with lower accuracy, and the other providing high accuracy while incurring higher computational time expenses. A mechanism to remove, or at least reduce, the effects of product movements while manufacturing, such as bouncing and flapping, is also proposed to improve the performance of the system.

[1]  Srikanth Saripalli,et al.  Road Detection and Tracking from Aerial Desert Imagery , 2012, J. Intell. Robotic Syst..

[2]  Daniel F. García,et al.  Fast and robust laser stripe extraction for 3D reconstruction in industrial environments , 2010, Machine Vision and Applications.

[3]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[4]  Daniel F. García,et al.  Real-time flatness inspection of rolled products based on optical laser triangulation and three-dimensional surface reconstruction , 2010, J. Electronic Imaging.

[5]  Lihui Wang,et al.  Review: Advances in 3D data acquisition and processing for industrial applications , 2010 .

[6]  Radu Orghidan,et al.  Modelling and accuracy estimation of a new omnidirectional depth computation sensor , 2006, Pattern Recognit. Lett..

[7]  A. Asadpour,et al.  Design and application of industrial machine vision systems , 2007 .

[8]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[9]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ray A. Jarvis,et al.  A Laser Time-of-Flight Range Scanner for Robotic Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  J. Börchers,et al.  Topometric measurement of the flatness of rolled products — the system TopPlan , 2008 .

[12]  Franz Pernkopf 3D surface acquisition and reconstruction for inspection of raw steel products , 2005, Comput. Ind..

[13]  B. Dörband,et al.  Handbook of optical systems , 2012 .

[14]  Lyndon Smith,et al.  A system for the dynamic industrial inspection of specular freeform surfaces , 2012 .

[15]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[16]  Ruben Usamentiaga,et al.  Real-time system for flatness inspection of steel strips , 2005, IS&T/SPIE Electronic Imaging.

[17]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[18]  Euripides G. M. Petrakis,et al.  A survey on industrial vision systems, applications, tools , 2003, Image Vis. Comput..

[19]  Anil K. Jain,et al.  A Survey of Automated Visual Inspection , 1995, Comput. Vis. Image Underst..

[20]  Anil Mital,et al.  Quality improvement in manufacturing through human performance enhancement , 2001 .

[21]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[22]  Amir Averbuch,et al.  Global parametric image alignment via high-order approximation , 2008, Comput. Vis. Image Underst..

[23]  Kamel S. Saidi,et al.  Gauging the Repeatability of 3-D Imaging Systems by Sphere Fitting , 2011, IEEE Transactions on Instrumentation and Measurement.

[24]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Placid Mathew Ferreira,et al.  Verification of form tolerances part I: Basic issues, flatness, and straightness , 1995 .

[26]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Sidney Ray,et al.  Applied photographic optics , 1998 .

[28]  R. Noll,et al.  Online laser measurement technology for rolled products , 2008 .

[29]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[30]  R. Popovic,et al.  First fully integrated 2-D array of single-photon detectors in standard CMOS technology , 2003, IEEE Photonics Technology Letters.

[31]  Xiaodong Liang,et al.  Influence of Reactors on Input Harmonics of Variable Frequency Drives , 2011, IEEE Transactions on Industry Applications.

[32]  G. Spreitzhofer,et al.  SI-FLAT contactless flatness measurement for cold rolling mills and processing lines , 2005 .

[33]  Lyuba Alboul,et al.  Methods for Indexing Stripes in Uncoded Structured Light Scanning Systems , 2004, WSCG.

[34]  B. Smith Six-sigma design (quality control) , 1993, IEEE Spectrum.

[35]  Toshiko Nakagawa,et al.  A study on vibration control of steel strips by using only current sensors , 2002 .

[36]  Pascal Getreuer,et al.  Automated vasculature extraction from placenta images , 2011, Medical Imaging.

[37]  G. Häusler,et al.  Laser triangulation: fundamental uncertainty in distance measurement. , 1994, Applied optics.

[38]  Daniel F. García,et al.  Real-time line scan extraction from infrared images using the wedge method in industrial environments , 2010, J. Electronic Imaging.

[39]  Jianzhong Lu,et al.  Stereoscopic Vision - An Application Oriented Overview , 1990, Other Conferences.

[40]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Joaquim Salvi,et al.  Laser stripe peak detector for 3D scanners. A FIR filter approach , 2004, ICPR 2004.

[42]  Hsi-Yung Feng,et al.  Analysis of digitizing errors of a laser scanning system , 2001 .

[43]  Hiroshi Akima,et al.  A Method of Bivariate Interpolation and Smooth Surface Fitting for Irregularly Distributed Data Points , 1978, TOMS.

[44]  Peihua Gu,et al.  Free-form surface inspection techniques state of the art review , 2004, Comput. Aided Des..

[45]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[47]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[48]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[49]  Juan C. Granda,et al.  Uncertainty Propagation Analysis in 3-D Shape Measurement Using Laser Range Finding , 2012, IEEE Transactions on Instrumentation and Measurement.

[50]  Alan M. Lytle,et al.  Evaluating a Ranging Protocol for 3D Imaging System , 2007 .