Sensor fusion of phase measuring profilometry and stereo vision for three-dimensional inspection of electronic components assembled on printed circuit boards.

Automatic optical inspection (AOI) for printed circuit board (PCB) assembly plays a very important role in modern electronics manufacturing industries. Well-developed inspection machines in each assembly process are required to ensure the manufacturing quality of the electronics products. However, generally almost all AOI machines are based on 2D image-analysis technology. In this paper, a 3D-measurement-method-based AOI system is proposed consisting of a phase shifting profilometer and a stereo vision system for assembled electronic components on a PCB after component mounting and the reflow process. In this system information from two visual systems is fused to extend the shape measurement range limited by 2pi phase ambiguity of the phase shifting profilometer, and finally to maintain fine measurement resolution and high accuracy of the phase shifting profilometer with the measurement range extended by the stereo vision. The main purpose is to overcome the low inspection reliability problem of 2D-based inspection machines by using 3D information of components. The 3D shape measurement results on PCB-mounted electronic components are shown and compared with results from contact and noncontact 3D measuring machines. Based on a series of experiments, the usefulness of the proposed sensor system and its fusion technique are discussed and analyzed in detail.

[1]  Takayuki Okatani,et al.  Absolute phase measurements using geometric constraints between multiple cameras and projectors. , 2007, Applied optics.

[2]  Jens Guehring,et al.  Dense 3D surface acquisition by structured light using off-the-shelf components , 2000, IS&T/SPIE Electronic Imaging.

[3]  Xianyu Su,et al.  Reliability-guided phase unwrapping algorithm: a review ☆ , 2004 .

[4]  Dirk Bergmann,et al.  New approach for automatic surface reconstruction with coded light , 1995, Optics & Photonics.

[5]  A Asundi,et al.  Fast phase-unwrapping algorithm based on a gray-scale mask and flood fill. , 1998, Applied optics.

[6]  Koichi Iwata,et al.  profile measurement by projecting two gratings with different pitches , 1994 .

[7]  Cihan H. Dagli,et al.  Automatic PCB Inspection Algorithms: A Survey , 1996, Comput. Vis. Image Underst..

[8]  Min Young Kim,et al.  Shadow-Free Moire Interferometer with Dual Projection for In-Line Inspection of Light Emitting Diodes , 2007 .

[9]  Kosuke Sato Range imaging based on moving pattern light and spatio-temporal matched filter , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[10]  Yu. N. Solodkin,et al.  Automatic processing of fringe patterns in integer interferometers , 1991 .

[11]  Georg Wiora High-resolution measurement of phase-shift amplitude and numeric object phase calculation , 2000, SPIE Optics + Photonics.

[12]  J. M. Huntley,et al.  Temporal phase-unwrapping algorithm for automated interferogram analysis. , 1993, Applied optics.

[13]  J M Huntley,et al.  Temporal phase unwrapping: application to surface profiling of discontinuous objects. , 1997, Applied optics.

[14]  Ming Wang,et al.  Phase unwrapping by lookup table method: application to phase map with singular points , 1999 .

[15]  Hyungsuck Cho,et al.  Stereo Moiré Technique: A Novel 3-D Measurement Method Using a Stereo Camera and a Digital Pattern Projector , 2007 .