Principal Component Analysis-Based Image Fusion Routine with Application to Automotive Stamping Split Detection

This study discusses the development and implementation of noncontact split detection method, for automotive stamping press lines. The system features a novel fusion routine that combines thermal and visible images in real-time, assisted with principle component analysis (PCA) subroutine. The thermal detector scans the temperature maps of the highly reflective steel sheets in the die cavity to locate abnormal temperature readings that might be indicative of high local wrinkling pressure, while the visible vision system offsets the blurring effect caused by heat diffusion across the surface and provide a spatial reference. The employed PCA uses a new singular value decomposition (SVD) that is more efficient than standard SVD computations, enabling the PCA to be applied in real-time acquisitions (∼30 Hz). The PCA affects the images by reducing the nonvalue data content (reduce redundancy, noise) while highlighting important features. The fusion is done using a pixel-level algorithm using different variations, where each is assessed for performance. The proposed detection system has been tested on an automotive pressline to assess the formability of complex-shaped panels and have shown high detection success rate. Different splits with variant shape, size, and severity have been detected under actual operating conditions.

[1]  W. M. Cummings,et al.  Thermoelastic stress analysis , 1991 .

[2]  G A H Al-Kindi,et al.  An application of machine vision in the automated inspection of engineering surfaces , 1992 .

[3]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[4]  Borut Zalik,et al.  Surface interrogation methods , 1995, Comput. Graph..

[5]  Rick S. Blum Distributed reception of fading signals in noise , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[6]  Jürgen Beyerer,et al.  Model-based analysis of groove textures with applications to automated inspection of machined surfaces , 1995 .

[7]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[8]  H. Hartmann,et al.  Cellector: A new software tool for the support of cell projection in combination with variable shape electron beam lithography for mask and direct write applications , 1999 .

[9]  Sy-Wei Lo,et al.  Monitoring the Displacement of a Blank in a Deep Drawing Process by Using a New Embedded-Type Sensor , 1999 .

[10]  André Chrysochoos,et al.  An infrared image processing to analyse the calorific effects accompanying strain localisation , 2000 .

[11]  M. J. Cardew-Hall,et al.  Estimating quality costs in an automotive stamping plant through the use of simulation , 2001 .

[12]  Nik Rajic,et al.  Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures , 2002 .

[13]  Hong Zheng,et al.  Automatic inspection of metallic surface defects using genetic algorithms , 2002 .

[14]  E. Doege,et al.  Contactless on-line measurement of material flow for closed loop control of deep drawing , 2002 .

[15]  Gang Hong,et al.  High resolution image fusion based on wavelet and IHS transformations , 2003 .

[16]  G. Rossi,et al.  Measurements of stress pattern on roll bearing supports by thermoelasticity , 2003 .

[17]  E. Doege,et al.  Development of an Optical Sensor for the Measurement of the Material Flow in Deep Drawing Processes , 2003 .

[18]  Karl D. Majeske,et al.  Identifying Sources of Variation in Sheet Metal Stamping , 2003 .

[19]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[20]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[21]  Anil K. Jain,et al.  Biometric technology for human identification , 2004 .

[22]  Sy-Wei Lo,et al.  Closed-loop control of the blank holding force in sheet metal forming with a new embedded-type displacement sensor , 2004 .

[23]  Ermanno G. Grinzato,et al.  Statistical analysis of IR thermographic sequences by PCA , 2004 .

[24]  Paulo A.F. Martins,et al.  Stamping of automotive components: a numerical and experimental investigation , 2004 .

[25]  André Chrysochoos,et al.  Calorimetric analysis of dissipative and thermoelastic effects associated with the fatigue behavior of steels , 2004 .

[26]  Kozo Saito,et al.  IR self-referencing thermography for detection of in-depth defects , 2005 .

[27]  Rick S. Blum,et al.  Multi-sensor image fusion and its applications , 2005 .

[28]  Yi Shen,et al.  Comparisons of Several Pixel-Level Image Fusion Schemes for Infrared and Visible Light Images , 2005, 2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.

[29]  Jinwen Tian,et al.  Multi-sensor image data fusion based on pixel-level weights of wavelet and the PCA transform , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[30]  Cedric Nishan Canagarajah,et al.  Image fusion using a new framework for complex wavelet transforms , 2005, IEEE International Conference on Image Processing 2005.

[31]  Kozo Saito,et al.  IR Thermography for the Nondestructive Evaluation of the Protective Coating Coverage on Steel Substrates , 2005 .

[32]  Kozo Saito,et al.  Infrared seed inspection system (IRSIS) on painted car shells , 2006 .

[33]  Eusebio de la Fuente López,et al.  On-line machine vision system for detect split defects in sheet-metal forming processes , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[34]  Jorge Ferreira,et al.  Control system of a mini hydraulic press for evaluating springback in sheet metal forming , 2006 .

[35]  Norman S Kopeika,et al.  Range gated active night vision system for automobiles. , 2006, Applied optics.

[36]  Jorge Ferreira,et al.  Close loop control of a hydraulic press for springback analysis , 2006 .

[37]  Joel Lanir,et al.  Comparing Multispectral Image Fusion Methods for a Target Detection Task , 2006, 2006 9th International Conference on Information Fusion.

[38]  Zheng Qin,et al.  Effective Image Fusion Rules Of Multi-scale Image Decomposition , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[39]  Yi Zhou,et al.  Automated applications of the infrared imagers in the automotive assembly lines: products and process control , 2007, SPIE Defense + Commercial Sensing.

[40]  L. Chan,et al.  Grids Reformation for Effective Strain Measurement of Forming Titanium Tailor-Welded Blanks at Elevated Temperatures , 2007 .

[41]  Ruxu Du,et al.  Diagnosis of Sheet Metal Stamping Processes Based on 3-D Thermal Energy Distribution , 2007, IEEE Trans Autom. Sci. Eng..

[42]  Ruxu Du,et al.  Diagnosis of Sheet Metal Stamping Processes Based on 3-D Thermal Energy Distribution , 2007, IEEE Transactions on Automation Science and Engineering.

[43]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[44]  Rick S. Blum,et al.  Investigation of image fusion algorithms and performance evaluation for night vision , 2007 .

[45]  Miao Qiguang,et al.  A novel image fusion algorithm using FRIT AND PCA , 2007, 2007 10th International Conference on Information Fusion.

[46]  Mohammed A. Omar,et al.  Pedestrian tracking routine for passive automotive night vision systems , 2007 .

[47]  Robert X. Gao,et al.  Process monitoring in stamping operations through tooling integrated sensing , 2008 .

[48]  Mohammed A. Omar,et al.  Dynamic-template processing for passive thermograms: Applied to automotive stamping split detection , 2008 .

[49]  Omar Hatamleh,et al.  A comprehensive investigation on the effects of laser and shot peening on fatigue crack growth in friction stir welded AA 2195 joints , 2009 .

[50]  Eric Planting Thermoelastic behavior of a small bearing cage , 2009 .

[51]  Yi Zhou,et al.  Pixel-Level Fusion for Infrared and Visible Acquisitions , 2009 .

[52]  Thomas Ummenhofer,et al.  On the use of infrared thermography for the analysis of fatigue damage processes in welded joints , 2009 .

[53]  Robert X. Gao,et al.  Tooling-integrated sensing systems for stamping process monitoring , 2009 .

[54]  Yi Zhou,et al.  Feature-level and pixel-level fusion routines when coupled to infrared night-vision tracking scheme , 2010 .

[55]  Yi Zhou,et al.  A combined approach of self-referencing and Principle Component Thermography for transient, steady, and selective heating scenarios , 2010 .