Improved Visual Inspection through 3D Image Reconstruction of Defects Based on the Photometric Stereo Technique

Visual inspections of nuclear power plant (NPP) reactors are important for understanding current NPP conditions. Unfortunately, the existing visual inspection methods only provide limited two-dimensional (2D) information due to a loss of depth information, which can lead to errors identifying defects. However, the high cost of developing new equipment can be avoided by using advanced data processing technology with existing equipment. In this study, a three-dimensional (3D) photometric stereo (PS) reconstruction technique is introduced to recover the lost depth information in NPP images. The system uses conventional inspection equipment, equipped with a camera and four light-emitting diodes (LEDs). The 3D data of the object surface are obtained by capturing images under multiple light sources oriented in different directions. The proposed method estimates the light directions and intensities for various image pixels in order to reduce the limitation of light calibration, which results in improved performance. This novel technique is employed to test specimens with various defects under laboratory conditions, revealing promising results. This study provides a new visual inspection method for NPP reactors.

[1]  Charlie C. L. Wang,et al.  Photometric stereo with near point lighting: A solution by mesh deformation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Michael Goesele,et al.  A Survey of Photometric Stereo Techniques , 2015, Found. Trends Comput. Graph. Vis..

[3]  Stephen Marshall,et al.  Improved Visual Inspection of Advanced Gas-Cooled Reactor Fuel Channels , 2015 .

[4]  Kui Jia,et al.  A practical means for calibrating an LED-based photometric stereo system , 2015 .

[5]  Hartmut Neven Machine Vision Technology , 2007 .

[6]  Steven R. Doctor,et al.  The Capabilities and Limitations of Remote Visual Methods to Detect Service-Induced Cracks in Reactor Components , 2006 .

[7]  Daniel Cremers,et al.  Semi-calibrated Near-Light Photometric Stereo , 2017, SSVM.

[8]  Paolo Favaro,et al.  A New Perspective on Uncalibrated Photometric Stereo , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  A. Bors,et al.  Height estimation from vector fields of surface normals , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[10]  Daniel Cremers,et al.  LED-Based Photometric Stereo: Modeling, Calibration and Numerical Solution , 2017, Journal of Mathematical Imaging and Vision.

[11]  Hui-Liang Shen,et al.  Photometric Stereo for General BRDFs via Reflection Sparsity Modeling , 2015, IEEE Transactions on Image Processing.

[12]  Alfred M. Bruckstein,et al.  Near Field Photometric Stereo with Point Light Sources , 2014, SIAM J. Imaging Sci..

[13]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[14]  Christian Eitzinger,et al.  Photometric stereo sensor for robot-assisted industrial quality inspection of coated composite material surfaces , 2015, International Conference on Quality Control by Artificial Vision.

[15]  Roberto Cipolla,et al.  Semi-Calibrated Near Field Photometric Stereo , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Yasuyuki Matsushita,et al.  Uncalibrated Photometric Stereo Under Natural Illumination , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Digital Image Processing for the Automation of NDT by Means of Endoscopy , 2016 .

[19]  Maria Petrou,et al.  The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Stephen Marshall,et al.  Automated in-core image generation from video to aid visual inspection of nuclear power plant cores , 2016 .

[21]  Paolo Favaro,et al.  Uncalibrated Near-Light Photometric Stereo , 2014, BMVC.

[22]  Sangchul Won,et al.  Development of an inspection system for planar steel surface using multispectral photometric stereo , 2013 .

[23]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[24]  Zhe Wu,et al.  A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo , 2019, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).