Robust Anomaly Detection Using Reflectance Transformation Imaging for Surface Quality Inspection

We propose a novel methodology for the detection and analysis of visual anomalies on challenging surfaces (metallic). The method is based on a local assessment of the reflectance across the inspected surface, using Reflectance Transformation Imaging data: a set of luminance images captured by a fixed camera while varying light spatial positions. The reflectance, in each pixel, is modelled by means of a projection of the measured luminances onto a basis of geometric functions, in this case, the Discrete Modal Decomposition (DMD) basis. However, a robust detection and analysis of surface visual anomalies requires that the method must not be affected neither by the geometry (sensor and surface orientation) nor by the texture pattern orientation of the inspected surface. We therefore introduce a rotation-invariant representation on the DMD, from which we devise saliency maps representing the local differences on reflectances. The methodology is tested on different engineering metallic samples exhibiting several types of defects. Compared to other saliency assessments, the results of our methodology demonstrate the best performance regarding anomaly detection, localisation and analysis.

[1]  M. J. Chantler,et al.  Visual search for a target against a 1/fβ continuous textured background , 2008, Vision Research.

[2]  Fraser Sturt,et al.  Underwater reflectance transformation imaging: a technology for in situ underwater cultural heritage object-level recording , 2017, J. Electronic Imaging.

[3]  Mark S. Drew,et al.  Efficient robust image interpolation and surface properties using polynomial texture mapping , 2014, EURASIP Journal on Image and Video Processing.

[4]  Laurent Itti,et al.  Realistic avatar eye and head animation using a neurobiological model of visual attention , 2004, SPIE Optics + Photonics.

[5]  J. H. Heida,et al.  D-Sight technique for rapid impact damage detection on composite aircraft structures , 1997 .

[6]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[7]  Rodger L. Reynolds,et al.  Theory and applications of a surface inspection technique using double-pass retroreflection , 1993 .

[8]  Kirk Martinez,et al.  Archaeological applications of polynomial texture mapping: analysis, conservation and representation , 2010 .

[9]  Qiang Chen,et al.  Integrating clustering with level set method for piecewise constant Mumford-Shah model , 2014, EURASIP J. Image Video Process..

[10]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[11]  Roberto Scopigno,et al.  High Quality PTM Acquisition: Reflection Transformation Imaging for Large Objects , 2006, VAST.

[12]  Yacov Hel-Or,et al.  Robust estimation of surface properties and interpolation of shadow/specularity components , 2012, Image Vis. Comput..

[13]  Ke Xu,et al.  Design of online surface inspection system of hot rolled strips , 2008, 2008 IEEE International Conference on Automation and Logistics.

[14]  Hugues Favrelière,et al.  Discrete Modal Decomposition for surface appearance modelling and rendering , 2015, Optical Metrology.

[15]  Jing Zhang,et al.  A Novel Text Detection System Based on Character and Link Energies , 2014, IEEE Transactions on Image Processing.

[16]  Théodore Puntous,et al.  Ability of quality controllers to detect standard scratches on polished surfaces , 2013 .

[17]  Alasdair D F Clarke,et al.  Modeling visual search on a rough surface. , 2009, Journal of vision.

[18]  Jon Y. Hardeberg,et al.  Saliency for Spectral Image Analysis , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Dusmanta Kumar Mohanta,et al.  Review of vision-based steel surface inspection systems , 2014, EURASIP Journal on Image and Video Processing.

[20]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[21]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[22]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[23]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.