Enhanced anomaly detection in wire ropes by combining structure and appearance

Automatic visual surface inspection is a challenging task, which has become important for quality assurance in the last years. Wire rope inspection is a special problem within this field. Usually, the huge and heavy ropes cannot be detached. Thus, an inspection of the ropes must be conducted, while the ropes are in use. The rope surface exhibits various appearance characteristics so that the existing, purely appearance-based approaches tend to fail. We explicitly integrate information about the object geometry, which we obtain by aligning a sequence of 2d rope images with a perfectly regular 3d model of the rope. The rendering equation is used to link object geometry to the observed rope appearance. Based on the connection between geometry and surface appearance we build a probabilistic appearance model which serves as representation for normal surface variations. A robust localization of rope surface defects is achieved by means of anomaly detection. The presented approach has no need for knowledge about the illumination setting or the reflectance properties of the material. An evaluation on real-world data from ropeways leads to an accuracy comparable to that of a human expert. With an accuracy of 95% and a false-alarm-rate of 1.5% the approach outperforms all other existing approaches.

[1]  H. Jensen.  Realistic Image Synthesis Using Photon Mapping , 2001 .

[2]  Matti Pietikäinen,et al.  Real-time surface inspection by texture , 2003, Real Time Imaging.

[3]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[4]  Joachim Denzler,et al.  An Analysis-by-Synthesis Approach to Rope Condition Monitoring , 2010, ISVC.

[5]  Joachim Denzler,et al.  One-Class Classification for Anomaly Detection in Wire Ropes with Gaussian Processes in a Few Lines of Code , 2011, MVA.

[6]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[7]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[8]  Majid Mirmehdi,et al.  Restructured Eigenfilter Matching for Novelty Detection in Random Textures , 2004, BMVC.

[9]  Dmitry Chetverikov.  Structural defects: general approach and application to textile inspection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  Joachim Denzler,et al.  Analysis of Structural Dependencies for the Automatic Visual Inspection of Wire Ropes , 2010, VMV.

[11]  Klaus Feyrer,et al.  Wire Ropes: Tension, Endurance, Reliability , 2007 .

[12]  William H. Press,et al.  Numerical recipes in C , 2002 .

[13]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[14]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[15]  Reinhard Koch,et al.  Dynamic 3-D Scene Analysis Through Synthesis Feedback Control , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  A. Ertuzun,et al.  Defect detection in textile fabric images using wavelet transforms and independent component analysis , 2006, Pattern Recognition and Image Analysis.

[17]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[18]  Hannu Kauppinen,et al.  COLOR AND TEXTURE BASED WOOD INSPECTION WITH NON-SUPERVISED CLUSTERING , 2001 .

[19]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[20]  Dianguo Xu,et al.  A New Method of Defects Identification for Wire Rope Based on Three-Dimensional Magnetic Flux Leakage , 2006 .

[21]  Joachim Denzler,et al.  On the Suitability of Different Features for Anomaly Detection in Wire Ropes , 2009, VISIGRAPP.

[22]  Jukka Iivarinen,et al.  Shape-Based Co-occurrence Matrices for Defect Classification , 2005, SCIA.

[23]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[24]  Peter Shirley,et al.  Fundamentals of computer graphics , 2018 .

[25]  Joachim Denzler,et al.  HMM-Based Defect Localization in Wire Ropes - A New Approach to Unusual Subsequence Recognition , 2009, DAGM-Symposium.

[26]  Michael Unser,et al.  Feature extraction and decision procedure for automated inspection of textured materials , 1984, Pattern Recognit. Lett..

[27]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[28]  Stephen H. Westin,et al.  Image-based bidirectional reflectance distribution function measurement. , 2000, Applied optics.

[29]  Allan Hanbury,et al.  Finding defects in texture using regularity and local orientation , 2002, Pattern Recognit..

[30]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[31]  Didier Stricker,et al.  Adaptable Model-Based Tracking Using Analysis-by-Synthesis Techniques , 2007, CAIP.

[32]  Reinhard Koch,et al.  An Analysis-by-Synthesis Camera Tracking Approach Based on Free-Form Surfaces , 2007, DAGM-Symposium.

[33]  Ehsanollah Kabir,et al.  Fabric Defect Detection Using Modified Local Binary Patterns , 2008, EURASIP J. Adv. Signal Process..

[34]  Peter Eisert.  Model-Based Camera Calibration Using Analysis by Synthesis Techniques , 2002, VMV.

[35]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[36]  N. Hasler,et al.  An Analysis-by-Synthesis Approach to Tracking of Textiles , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[37]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[38]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[39]  Xianghua Xie,et al.  A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques , 2008 .

[40]  Ron Kohavi,et al.  The Case against Accuracy Estimation for Comparing Induction Algorithms , 1998, ICML.

[41]  Kristin J. Dana.  BRDF/BTF measurement device , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[42]  Nicola Ancona,et al.  Rail corrugation detection by Gabor filtering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[43]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[44]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[45]  Jukka Iivarinen,et al.  Surface defect detection with histogram-based texture features , 2000, SPIE Optics East.

[46]  Ajai Jain,et al.  The Handbook of Pattern Recognition and Computer Vision , 1993 .

[47]  Zhigang Fan,et al.  Automated Inspection of Textile Fabrics Using Textural Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[49]  Felix Naumann,et al.  Data fusion , 2009, CSUR.