Intelligent detection of edge inconsistency for mechanical workpiece by machine vision with deep learning and variable geometry model

Inconsistent edges of mechanical workpieces in the same batch are one of the main reasons that lead to different machining performance. A full recognition of the inconsistent features has significant impact on enhancement of their intelligent machining ability. An intelligent hybrid strategy is proposed for edge inconsistent feature detection by machine vision, in which deep learning is combined with variable geometric model together to conduct the function. A deep convolutional neural network based feature classification model is established with K-Means clustering tactic. Supported on the classification model, a variable geometric model for specific edge inconsistency is given with an inconsistency evaluation function to investigate the match degree between the geometric model and the actual detected edge, and then particle swarm optimization algorithm is applied to find the solution of this geometric model. Detection experiments are carried out on a domestic servo-driven vision measuring platform to verify the performance of the proposed approach. The results show that the combined scheme can classify the different type of geometric contour of edge features with 100% correctness, and better evaluation performance by dice similarity index and Hausdorff distance in comparisons with other recent candidate methodologies. It is also indicated that the presented method provides a good recognition of the geometrical shape with less than 0.06 m m maximum error for workpiece with 142 × 119 m m size in the visual field.

[1]  Li Jing,et al.  Saliency detection using adaptive background template , 2017 .

[2]  Laura Igual,et al.  Image Segmentation With Cage Active Contours , 2015, IEEE Transactions on Image Processing.

[3]  Pascal Ray,et al.  A new approach to identifying the elastic behaviour of a manufacturing machine , 2008 .

[4]  Thirapiroon Thongkamwitoon,et al.  An Image Recapture Detection Algorithm Based on Learning Dictionaries of Edge Profiles , 2015, IEEE Transactions on Information Forensics and Security.

[5]  Xiaowen Shi,et al.  Edge detection with feature re-extraction deep convolutional neural network , 2018, J. Vis. Commun. Image Represent..

[6]  H. H. Shahabi,et al.  Prediction of surface roughness and dimensional deviation of workpiece in turning: a machine vision approach , 2010 .

[7]  Qingling Li,et al.  Automatic Detection of Defects in Tire Radiographic Images , 2017, IEEE Transactions on Automation Science and Engineering.

[8]  Hai-Miao Hu,et al.  Naturalness Preserved Nonuniform Illumination Estimation for Image Enhancement Based on Retinex , 2017, IEEE Transactions on Multimedia.

[9]  Jian Cheng,et al.  Additive Margin Softmax for Face Verification , 2018, IEEE Signal Processing Letters.

[10]  Quoc-Lam Nguyen,et al.  Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network , 2018, Automation in Construction.

[11]  Chen-Yang Cheng,et al.  Particle swarm optimization with fitness adjustment parameters , 2017, Comput. Ind. Eng..

[12]  Menglong Yan,et al.  Object recognition in remote sensing images using sparse deep belief networks , 2015 .

[13]  Dong-Joong Kang,et al.  Machine learning-based imaging system for surface defect inspection , 2016, International Journal of Precision Engineering and Manufacturing-Green Technology.

[14]  Yaonan Wang,et al.  A Machine Vision Apparatus and Method for Can-End Inspection , 2016, IEEE Transactions on Instrumentation and Measurement.

[15]  Teng Gao,et al.  A new deep spatial transformer convolutional neural network for image saliency detection , 2018, Des. Autom. Embed. Syst..

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Danhua Cao,et al.  Defect detection on button surfaces with the weighted least-squares model , 2017 .

[19]  Xiuqin Rao,et al.  Computer vision detection of surface defect on oranges by means of a sliding comparison window local segmentation algorithm , 2017, Comput. Electron. Agric..

[20]  Hamido Fujita,et al.  Decision support system for arrhythmia prediction using convolutional neural network structure without preprocessing , 2019, Applied Intelligence.

[21]  Yong-Lin Kuo,et al.  A Simple and Efficient Median Filter for Removing High-Density Impulse Noise in Images , 2015, Int. J. Fuzzy Syst..

[22]  Andrew Lim,et al.  A fast implementation for the 2D/3D box placement problem , 2016, Comput. Optim. Appl..

[23]  Hongliang Li,et al.  Repairing Bad Co-Segmentation Using Its Quality Evaluation and Segment Propagation , 2014, IEEE Transactions on Image Processing.

[24]  Kevin M. Passino,et al.  Illumination Balancing Algorithm for Smart Lights , 2014, IEEE Transactions on Control Systems Technology.

[25]  WangXiaogang,et al.  Local binary features for texture classification , 2017 .

[26]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[27]  Zeshui Xu,et al.  An ordered clustering algorithm based on K-means and the PROMETHEE method , 2018, Int. J. Mach. Learn. Cybern..

[28]  Yan Wang,et al.  Dense crowd counting from still images with convolutional neural networks , 2016, J. Vis. Commun. Image Represent..

[29]  Wei Shen,et al.  Spatial-temporal convolutional neural networks for anomaly detection and localization in crowded scenes , 2016, Signal Process. Image Commun..

[30]  Zhong Liu,et al.  An approach to variable-order prediction via multiple distal dendrites of neurons , 2018, Neural Computing and Applications.

[31]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[32]  Jing Li,et al.  Saliency detection using adaptive background template , 2017, IET Comput. Vis..

[33]  Yan Li,et al.  A new method and device for motion accuracy measurement of NC machine tools. Part 2: device error identification and trajectory measurement of general planar motions , 2001 .

[34]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[35]  Navdeep Jaitly,et al.  Deep Learning for Automated Occlusion Edge Detection in RGB-D Frames , 2016, Journal of Signal Processing Systems.

[36]  Qiang Wu,et al.  Hard exudates segmentation based on learned initial seeds and iterative graph cut , 2018, Comput. Methods Programs Biomed..

[37]  Shilpa Suresh,et al.  Modified differential evolution algorithm for contrast and brightness enhancement of satellite images , 2017, Appl. Soft Comput..

[38]  Jianping Yin,et al.  Foreword to the special issue on recent advances on pattern recognition and artificial intelligence , 2018, Neural Computing and Applications.

[39]  Yonghong Song,et al.  Scene text localization using edge analysis and feature pool , 2016, Neurocomputing.

[40]  Longin Jan Latecki,et al.  Training convolutional neural network from multi-domain contour images for 3D shape retrieval , 2017, Pattern Recognit. Lett..

[41]  Du-ming Tsai,et al.  Machine Vision-Based Positioning and Inspection Using Expectation–Maximization Technique , 2017, IEEE Transactions on Instrumentation and Measurement.

[42]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[43]  Sudan Jha,et al.  Neutrosophic image segmentation with Dice Coefficients , 2019, Measurement.

[44]  Wen Gao,et al.  A Shape Reconstructability Measure of Object Part Importance with Applications to Object Detection and Localization , 2014, International Journal of Computer Vision.

[45]  Wei Zhou,et al.  High-precision estimation of target range, radial velocity, and azimuth in mechanical scanning LFMCW radar , 2017 .

[46]  Chenglin Wen,et al.  Deep learning fault diagnosis method based on global optimization GAN for unbalanced data , 2020, Knowl. Based Syst..

[47]  K. Y. Kim,et al.  An Automatic Detection of the ROI Using Otsu Thresholding in Nonlinear Difference EIT Imaging , 2018, IEEE Sensors Journal.

[48]  Peng-Fei Li,et al.  Fabric defect detection based on golden image subtraction , 2017 .

[49]  Xiaolin Gui,et al.  A Study on Deep Belief Net for Branch Prediction , 2018, IEEE Access.

[50]  Jianchao Fan,et al.  A Two-Phase Fuzzy Clustering Algorithm Based on Neurodynamic Optimization With Its Application for PolSAR Image Segmentation , 2018, IEEE Transactions on Fuzzy Systems.

[51]  Bülent Yener,et al.  Image driven machine learning methods for microstructure recognition , 2016 .

[52]  Bartosz Powałka,et al.  Machine vision micro-milling tool wear inspection by image reconstruction and light reflectance , 2016 .