Visual Perception-Based Statistical Modeling of Complex Grain Image for Product Quality Monitoring and Supervision on Assembly Production Line

Computer vision as a fast, low-cost, noncontact, and online monitoring technology has been an important tool to inspect product quality, particularly on a large-scale assembly production line. However, the current industrial vision system is far from satisfactory in the intelligent perception of complex grain images, comprising a large number of local homogeneous fragmentations or patches without distinct foreground and background. We attempt to solve this problem based on the statistical modeling of spatial structures of grain images. We present a physical explanation in advance to indicate that the spatial structures of the complex grain images are subject to a representative Weibull distribution according to the theory of sequential fragmentation, which is well known in the continued comminution of ore grinding. To delineate the spatial structure of the grain image, we present a method of multiscale and omnidirectional Gaussian derivative filtering. Then, a product quality classifier based on sparse multikernel–least squares support vector machine is proposed to solve the low-confidence classification problem of imbalanced data distribution. The proposed method is applied on the assembly line of a food-processing enterprise to classify (or identify) automatically the production quality of rice. The experiments on the real application case, compared with the commonly used methods, illustrate the validity of our method.

[1]  Guang-ming Xian,et al.  An identification method of malignant and benign liver tumors from ultrasonography based on GLCM texture features and fuzzy SVM , 2010, Expert Syst. Appl..

[2]  Dale Purves,et al.  A statistical explanation of visual space , 2003, Nature Neuroscience.

[3]  Ferhat Kurtulmuş,et al.  Discriminating rapeseed varieties using computer vision and machine learning , 2015, Expert Syst. Appl..

[4]  Sadayuki Tsugawa,et al.  Vision-based vehicles in Japan: machine vision systems and driving control systems , 1994, IEEE Trans. Ind. Electron..

[5]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[6]  Yoichi Ando,et al.  Textural properties corresponding to visual perception based on the correlation mechanism in the visual system , 2003, Psychological research.

[7]  Huaqing Wang,et al.  Intelligent Gearbox Diagnosis Methods Based on SVM, Wavelet Lifting and RBR , 2010, Sensors.

[8]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[9]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[10]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Radovan Kovacevic,et al.  A Laser-Based Vision System for Weld Quality Inspection , 2011, Sensors.

[13]  Stephen Hugo Arce,et al.  Fast and accurate automated cell boundary determination for fluorescence microscopy , 2013, Scientific reports.

[14]  Xiang-Yan Zeng,et al.  SMO-based pruning methods for sparse least squares support vector machines , 2005, IEEE Transactions on Neural Networks.

[15]  Yu Zhang,et al.  Fabric defect classification using radial basis function network , 2010, Pattern Recognit. Lett..

[16]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[17]  A. Asadpour,et al.  Design and application of industrial machine vision systems , 2007 .

[18]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[19]  D. Jayas,et al.  Classification of cereal grains using wavelet, morphological, colour, and textural features of non-touching kernel images , 2008 .

[20]  Weihua Gui,et al.  Nonparametric density estimation of froth colour texture distribution for monitoring sulphur flotation process , 2013 .

[21]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[22]  P. Dario,et al.  Magnetically Activated Stereoscopic Vision System for Laparoendoscopic Single-Site Surgery , 2013, IEEE/ASME Transactions on Mechatronics.

[23]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[24]  Arnold W. M. Smeulders,et al.  c ○ 2005 Springer Science + Business Media, Inc. Manufactured in The Netherlands. A Six-Stimulus Theory for Stochastic Texture , 2002 .

[25]  Michal Strzelecki,et al.  Texture Analysis Methods - A Review , 1998 .

[26]  Stanley M. Dunn,et al.  Texture classification using noncasual hidden Markov models , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  M. A. Pagani,et al.  Classification of bread wheat flours in different quality categories by a wavelet-based feature selection/classification algorithm on NIR spectra , 2005 .

[28]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[29]  Digvir S. Jayas,et al.  CLASSIFICATION OF CEREAL GRAINS USING MACHINE VISION: III. TEXTURE MODELS , 2000 .

[30]  Ruben Usamentiaga,et al.  Optimizing Steel Coil Production: An Enhanced Inspection System Based on Anomaly Detection Techniques , 2014, IEEE Industry Applications Magazine.

[31]  Ashfaqur Rahman,et al.  Feature Weighting and Retrieval Methods for Dynamic Texture Motion Features , 2009, Int. J. Comput. Intell. Syst..

[32]  Ashraf A. Kassim,et al.  Texture analysis methods for tool condition monitoring , 2007, Image Vis. Comput..

[33]  Teuvo Kohonen,et al.  Improved versions of learning vector quantization , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[34]  Da-Wen Sun,et al.  Inspection and grading of agricultural and food products by computer vision systems—a review , 2002 .

[35]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[36]  W. K. Brown A theory of sequential fragmentation and its astronomical applications , 1989 .

[37]  Da-Wen Sun,et al.  Recent advances in image processing using image texture features for food quality assessment , 2013 .

[38]  W. K. Brown,et al.  Derivation of the Weibull distribution based on physical principles and its connection to the Rosin–Rammler and lognormal distributions , 1995 .

[39]  B. K. Yadav,et al.  Monitoring milling quality of rice by image analysis , 2001 .

[40]  P. R. China Machine Vision Based Production Condition Classification and Recognition for Mineral Flotation Process Monitoring , 2013 .

[41]  Markus Wilde,et al.  Effects of Multivantage Point Systems on the Teleoperation of Spacecraft Docking , 2014, IEEE Transactions on Human-Machine Systems.

[42]  Yu Xie,et al.  A physics-based defects model and inspection algorithm for automatic visual inspection , 2014 .

[43]  Jody Muelaner,et al.  A new paradigm in large-scale assembly—research priorities in measurement assisted assembly , 2014 .

[44]  Weihua Gui,et al.  Recognition of the operational statuses of reagent addition using dynamic bubble size distribution in copper flotation process , 2013 .

[45]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[46]  Zoubin Ghahramani,et al.  Probabilistic machine learning and artificial intelligence , 2015, Nature.

[47]  Ashfaqur Rahman,et al.  Feature Weighting and Retrieval Methods for Dynamic Texture Motion Features , 2009 .