Estimating size fraction categories of coal particles on conveyor belts using image texture modeling methods

Motivation: Physical properties of coal such as particle size distribution have a large influence on the stability and operational behavior of fluidized bed reactors and metallurgical furnaces. In particular, the presence of large amounts of ''fine'' particles invariably has a drastic effect on plant performance as a result of impaired gas permeability characteristics of the coal or ore burden. Therefore, monitoring and control of particle size distribution profiles of such aggregate material on reactor feed streams, such as moving conveyor belts, is critical for predictable operation of these processes. Traditionally, the method of sieve analysis using stock or belt cut samples has been widely used in industry. Unfortunately, the reliability and usefulness of belt cut techniques are constrained by frequency of sampling as well as laboratory analysis turnaround times. For real-time monitoring and control purposes, automated sampling and analysis methods are more desirable. Methods: In this study, the problem of estimating the particle size distribution profile of material on a moving conveyor belt is formulated within a texture classification framework, which has its basis in machine vision and incorporates elements from statistical pattern recognition. Using exemplar images of coal particles taken on a process stream, a set of local features that compactly describes the textural properties of each image are expressed in terms of localized nonlinear features called textons. Representation of image information using textons is primarily motivated by insights from neuroscience research on the optimality of linear oriented basis functions as models of perception in early processing of visual information in the cortex regions of the human brain. Using these representations for different textures, nearest neighbor and support vector machine classification models are subsequently used to classify test images. Results: Using a comprehensive evaluation, it is shown that the use of texton representation obtained from decomposing images with linear oriented basis functions can be sufficiently discriminative compared to the use of the widely used second-order statistical features or features from other baseline models. In particular, model performance obtained with appropriately tuned filters suggest the importance of including shape and spatial structure information in an image representation for texture classification of coal particles. Furthermore, using nonlinear support vector machines rather than nearest neighbor classifiers significantly improved classification performance. A texture classification approach to particle size profile estimation has potential applications in the online monitoring of the proportion of ''fines'' in coal material on moving conveyor belts.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  B Julesz,et al.  Inability of Humans to Discriminate between Visual Textures That Agree in Second-Order Statistics—Revisited , 1973, Perception.

[5]  Tony Lindeberg,et al.  Direct computation of shape cues using scale-adapted spatial derivative operators , 1996, International Journal of Computer Vision.

[6]  Christoph H. Lampert Kernel Methods in Computer Vision , 2009, Found. Trends Comput. Graph. Vis..

[7]  Tom C. Palangio,et al.  WipFrag image based granulometry system , 2018, Measurement of Blast Fragmentation.

[8]  Fernand Meyer,et al.  An Overview of Morphological Segmentation , 2001, Int. J. Pattern Recognit. Artif. Intell..

[9]  B. Julesz Early vision and focal attention , 1991 .

[10]  David LaRosa,et al.  VisioRock, an integrated vision technology for advanced control of comminution circuits , 2004 .

[11]  B Julesz,et al.  Experiments in the visual perception of texture. , 1975, Scientific American.

[12]  M. Varma Statistical Approaches to Texture Classification , 2004 .

[13]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[14]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[16]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[17]  Gunnar Rätsch,et al.  The SHOGUN Machine Learning Toolbox , 2010, J. Mach. Learn. Res..

[18]  Song-Chun Zhu,et al.  Minimax Entropy Principle and Its Application to Texture Modeling , 1997, Neural Computation.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[21]  Tony Lindeberg,et al.  Principles for Automatic Scale Selection , 1999 .

[22]  Dennis Gabor,et al.  Theory of communication , 1946 .

[23]  Manik Varma,et al.  Learning The Discriminative Power-Invariance Trade-Off , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[24]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[25]  Kristin J. Dana,et al.  3D Texture Recognition Using Bidirectional Feature Histograms , 2004, International Journal of Computer Vision.

[26]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[27]  Cordelia Schmid,et al.  Constructing models for content-based image retrieval , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[29]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[30]  K. Nakayama Chapter 10 – Vision Fin de Siècle: A Reductionistic Explanation of Perception for the 21st Century? , 1998 .

[31]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[32]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[33]  Mario Fritz,et al.  On the Significance of Real-World Conditions for Material Classification , 2004, ECCV.

[34]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[35]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[36]  Chris Aldrich,et al.  The classification of froth structures in a copper flotation plant by means of a neural net , 1995 .

[37]  Jani Kaartinen,et al.  Machine-vision-based control of zinc flotation—A case study , 2006 .

[38]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[39]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[40]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[41]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[42]  Nicolas Pinto,et al.  Why is Real-World Visual Object Recognition Hard? , 2008, PLoS Comput. Biol..

[43]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[44]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[45]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[46]  R. Fletcher Practical Methods of Optimization , 1988 .

[47]  Nick J. Miles,et al.  Improving particle size measurement using multi-flash imaging , 2009 .

[48]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[49]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[51]  Nicolas Pinto,et al.  How far can you get with a modern face recognition test set using only simple features? , 2009, CVPR.

[52]  Edward Dougherty,et al.  Morphological Segmentation for Textures and Particles , 2020 .

[53]  Bernhard Schölkopf,et al.  The connection between regularization operators and support vector kernels , 1998, Neural Networks.

[54]  O. Carlsson,et al.  A method for estimation of fragment size distribution with automatic image processing , 1983 .

[55]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.