Online Monitoring of Flotation Froth Bubble-Size Distributions via Multiscale Deblurring and Multistage Jumping Feature-Fused Full Convolutional Networks

This article proposes an online bubble size distribution (BSD) monitoring scheme by incorporating a multiscale-deblurring full convolutional network (FulConNet) (MsD) and a multistage jumping feature-fused FulConNet (MsJ), having the potential of online identification of the health state of the flotation process operations. MsD can restore the blurry froth images from any complex foggy and motion-blurred scene due to air–water fogs, camera vibrations, and high-speed froth flows. MsJ is proposed to segment accurately various froth images with the fully occupied and closely adhesive fragile bubbles, involving multiple residual groups and multiple jumping feature layers to delineate the bubbles of various sizes adaptively. The Weibull distribution behavior of the left-skewed BSD is demonstrated by the sequential fragmentation theory, whose parameters can be used to identify the flotation state. Extensive comparative experiments on a real copper-mine flotation process demonstrate that the proposed method performs favorably against the state-of-the-art froth-image-segmentation approaches, and the Weibull distribution model can effectively characterize the underlying left-skewed BSD behavior, which is an effective indicator for the online flotation-state identification or health evaluation.

[1]  Jinping Liu,et al.  Adaptive intrusion detection via GA-GOGMM-based pattern learning with fuzzy rough set-based attribute selection , 2020, Expert Syst. Appl..

[2]  Risheng Liu,et al.  Blind image deblurring via hybrid deep priors modeling , 2020, Neurocomputing.

[3]  Chris Aldrich,et al.  Online monitoring and control of froth flotation systems with machine vision: A review , 2010 .

[4]  Jinping Liu,et al.  STA-APSNFIS: STA-Optimized Adaptive Pre-Sparse Neuro-Fuzzy Inference System for Online Soft Sensor Modeling , 2020, IEEE Access.

[5]  Weihua Gui,et al.  Combined fuzzy based feedforward and bubble size distribution based feedback control for reagent dosage in copper roughing process , 2016 .

[6]  Mohammad Hamiruce Marhaban,et al.  An image segmentation algorithm for measurement of flotation froth bubble size distributions , 2017 .

[7]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Fernand Meyer,et al.  Levelings, Image Simplification Filters for Segmentation , 2004, Journal of Mathematical Imaging and Vision.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Bernhard Schölkopf,et al.  Fast removal of non-uniform camera shake , 2011, 2011 International Conference on Computer Vision.

[11]  Aggelos K. Katsaggelos,et al.  Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods , 2018, IEEE Signal Processing Magazine.

[12]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Michael S. Brown,et al.  Nonlinear Camera Response Functions and Image Deblurring: Theoretical Analysis and Practice , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Weihua Gui,et al.  Recognition of the operational statuses of reagent addition using dynamic bubble size distribution in copper flotation process , 2013 .

[17]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[18]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[19]  Jinping Liu,et al.  Toward security monitoring of industrial Cyber-Physical systems via hierarchically distributed intrusion detection , 2020, Expert Syst. Appl..

[20]  Zhenfeng Zhu,et al.  Edge Heuristic GAN for Non-Uniform Blind Deblurring , 2019, IEEE Signal Processing Letters.

[21]  Hazim Kemal Ekenel,et al.  Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  W. K. Brown A theory of sequential fragmentation and its astronomical applications , 1989 .

[23]  Jinping Liu,et al.  Illumination-Invariant Flotation Froth Color Measuring via Wasserstein Distance-Based CycleGAN With Structure-Preserving Constraint , 2020, IEEE Transactions on Cybernetics.

[24]  Licheng Yu,et al.  Vector Sparse Representation of Color Image Using Quaternion Matrix Analysis , 2015, IEEE Transactions on Image Processing.

[25]  Bernhard Schölkopf,et al.  Discriminative Transfer Learning for General Image Restoration , 2017, IEEE Transactions on Image Processing.

[26]  Lina J. Karam,et al.  DeepCorrect: Correcting DNN Models Against Image Distortions , 2017, IEEE Transactions on Image Processing.

[27]  Jan J. Cilliers,et al.  A review of froth flotation control , 2011 .

[28]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[29]  Guangming Shi,et al.  Denoising Prior Driven Deep Neural Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Tae Hyun Kim,et al.  Segmentation-Free Dynamic Scene Deblurring , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Tao Xu,et al.  SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation , 2017, Neuroinformatics.

[32]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[33]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[34]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  A. Enis Çetin,et al.  Phase and TV Based Convex Sets for Blind Deconvolution of Microscopic Images , 2015, IEEE Journal of Selected Topics in Signal Processing.

[36]  Jean Ponce,et al.  Learning a convolutional neural network for non-uniform motion blur removal , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  W. Wang,et al.  Froth delineation based on image classification , 2003 .

[38]  M. Massinaei,et al.  New image-processing algorithm for measurement of bubble size distribution from flotation froth images , 2011 .

[39]  Marcin Ciecholewski,et al.  River channel segmentation in polarimetric SAR images: Watershed transform combined with average contrast maximisation , 2017, Expert Syst. Appl..

[40]  Jarmo Ilonen,et al.  Estimation of Bubble Size Distribution Based on Power Spectrum , 2014, CIARP.

[41]  桂卫华,et al.  Application of statistical modeling of image spatial structures to automated visual inspection of product quality , 2016 .

[42]  Vishal Monga,et al.  Blind Image Deblurring Using Row–Column Sparse Representations , 2017, IEEE Signal Processing Letters.

[43]  Yi Wang,et al.  Scale-Recurrent Network for Deep Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  W. K. Brown,et al.  Derivation of the Weibull distribution based on physical principles and its connection to the Rosin–Rammler and lognormal distributions , 1995 .

[45]  Takeshi Ogawa,et al.  Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling , 2020, IEEE Transactions on Medical Imaging.

[46]  Jinping Liu,et al.  Toward Flotation Process Operation-State Identification via Statistical Modeling of Biologically Inspired Gabor Filtering Responses , 2020, IEEE Transactions on Cybernetics.

[47]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.