Image-Based Size Analysis of Agglomerated and Partially Sintered Particles via Convolutional Neural Networks

Abstract There is a high demand for fully automated methods for the analysis of primary particle size distributions of agglomerated, sintered or occluded primary particles, due to their impact on material properties. Therefore, a novel, deep learning-based, method for the detection of such primary particles was proposed and tested, which renders a manual tuning of analysis parameters unnecessary. As a specialty, the training of the utilized convolutional neural networks was carried out using only synthetic images, thereby avoiding the laborious task of manual annotation and increasing the ground truth quality. Nevertheless, the proposed method performs excellent on real world samples of sintered silica nanoparticles with various sintering degrees and varying image conditions. In a direct comparison, the proposed method clearly outperforms two state-of-the-art methods for automated image-based particle size analysis (Hough transformation and the ImageJ ParticleSizer plug-in), thereby attaining human-like performance.

[1]  L. Goddard.  Information Theory , 1962, Nature.

[2]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[3]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[4]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[5]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[6]  Brian Scarlett,et al.  Characterization of Agglomerated and Aggregated Aerosol Particles Using Image Analysis , 1994 .

[7]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[8]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Zhenzhou Wang,et al.  A semi-automatic method for robust and efficient identification of neighboring muscle cells , 2016, Pattern Recognit..

[11]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  M. Massinaei,et al.  Estimation of particle size distribution on an industrial conveyor belt using image analysis and neural networks , 2014 .

[14]  Young-Don Ko,et al.  A neural network-based soft sensor for particle size distribution using image analysis , 2011 .

[15]  J. Rubio,et al.  New basis for measuring the size distribution of bubbles , 2003 .

[16]  Joakim Andén,et al.  APPLE Picker: Automatic Particle Picking, a Low-Effort Cryo-EM Framework , 2018, Journal of structural biology.

[17]  Bostjan Likar,et al.  In-line recognition of agglomerated pharmaceutical pellets with density-based clustering and convolutional neural network , 2017, IPSJ Transactions on Computer Vision and Applications.

[18]  S. Khodakarim,et al.  Improved Method for Analysis of Airborne Asbestos Fibers Using Phase Contrast Microscopy and FTIR Spectrometry , 2014, Tanaffos.

[19]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[20]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[21]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[22]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[23]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[24]  David J. Farber,et al.  A Parallel Mechanism for Detecting Curves in Pictures , 1975, IEEE Transactions on Computers.

[25]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[26]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[27]  Mohammad Ilyas,et al.  Segmenting overlapping cell nuclei in digital histopathology images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Honglak Lee,et al.  Unsupervised learning of hierarchical representations with convolutional deep belief networks , 2011, Commun. ACM.

[29]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[30]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[31]  Thomas G. Dietterich.  Adaptive computation and machine learning , 1998 .

[32]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[33]  Yu Ding,et al.  Segmentation, Inference and Classification of Partially Overlapping Nanoparticles , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  M. Pitz,et al.  Multiparameter Characterization of Aerosols , 2018, Chemie Ingenieur Technik.

[35]  L. F. Oliveira,et al.  Atmospheric particle number concentration and size distribution in a traffic–impacted area , 2015 .

[36]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[37]  Frank Einar Kruis,et al.  Fully automated primary particle size analysis of agglomerates on transmission electron microscopy images via artificial neural networks , 2018, Powder Technology.