Fully automated primary particle size analysis of agglomerates on transmission electron microscopy images via artificial neural networks

Abstract There is a high demand for fully automated methods for the analysis of primary particle size distributions of agglomerates on transmission electron microscopy images. Therefore, a novel method, based on the utilization of artificial neural networks, was proposed, implemented and validated. The training of the artificial neural networks requires large quantities (up to several hundreds of thousands) of transmission electron microscopy images of agglomerates consisting of primary particles with known sizes. Since the manual evaluation of such large amounts of transmission electron microscopy images is not feasible, a synthesis of lifelike transmission electron microscopy images as training data was implemented. The proposed method can compete with state-of-the-art automated imaging particle size methods like the Hough transformation, ultimate erosion and watershed transformation and is in some cases even able to outperform these methods. It is however still outperformed by the manual analysis.

[1]  Michael A Babyak,et al.  What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type Models , 2004, Psychosomatic medicine.

[2]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[3]  K. Barmak,et al.  A methodology for automated quantitative microstructural analysis of transmission electron micrographs , 1998 .

[4]  Roberto Irizarry,et al.  Data-driven model and model paradigm to predict 1D and 2D particle size distribution from measured chord-length distribution , 2017 .

[5]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[7]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[8]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[9]  Joonyoung Park,et al.  Nanoparticle characterization: state of the art, challenges, and emerging technologies. , 2013, Molecular pharmaceutics.

[10]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[11]  Young-Don Ko,et al.  A neural network-based soft sensor for particle size distribution using image analysis , 2011 .

[12]  M. Massinaei,et al.  Estimation of particle size distribution on an industrial conveyor belt using image analysis and neural networks , 2014 .

[13]  Jeroen Lammertyn,et al.  Semi-automatic size measurement of primary particles in aggregated nanomaterials by transmission electron microscopy , 2014 .

[14]  E. Hornbogen,et al.  Mikro- und Nanoskopie der Werkstoffe , 2009 .

[15]  R. P. King,et al.  Determination of the distribution of size of irregularly shaped particles from measurements on sections or projected areas , 1982 .

[16]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[17]  David J. Farber,et al.  A Parallel Mechanism for Detecting Curves in Pictures , 1975, IEEE Transactions on Computers.

[18]  J. Calvert,et al.  Glossary of atmospheric chemistry terms (Recommendations 1990) , 1990 .

[19]  G.S. Stegmayer,et al.  Particle Size Distribution from Combined Light Scattering Measurements. A Neural Network Approach for Solving the Inverse Problem , 2006, 2006 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Roberto Guardani,et al.  Use of neural networks in the analysis of particle size distributions by laser diffraction , 1997 .

[22]  Georgina Stegmayer,et al.  A Neural Network Model for Estimating the Particle Size Distribution of Dilute Latex from Multiangle Dynamic Light Scattering Measurements , 2009 .

[23]  Mohammad Ilyas,et al.  Segmenting overlapping cell nuclei in digital histopathology images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Zhenzhou Wang,et al.  A semi-automatic method for robust and efficient identification of neighboring muscle cells , 2016, Pattern Recognit..

[25]  Yu Ding,et al.  Segmentation, Inference and Classification of Partially Overlapping Nanoparticles , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[27]  F. L. Deepak,et al.  Nanomaterial properties: size and shape dependencies , 2012 .

[28]  C. Nascimento,et al.  Use of neural networks in the analysis of particle size distribution by laser diffraction: tests with different particle systems , 2002 .

[29]  Terence Allen,et al.  Powder Sampling and Particle Size Determination , 2003 .

[30]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[31]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[32]  Martin T. Hagan,et al.  Neural network design , 1995 .

[33]  Brian Scarlett,et al.  Characterization of Agglomerated and Aggregated Aerosol Particles Using Image Analysis , 1994 .

[34]  R. King.  Measurement of particle size distribution by image analyser , 1984 .

[35]  SchmidhuberJürgen.  Deep learning in neural networks , 2015 .

[36]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[37]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[38]  Jay Martin Tenenbaum,et al.  Accommodation in computer vision , 1971 .