A physical model for microstructural characterization and segmentation of 3D tomography data

We present a novel method for characterizing the microstructure of a material from volumetric datasets such as 3D image data from computed tomography (CT). The method is based on a new statistical model for the distribution of voxel intensities and gradient magnitudes, incorporating prior knowledge about the physical nature of the imaging process. It allows for direct quantification of parameters of the imaged sample like volume fractions, interface areas and material density, and parameters related to the imaging process like image resolution and noise levels. Existing methods for characterization from 3D images often require segmentation of the data, a procedure where each voxel is labeled according to the best guess of which material it represents. Through our approach, the segmentation step is circumvented so that errors and computational costs related to this part of the image processing pipeline are avoided. Instead, the material parameters are quantified through their known relation to parameters of our model which is fitted directly to the raw, unsegmented data. We present an automated model fitting procedure that gives reproducible results without human bias and enables automatic analysis of large sets of tomograms. For more complex structure analysis questions, a segmentation is still beneficial. We show that our model can be used as input to existing probabilistic methods, providing a segmentation that is based on the physics of the imaged sample. Because our model accounts for mixed-material voxels stemming from blurring inherent to the imaging technique, we reduce the errors that other methods can create at interfaces between materials.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  T. Mukunoki,et al.  Evaluation of Porosity and Its Variation in Porous Materials Using Microfocus X-ray Computed Tomography Considering the Partial Volume Effect , 2013 .

[3]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[4]  F. Alpak,et al.  Effect of image segmentation & voxel size on micro-CT computed effective transport & elastic properties , 2017 .

[5]  Michael Figurnov,et al.  Monte Carlo Gradient Estimation in Machine Learning , 2019, J. Mach. Learn. Res..

[6]  Thomas Lewiner,et al.  Efficient Implementation of Marching Cubes' Cases with Topological Guarantees , 2003, J. Graphics, GPU, & Game Tools.

[7]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[8]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[9]  Koenraad Van Leemput,et al.  A unifying framework for partial volume segmentation of brain MR images , 2003, IEEE Transactions on Medical Imaging.

[10]  P. S. Jørgensen,et al.  Three dimensional characterization of nickel coarsening in solid oxide cells via ex-situ ptychographic nano-tomography , 2018 .

[11]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[12]  E L Nickoloff,et al.  A simplified approach for modulation transfer function determinations in computed tomography. , 1985, Medical physics.

[13]  Josiane Zerubia,et al.  Bayesian image classification using Markov random fields , 1996, Image Vis. Comput..

[14]  Peter Moonen,et al.  More than pretty images – Towards confidence bounds on segmentation thresholds , 2019 .

[15]  A. Rollett,et al.  The Monte Carlo Method , 2004 .

[16]  M. Tuller,et al.  Segmentation of X‐ray computed tomography images of porous materials: A crucial step for characterization and quantitative analysis of pore structures , 2009 .

[17]  Simon K Warfield,et al.  Segmentations of MRI images of the female pelvic floor: A study of inter‐ and intra‐reader reliability , 2011, Journal of magnetic resonance imaging : JMRI.

[18]  David H. Laidlaw,et al.  Partial-volume Bayesian classification of material mixtures in MR volume data using voxel histograms , 1997, IEEE Transactions on Medical Imaging.

[19]  Ali Gholipour,et al.  Semi-Supervised Learning With Deep Embedded Clustering for Image Classification and Segmentation , 2019, IEEE Access.

[20]  Frans Vos,et al.  Classifying CT Image Data Into Material Fractions by a Scale and Rotation Invariant Edge Model , 2007, IEEE Transactions on Image Processing.

[21]  F. Boas,et al.  CT artifacts: Causes and reduction techniques , 2012 .

[22]  Bruce R. Whiting,et al.  Signal statistics in x-ray computed tomography , 2002, SPIE Medical Imaging.

[23]  Dominique Bernard,et al.  3D imaging in material science: Application of X-ray tomography , 2010 .

[24]  P. Withers,et al.  Quantitative X-ray tomography , 2014 .

[25]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[26]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[27]  Anil K. Jain,et al.  MRF model-based algorithms for image segmentation , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[28]  S M Bentzen,et al.  Evaluation of the spatial resolution of a CT scanner by direct analysis of the edge response function. , 1983, Medical physics.

[29]  M. Hassner,et al.  The use of Markov Random Fields as models of texture , 1980 .

[30]  P. S. Jørgensen,et al.  High accuracy interface characterization of three phase material systems in three dimensions , 2010 .

[31]  J. Fessler,et al.  Modelling the physics in the iterative reconstruction for transmission computed tomography , 2013, Physics in medicine and biology.

[32]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[33]  O. Bunk,et al.  X-ray ptychographic computed tomography at 16 nm isotropic 3D resolution , 2014, Scientific Reports.

[34]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[35]  Wesley E. Snyder,et al.  Quantification of brain tissue through incorporation of partial volume effects , 1992, Medical Imaging.

[36]  M. Graef,et al.  Application and further development of advanced image processing algorithms for automated analysis of serial section image data , 2009 .

[37]  Alan C. Evans,et al.  Fast and robust parameter estimation for statistical partial volume models in brain MRI , 2004, NeuroImage.

[38]  Nikolas P. Galatsanos,et al.  A spatially constrained mixture model for image segmentation , 2005, IEEE Transactions on Neural Networks.

[39]  P. Deb Finite Mixture Models , 2008 .

[40]  Lars Linsen,et al.  Uncertainty estimation and visualization in probabilistic segmentation , 2014, Comput. Graph..