An Application of Deep Neural Networks for Segmentation of Microtomographic Images of Rock Samples

Image segmentation is a crucial step of almost any Digital Rock workflow. In this paper, we propose an approach for generation of a labelled dataset and investigate an application of three popular convolutional neural networks (CNN) architectures for segmentation of 3D microtomographic images of samples of various rocks. Our dataset contains eight pairs of images of five specimens of sand and sandstones. For each sample, we obtain a single set of microtomographic shadow projections, but run reconstruction twice: one regular high-quality reconstruction, and one using just a quarter of all available shadow projections. Thoughtful manual Indicator Kriging (IK) segmentation of the full-quality image is used as the ground truth for segmentation of images with reduced quality. We assess the generalization capability of CNN by splitting our dataset into training and validation sets by five different manners. In addition, we compare neural networks results with segmentation by IK and thresholding. Segmentation outcomes by 2D and 3D U-nets are comparable to IK, but the deep neural networks operate in automatic mode, and there is big room for improvements in solutions based on CNN. The main difficulties are associated with the segmentation of fine structures that are relatively uncommon in our dataset.

[1]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[2]  Oleg Yurievich Dinariev,et al.  Coupling Multiphase Hydrodynamic and NMR Pore-Scale Modeling for Advanced Characterization of Saturated Rocks , 2015 .

[3]  Evgeny Burnaev,et al.  Driving Digital Rock towards Machine Learning: predicting permeability with Gradient Boosting and Deep Neural Networks , 2018, Comput. Geosci..

[4]  I. A. Varfolomeev,et al.  3D MICRO-CT IMAGE SEGMENTATION OF ROCK SAMPLES, TRAINED USING 2D MINERAL MAPS , 2019, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[5]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[6]  M. Crawford,et al.  Fundamentals of Geostatistics in Five Lessons , 2005 .

[7]  Tapan Mukerji,et al.  Digital rock physics benchmarks - part II: Computing effective properties , 2013, Comput. Geosci..

[8]  Ivan Yakimchuk,et al.  Blind Quality Assessment for Slice of Microtomographic Image , 2019, 2019 24th Conference of Open Innovations Association (FRUCT).

[9]  Peyman Mostaghimi,et al.  Deep Learning Convolutional Neural Networks to Predict Porous Media Properties , 2018, Day 1 Tue, October 23, 2018.

[10]  Guosheng Lin,et al.  Efficient Piecewise Training of Deep Structured Models for Semantic Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Steffen Berg,et al.  Generation of ground truth images to validate micro-CT image-processing pipelines , 2018, The Leading Edge.

[13]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[14]  Murtaza Ziauddin,et al.  Digital Rock Technology for Quantitative Prediction of Acid Stimulation Efficiency in Carbonates , 2015 .

[15]  Veerle Cnudde,et al.  Imaging and image-based fluid transport modeling at the pore scale in geological materials : a practical introduction to the current state-of-the-art , 2016 .

[16]  Ilia V. Safonov,et al.  Adaptive Image Processing Algorithms for Printing , 2018 .

[17]  Wolfram Rühaak,et al.  Processing of rock core microtomography images: Using seven different machine learning algorithms , 2016, Comput. Geosci..

[18]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[19]  I. I. Rushakov,et al.  Computed Tomography , 2019, Compendium of Biomedical Instrumentation.

[20]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[21]  L. Feldkamp,et al.  Practical cone-beam algorithm , 1984 .

[22]  Matthew Andrew,et al.  A quantified study of segmentation techniques on synthetic geological XRM and FIB-SEM images , 2018, Computational Geosciences.

[23]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  José García Rodríguez,et al.  A survey on deep learning techniques for image and video semantic segmentation , 2018, Appl. Soft Comput..

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Wolfram Rühaak,et al.  Phase segmentation of X-ray computer tomography rock images usingmachine learning techniques: an accuracy and performancestudy , 2016 .

[28]  Arash Rabbani,et al.  An automated simple algorithm for realistic pore network extraction from micro-tomography images , 2014 .

[29]  Ivan Yakimchuk,et al.  Algorithms for 3D Particles Characterization Using X-Ray Microtomography in Proppant Crush Test , 2018, J. Imaging.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Glenn R. Myers,et al.  PI-Line Difference for Alignment and Motion-Correction of Cone-Beam Helical-Trajectory Micro-Tomography Data , 2020, IEEE Transactions on Computational Imaging.

[32]  Sidi Ahmed Mahmoudi,et al.  MRI Breast Tumor Segmentation Using Different Encoder and Decoder CNN Architectures , 2019, Comput..

[33]  C. Berg,et al.  Industrial applications of digital rock technology , 2017, 2005.02815.

[34]  Oleg Yurievich Dinariev,et al.  Direct Hydrodynamic Simulation of Multiphase Flow in Porous Rock , 2014 .

[35]  W. Brent Lindquist,et al.  Image Thresholding by Indicator Kriging , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Adrian Sheppard,et al.  Mapping permeability in low‐resolution micro‐CT images: A multiscale statistical approach , 2016 .

[39]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[40]  Mark L. Rivers,et al.  Comparison of image segmentation methods in simulated 2D and 3D microtomographic images of soil aggregates , 2011 .

[41]  Liansheng Wang,et al.  RP-Net: A 3D Convolutional Neural Network for Brain Segmentation From Magnetic Resonance Imaging , 2019, IEEE Access.

[42]  T. Weitkamp,et al.  ANKAphase: software for single-distance phase retrieval from inline X-ray phase-contrast radiographs. , 2011, Journal of synchrotron radiation.

[43]  M. Tuller,et al.  Segmentation of X‐ray computed tomography images of porous materials: A crucial step for characterization and quantitative analysis of pore structures , 2009 .

[44]  Tapan Mukerji,et al.  Digital rock physics benchmarks - Part I: Imaging and segmentation , 2013, Comput. Geosci..

[45]  Oleg Yurievich Dinariev,et al.  Application of Digital Rock Technology for Chemical EOR Screening , 2013 .

[46]  Marc Pollefeys,et al.  An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation , 2017, STACOM@MICCAI.

[47]  Bin Yang,et al.  Semantic Organ Segmentation in 3D Whole-Body MR Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[48]  David A. Patterson,et al.  Motivation for and Evaluation of the First Tensor Processing Unit , 2018, IEEE Micro.

[49]  M. Blunt,et al.  Pore-scale imaging and modelling , 2013 .

[50]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[51]  Katsuhiko Kaneko,et al.  Segmentation of multi-phase X-ray computed tomography images , 2015 .

[52]  Pejman Tahmasebi,et al.  Segmentation of digital rock images using deep convolutional autoencoder networks , 2019, Comput. Geosci..

[53]  Lin Yang,et al.  Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation , 2016, NIPS.

[54]  Ivan Yakimchuk,et al.  Segmentation of 3D image of a rock sample supervised by 2D mineralogical image , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[55]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[57]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[58]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Won-Ki Jeong,et al.  FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics , 2016, Frontiers in Computer Science.

[60]  Jiapan Guo,et al.  3D segmentation of mandible from multisectional CT scans by convolutional neural networks , 2018, ArXiv.