A reusable pipeline for large-scale fiber segmentation on unidirectional fiber beds using fully convolutional neural networks

Fiber-reinforced ceramic-matrix composites are advanced materials resistant to high temperatures, with application to aerospace engineering. Their analysis depends on the detection of embedded fibers, with semi-supervised techniques usually employed to separate fibers within the fiber beds. Here we present an open computational pipeline to detect fibers in ex-situ X-ray computed tomography fiber beds. To separate the fibers in these samples, we tested four different architectures of fully convolutional neural networks. When comparing our neural network approach to a semi-supervised one, we obtained Dice and Matthews coefficients greater than 92.28 ± 9.65%, reaching up to 98.42 ± 0.03%, showing that the network results are close to the human-supervised ones in these fiber beds, in some cases separating fibers that human-curated algorithms could not find. The software we generated in this project is open source, released under a permissive ∗alex.desiqueira@igdore.org †dushizima@lbl.gov ‡stefanv@berkeley.edu 1 ar X iv :2 10 1. 04 82 3v 2 [ ee ss .I V ] 1 5 Ja n 20 21 license, and can be freely adapted and re-used in other domains. All data and instructions on how to download and use it are also available.

[1]  William W. Whitacre,et al.  Numerical reconstruction of graphite/epoxy composite microstructure based on sub-micron resolution X-ray computed tomography , 2014 .

[2]  R.E. Woods,et al.  Real-time digital image enhancement , 1981, Proceedings of the IEEE.

[3]  M. Czabaj,et al.  A fiber-segmentation algorithm for composites imaged using X-ray microtomography: Development and validation , 2019, Composites Part A: Applied Science and Manufacturing.

[4]  Russell C. Hardie,et al.  Anomaly detection of microstructural defects in continuous fiber reinforced composites , 2015, Electronic Imaging.

[5]  Keerthi Ram,et al.  Semantic segmentation of microscopic neuroanatomical data by combining topological priors with encoder–decoder deep networks , 2020, Nature Machine Intelligence.

[6]  Hanif M. Ladak,et al.  Fully automated segmentation of the temporal bone from micro-CT using deep learning , 2020, Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging.

[7]  Knut Conradsen,et al.  Statistical validation of individual fibre segmentation from tomograms and microscopy , 2018 .

[8]  Tetsuya J. Kobayashi,et al.  3D convolutional neural networks-based segmentation to acquire quantitative criteria of the nucleus during mouse embryogenesis , 2020, npj Systems Biology and Applications.

[9]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[10]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[11]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[12]  Frank W. Zok,et al.  X-ray computed tomography of microstructure evolution during matrix impregnation and curing in unidirectional fiber beds , 2019, Composites Part A: Applied Science and Manufacturing.

[13]  Frank W. Zok,et al.  Ceramic-matrix composites enable revolutionary gains in turbine engine efficiency , 2016 .

[14]  M. Ferraris,et al.  Recent progress in the development of SiC composites for nuclear fusion applications , 2018, Journal of Nuclear Materials.

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Yoshua Bengio,et al.  Equilibrated adaptive learning rates for non-convex optimization , 2015, NIPS.

[18]  Alexandre Fioravante de Siqueira,et al.  Segmentation of nearly isotropic overlapped tracks in photomicrographs using successive erosions as watershed markers , 2017, Microscopy research and technique.

[19]  Dilworth Y. Parkinson,et al.  Evaluating Fiber Detection Models Using Neural Networks , 2019, ISVC.

[20]  Josef Kittler,et al.  A Comparative Study of Hough Transform Methods for Circle Finding , 1989, Alvey Vision Conference.

[21]  Pau-Choo Chung,et al.  A Fast Algorithm for Multilevel Thresholding , 2001, J. Inf. Sci. Eng..

[22]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[23]  Simo Saarakkala,et al.  Deep-Learning for Tidemark Segmentation in Human Osteochondral Tissues Imaged with Micro-computed Tomography , 2019, ACIVS.

[24]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[25]  Frank W. Zok,et al.  In-situ 3D visualization of composite microstructure during polymer-to-ceramic conversion , 2018 .

[26]  Nitin P. Padture,et al.  Advanced structural ceramics in aerospace propulsion. , 2016, Nature materials.

[27]  James P. Horwath,et al.  Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images , 2020, npj Computational Materials.

[28]  Darren J. Kerbyson,et al.  Size invariant circle detection , 1999, Image Vis. Comput..

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Makoto Yamada,et al.  Deep-learning-based quality filtering of mechanically exfoliated 2D crystals , 2019, npj Computational Materials.

[32]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[33]  Daniela Ushizima,et al.  Deep learning for Alzheimer's disease: Mapping large-scale histological tau protein for neuroimaging biomarker validation , 2021, NeuroImage.

[34]  Chao Yang,et al.  IDEAL: Images Across Domains, Experiments, Algorithms and Learning , 2016 .

[35]  Frank W. Zok,et al.  Ex-situ XCT dataset for "X-ray computed tomography of microstructure evolution during matrix impregnation and curing in unidirectional fiber beds" , 2019 .

[36]  Wei Li,et al.  Automated defect analysis in electron microscopic images , 2018, npj Computational Materials.

[37]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[38]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[39]  et al.,et al.  Jupyter Notebooks - a publishing format for reproducible computational workflows , 2016, ELPUB.

[40]  Hao Wang,et al.  Data augmentation in microscopic images for material data mining , 2020, npj Computational Materials.

[41]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[42]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[43]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[44]  Youjie Zhou,et al.  Large-Scale Fiber Tracking Through Sparsely Sampled Image Sequences of Composite Materials , 2016, IEEE Transactions on Image Processing.

[45]  Constantinos Soutis,et al.  Generation of Micro-scale Finite Element Models from Synchrotron X-ray CT Images for Multidirectional Carbon Fibre Reinforced Composites , 2016 .

[46]  Lars Pilgaard Mikkelsen,et al.  Individual fibre segmentation from 3D X-ray computed tomography for characterising the fibre orientation in unidirectional composite materials , 2017 .

[47]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[49]  I. Foster,et al.  The Materials Data Facility: Data Services to Advance Materials Science Research , 2016, JOM.

[50]  Song Wang,et al.  Unsupervised Learning for Large-Scale Fiber Detection and Tracking in Microscopic Material Images , 2018, ArXiv.

[51]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.