BLAST-NET: Semantic Segmentation of Human Blastocyst Components via Cascaded Atrous Pyramid and Dense Progressive Upsampling

Components of a human blastocyst (day-5 embryo) and their morphological attributes highly correlate with the embryo’s potentials for a viable pregnancy. Automatic semantic segmentation of human blastocyst components is a crucial step toward achieving objective quality assessment of such blastocyst. In this paper, a semantic segmentation system is proposed for human blastocyst components in microscopic images. The proposed Blast-Net features two novel components: a Cascaded Atrous Pyramid Pooling (CAPP) module to incorporate multi-scale global contextual priors, and a Dense Progressive Sub-pixel Upsampling (DPSU) module to recover the high-resolution prediction map. Experimental results confirm that the proposed method achieves the best-reported segmentation performance to date with a mean Jaccard Index of 82.85 % for microscopic images of the human blastocyst.

[1]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[2]  P. McGovern,et al.  Blastocyst expansion score and trophectoderm morphology strongly predict successful clinical pregnancy and live birth following elective single embryo blastocyst transfer (eSET): a national study , 2013, Journal of Assisted Reproduction and Genetics.

[3]  Reza Moradi Rad,et al.  Blastomere Cell Counting and Centroid Localization in Microscopic Images of Human Embryo , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[4]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[5]  Seth R. Flaxman,et al.  National, Regional, and Global Trends in Infertility Prevalence Since 1990: A Systematic Analysis of 277 Health Surveys , 2012, PLoS medicine.

[6]  J A Noble,et al.  A method for semi-automatic grading of human blastocyst microscope images. , 2012, Human reproduction.

[7]  Christian Ledig,et al.  Checkerboard artifact free sub-pixel convolution: A note on sub-pixel convolution, resize convolution and convolution resize , 2017, ArXiv.

[8]  Parvaneh Saeedi,et al.  Human blastocyst segmentation using neural network , 2016, 2016 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[9]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[10]  Reza Moradi Rad,et al.  Coarse-to-fine texture analysis for inner cell mass identification in human blastocyst microscopic images , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[11]  T. Shakespeare,et al.  Editorial , 2011, Disability and rehabilitation.

[12]  Zhi-peng Xu,et al.  Effects of abnormal zona pellucida on fertilization and pregnancy in IVF/ICSI-ET , 2015 .

[13]  Parvaneh Saeedi,et al.  Automatic Segmentation of Trophectoderm in Microscopic Images of Human Blastocysts , 2015, IEEE Transactions on Biomedical Engineering.

[14]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[15]  T. D’Hooghe,et al.  Intra- and interobserver analysis in the morphological assessment of early stage embryos during an IVF procedure: a multicentre study , 2011, Reproductive biology and endocrinology : RB&E.

[16]  Parvaneh Saeedi,et al.  Automatic Identification of Human Blastocyst Components via Texture , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[18]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Bernhard Schölkopf,et al.  EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Reza Moradi Rad,et al.  Human Blastocyst's Zona Pellucida Segmentation via Boosting Ensemble of Complementary Learning , 2018 .

[21]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Parvaneh Saeedi,et al.  Inner cell mass segmentation in human HMC embryo images using fully convolutional network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[25]  Reza Moradi Rad,et al.  Multi-Resolutional Ensemble of Stacked Dilated U-Net for Inner Cell Mass Segmentation in Human Embryonic Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[26]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Win Tun Latt,et al.  Automatic segmentation of zona pellucida and its application in cleavage-stage embryo biopsy position selection , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  E. Santos Filho,et al.  A Review on Automatic Analysis of Human Embryo Microscope Images , 2010, The open biomedical engineering journal.

[31]  Yang Yu,et al.  Overall Blastocyst Quality, Trophectoderm Grade, and Inner Cell Mass Grade Predict Pregnancy Outcome in Euploid Blastocyst Transfer Cycles , 2018, Chinese medical journal.

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  江藤 文夫.  World Report on Disability 2011を読む(第2回)世界の障害者人口と統計手法をめぐって , 2013 .

[34]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).