Automated Measurements of Key Morphological Features of Human Embryos for IVF

A major challenge in clinical In-Vitro Fertilization (IVF) is selecting the highest quality embryo to transfer to the patient in the hopes of achieving a pregnancy. Time-lapse microscopy provides clinicians with a wealth of information for selecting embryos. However, the resulting movies of embryos are currently analyzed manually, which is time consuming and subjective. Here, we automate feature extraction of time-lapse microscopy of human embryos with a machine-learning pipeline of five convolutional neural networks (CNNs). Our pipeline consists of (1) semantic segmentation of the regions of the embryo, (2) regression predictions of fragment severity, (3) classification of the developmental stage, and object instance segmentation of (4) cells and (5) pronuclei. Our approach greatly speeds up the measurement of quantitative, biologically relevant features that may aid in embryo selection.

[1]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[2]  ROBERT HOFFMAN,et al.  The modulation contrast microscope , 1975, Nature.

[3]  J Cohen,et al.  Human embryo fragmentation in vitro and its implications for pregnancy and implantation. , 1999, Fertility and sterility.

[4]  Mathieu Salzmann,et al.  Deep Convolutional Neural Networks for Human Embryonic Cell Counting , 2016, ECCV Workshops.

[5]  Ehsan Kazemi,et al.  Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization , 2019, npj Digital Medicine.

[6]  E. Norwitz,et al.  Maternal physiology and complications of multiple pregnancy. , 2005, Seminars in perinatology.

[7]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Y. Kalma,et al.  Time-lapse imaging reveals delayed development of embryos carrying unbalanced chromosomal translocations , 2017, Journal of Assisted Reproduction and Genetics.

[9]  Henrik Karstoft,et al.  Automatic grading of human blastocysts from time-lapse imaging , 2019, Comput. Biol. Medicine.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Weiyuan Cui,et al.  Mother or nothing: the agony of infertility. , 2010, Bulletin of the World Health Organization.

[12]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  J A Noble,et al.  A method for semi-automatic grading of human blastocyst microscope images. , 2012, Human reproduction.

[14]  K. Moley,et al.  Obesity and female infertility: potential mediators of obesity's impact. , 2017, Fertility and sterility.

[15]  C. Racowsky,et al.  National survey on use of time-lapse imaging systems in IVF laboratories , 2017, Journal of Assisted Reproduction and Genetics.

[16]  Jian Sun,et al.  Instance-Aware Semantic Segmentation via Multi-task Network Cascades , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[18]  Reza Moradi Rad,et al.  A hybrid approach for multiple blastomeres identification in early human embryo images , 2018, Comput. Biol. Medicine.

[19]  Parvaneh Saeedi,et al.  Inner cell mass segmentation in human HMC embryo images using fully convolutional network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Cindy Farquhar,et al.  Time-lapse systems for embryo incubation and assessment in assisted reproduction. , 2018, The Cochrane database of systematic reviews.

[21]  D. Brison,et al.  Hydatidiform molar pregnancy following assisted reproduction , 2019, Journal of Assisted Reproduction and Genetics.

[22]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Alan S. Penzias,et al.  Guidance on the limits to the number of embryos to transfer: a committee opinion. , 2021, Fertility and sterility.

[24]  C. Racowsky,et al.  National collection of embryo morphology data into Society for Assisted Reproductive Technology Clinic Outcomes Reporting System: associations among day 3 cell number, fragmentation and blastomere asymmetry, and live birth rate. , 2011, Fertility and sterility.

[25]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[26]  Julian J. McAuley,et al.  Embryo staging with weakly-supervised region selection and dynamically-decoded predictions , 2019, MLHC.

[27]  Z. Rosenwaks,et al.  Implantation enhancement by selective assisted hatching using zona drilling of human embryos with poor prognosis. , 1992, Human reproduction.

[28]  D. Tran,et al.  Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer , 2019, Human reproduction.

[29]  Marcos Meseguer,et al.  Clinical validation of embryo culture and selection by morphokinetic analysis: a randomized, controlled trial of the EmbryoScope. , 2014, Fertility and sterility.

[30]  N. Treff,et al.  The nature of aneuploidy with increasing age of the female partner: a review of 15,169 consecutive trophectoderm biopsies evaluated with comprehensive chromosomal screening. , 2014, Fertility and sterility.

[31]  J. Maltau,et al.  [In vitro fertilization]. , 1988, Tidsskrift for Den Norske Laegeforening.

[32]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[33]  Markus Montag,et al.  Development of a generally applicable morphokinetic algorithm capable of predicting the implantation potential of embryos transferred on Day 3 , 2016, Human reproduction.