A hybrid approach for multiple blastomeres identification in early human embryo images

Automatic quality assessment of the human embryo paves the way to improve the outcome of the In Vitro Fertilization (IVF) treatment by selecting embryos with the highest implantation potentials. Analyzing the shape, size, and motion of the cells, as well as other time-related changes, facilitates embryo quality assessment. However, the ambitious 3D-like side-lit appearance of the embryo, occlusion, transparency of cells and artifacts such as fragmentation make automatic detection of blastomeres (embryonic cells) a challenging task. In this paper, an automated noninvasive approach is proposed to identify multiple blastomere cells inside an embryo at different growth stages. In particular, the proposed method aims to identify up to 8 blastomeres in microscopic human embryo images of days 1-3. The proposed system is a hybrid approach that aggregates both models and features capturing global and local characteristics to locate the boundaries of each blastomere. Experimental results on a large dataset of 271 embryo images with various blastomere numbers and sizes confirm that the proposed method identifies blastomeres with average Precision, Recall, and Overall Quality of 85.9%, 85.3%, and 76.5%, respectively.

[1]  Masayuki Yamamura,et al.  Computer simulation of the cellular arrangement using physical model in early cleavage of the nematode Caenorhabditis elegans , 2003, Bioinform..

[2]  James George Dunham,et al.  Optimum Uniform Piecewise Linear Approximation of Planar Curves , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  R Hoffman,et al.  Modulation contrast microscope. , 1975, Applied optics.

[4]  T. Baer,et al.  Non-invasive imaging of human embryos before embryonic genome activation predicts development to the blastocyst stage , 2010, Nature Biotechnology.

[5]  Peter Lorenzen,et al.  Automated Embryo Stage Classification in Time-Lapse Microscopy Video of Early Human Embryo Development , 2013, MICCAI.

[6]  Basak Balaban,et al.  Assessment of human embryo development using morphological criteria in an era of time-lapse, algorithms and 'OMICS': is looking good still important? , 2016, Molecular human reproduction.

[7]  Patric R. J. Östergård,et al.  Dense packings of congruent circles in a circle , 1998, Discret. Math..

[8]  Mathieu Salzmann,et al.  Automated monitoring of human embryonic cells up to the 5-cell stage in time-lapse microscopy images , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[9]  Davi Geiger,et al.  Label free cell-tracking and division detection based on 2D time-lapse images for lineage analysis of early embryo development , 2014, Comput. Biol. Medicine.

[10]  Charalambos Strouthopoulos,et al.  An automated blastomere identification method for the evaluation of day 2 embryos during IVF/ICSI treatments , 2018, Comput. Methods Programs Biomed..

[11]  E. Santos Filho,et al.  A Review on Automatic Analysis of Human Embryo Microscope Images , 2010, The open biomedical engineering journal.

[12]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[13]  A. Campana,et al.  Early cleavage of in-vitro fertilized human embryos to the 2-cell stage: a novel indicator of embryo quality and viability. , 1997, Human reproduction.

[14]  Mhand Hifi,et al.  A Literature Review on Circle and Sphere Packing Problems: Models and Methodologies , 2009, Adv. Oper. Res..

[15]  Seth R. Flaxman,et al.  National, Regional, and Global Trends in Infertility Prevalence Since 1990: A Systematic Analysis of 277 Health Surveys , 2012, PLoS medicine.

[16]  J. Shaw,et al.  A formula for scoring human embryo growth rates in in vitro fertilization: Its value in predicting pregnancy and in comparison with visual estimates of embryo quality , 1986, Journal of in Vitro Fertilization and Embryo Transfer.

[17]  Parvaneh Saeedi,et al.  Automatic blastomere detection in day 1 to day 2 human embryo images using partitioned graphs and ellipsoids , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  N. Desai,et al.  Morphological evaluation of human embryos and derivation of an embryo quality scoring system specific for day 3 embryos: a preliminary study. , 2000, Human reproduction.

[19]  Magdalena Zernicka-Goetz,et al.  Spatial arrangement of individual 4-cell stage blastomeres and the order in which they are generated correlate with blastocyst pattern in the mouse embryo , 2005, Mechanisms of Development.

[20]  Luca Maria Gambardella,et al.  Blastomere segmentation and 3D morphology measurements of early embryos from Hoffman Modulation Contrast image stacks , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Mathieu Salzmann,et al.  Deep Convolutional Neural Networks for Human Embryonic Cell Counting , 2016, ECCV Workshops.

[22]  Paulo Fazendeiro,et al.  ARTE: An Embryo Quality Assessment Tool , 2014, WorldCIST.

[23]  Reza Moradi Rad,et al.  Blastomere Cell Counting and Centroid Localization in Microscopic Images of Human Embryo , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[24]  David K Gardner,et al.  Single blastocyst transfer: a prospective randomized trial. , 2004, Fertility and sterility.

[25]  R. Gardner,et al.  Experimental analysis of second cleavage in the mouse. , 2002, Human reproduction.

[26]  Yun Tian,et al.  Automatic Blastomere Recognition from a Single Embryo Image , 2014, Comput. Math. Methods Medicine.

[27]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[28]  K Lundin,et al.  Human embryos with unevenly sized blastomeres have lower pregnancy and implantation rates: indications for aneuploidy and multinucleation. , 2001, Human reproduction.

[29]  Mathieu Salzmann,et al.  Segmentation of developing human embryo in time-lapse microscopy , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[30]  Suzanne Tough,et al.  Estimating the prevalence of infertility in Canada , 2012, Human reproduction.

[31]  Mathieu Salzmann,et al.  A Linear Chain Markov Model for Detection and Localization of Cells in Early Stage Embryo Development , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[32]  K. Niakan,et al.  Human pre-implantation embryo development , 2012, Development.

[33]  Parvaneh Saeedi,et al.  Automatic Segmentation of Trophectoderm in Microscopic Images of Human Blastocysts , 2015, IEEE Transactions on Biomedical Engineering.