Methods to improve the understanding of microscopic embryo data sets using image analysis

In this work we propose a framework for visualisation of semi-automatically segmented microscopic images of human embryos. A large part of the education of biologists consists of learning to interpret the output from a variety of analytical methods and medical imaging modalities, which can be more or less abstract in nature. Even in visual microscopy, the optical setup and the different ways to increase contrast between the sample and background produce image artefacts which have to be taken into account when interpreting the image. In in vitro fertilisation, the correct evaluation of the quality of the embryo is crucial for successful future development of the implanted foetus. Embryos are selected for transfer based on a number of characteristics, such as blastomere symmetry, degree of fragmentation and number and size of blastomeres. Traditionally, this evaluation has to a large extent been done by manual observation through visual microscopy, and obtaining the necessary expertise takes years of training. Here we show how the output from different analytical methods may be combined and how creative visualisation and improved user interaction with large data sets may improve the understanding of the sample under study. We show how existing computer-aided tools can be used in embryo selection and discuss automation as a way to quantify the subjective bias of manual embryo selection. We use data from human embryos as a case study, but the methods may be applied to any type of biological or microscopic material.

[1]  Charles Hanson,et al.  A morphological and chromosomal study of blastocysts developing from morphologically suboptimal human pre-embryos compared with control blastocysts. , 2003, Human reproduction.

[2]  G. Mashanov,et al.  Automatic tracking of individual migrating cells using low‐magnification dark‐field microscopy , 2012, Journal of microscopy.

[3]  I. Sbalzarini,et al.  High‐resolution cell outline segmentation and tracking from phase‐contrast microscopy images , 2012, Journal of microscopy.

[4]  J. Lemmen,et al.  Kinetic markers of human embryo quality using time-lapse recordings of IVF/ICSI-fertilized oocytes. , 2008, Reproductive biomedicine online.

[5]  Luca Maria Gambardella,et al.  Segmentation of Human Zygotes in Hoffman Modulation Contrast Images , 2009 .

[6]  D. Gardner,et al.  Blastocyst culture and transfer: analysis of results and parameters affecting outcome in two in vitro fertilization programs. , 1999, Fertility and sterility.

[7]  P Davis,et al.  A microscopic and biochemical study of fragmentation phenotypes in stage-appropriate human embryos. , 2001, Human reproduction.

[8]  U. Schnars,et al.  Digital recording and reconstruction of holograms in hologram interferometry and shearography. , 1994, Applied optics.

[9]  R. Dobarzić,et al.  [Fluorescence microscopy]. , 1975, Plucne bolesti i tuberkuloza.

[10]  K. Nugent,et al.  Quantitative phase microscopy: A new tool for investigating the structure and function of unstained live cells , 2004, Clinical and experimental pharmacology & physiology.

[11]  M V Boland,et al.  Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. , 1998, Cytometry.

[12]  E. Cuche,et al.  Simultaneous amplitude-contrast and quantitative phase-contrast microscopy by numerical reconstruction of Fresnel off-axis holograms. , 1999, Applied optics.

[13]  J Cohen,et al.  Human embryo fragmentation in vitro and its implications for pregnancy and implantation. , 1999, Fertility and sterility.

[14]  Xiaobo Zhou,et al.  Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy , 2006, IEEE Transactions on Biomedical Engineering.

[15]  Helena Cirenajwis,et al.  Digital holography and cell studies , 2011 .

[16]  E. Santos Filho,et al.  A Review on Automatic Analysis of Human Embryo Microscope Images , 2010, The open biomedical engineering journal.

[17]  T. Kanade,et al.  Learning to Detect Different Types of Cells under Phase Contrast Microscopy , 2009 .

[18]  Ann-Shyn Chiang,et al.  High-resolution confocal imaging and three-dimensional rendering. , 2003, Methods.

[19]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[20]  Robert Hoffman,et al.  The modulation contrast microscope: principles and performance , 1977 .

[21]  Pedro Larrañaga,et al.  Automatic segmentation of zona pellucida in HMC images of human embryos , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[22]  J A Noble,et al.  A method for semi-automatic grading of human blastocyst microscope images. , 2012, Human reproduction.

[23]  M. Davidson,et al.  [Optical microscopy]. , 2018, Microscopica acta.

[24]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  L A Scott,et al.  The successful use of pronuclear embryo transfers the day following oocyte retrieval. , 1998, Human reproduction.

[26]  D. Payne,et al.  Preliminary observations on polar body extrusion and pronuclear formation in human oocytes using time-lapse video cinematography. , 1997, Human reproduction.

[27]  Anne E Carpenter,et al.  CellProfiler: free, versatile software for automated biological image analysis. , 2007, BioTechniques.

[28]  B Giraudeau,et al.  Limited value of morphological assessment at days 1 and 2 to predict blastocyst development potential: a prospective study based on 4042 embryos. , 2007, Human reproduction.

[29]  Rafael Yuste,et al.  Fluorescence microscopy today , 2005, Nature Methods.

[30]  Silvester Czanner,et al.  Use of Concave Corners in the Segmentation of Embryological Datasets , 2012 .

[31]  Luca Maria Gambardella,et al.  Blastomere segmentation and 3D morphology measurements of early embryos from Hoffman Modulation Contrast image stacks , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[32]  H. Baker,et al.  Pronuclear orientation, polar body placement, and embryo quality after intracytoplasmic sperm injection and in-vitro fertilization: further evidence for polarity in human oocytes? , 1999, Human reproduction.