Spherical Harmonics For Shape-Constrained 3d Cell Segmentation

Recent microscopy imaging techniques allow to precisely analyze cell morphology in 3D image data. To process the vast amount of image data generated by current digitized imaging techniques, automated approaches are demanded more than ever. Segmentation approaches used for morphological analyses, however, are often prone to produce unnaturally shaped predictions, which in conclusion could lead to inaccurate experimental outcomes. In order to minimize further manual interaction, shape priors help to constrain the predictions to the set of natural variations. In this paper, we show how spherical harmonics can be used as an alternative way to inherently constrain the predictions of neural networks for the segmentation of cells in 3D microscopy image data. Benefits and limitations of the spherical harmonic representation are analyzed and final results are compared to other state-of-the-art approaches on two different data sets.

[1]  Fred A. Hamprecht,et al.  Accurate and versatile 3D segmentation of plant tissues at cellular resolution , 2020, bioRxiv.

[2]  Marius Pachitariu,et al.  Cellpose: a generalist algorithm for cellular segmentation , 2020, Nature Methods.

[3]  Jean-Christophe Olivo-Marin,et al.  Characterization of cell shape and deformation in 3D using Spherical Harmonics , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[4]  Johannes Stegmaier,et al.  CNN-Based Preprocessing to Optimize Watershed-Based Cell Segmentation in 3D Confocal Microscopy Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[5]  M. Horsfield,et al.  Optimal strategies for measuring diffusion in anisotropic systems by magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[6]  Karl Rohr,et al.  A spherical harmonics intensity model for 3D segmentation and 3D shape analysis of heterochromatin foci , 2016, Medical Image Anal..

[7]  Andreas Bartschat,et al.  Cell segmentation in 3D confocal images using supervoxel merge-forests with CNN-based hypothesis selection , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[8]  Fred A. Hamprecht,et al.  Inpainting Networks Learn to Separate Cells in Microscopy Images , 2020, BMVC.

[9]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Ing Ren Tsang,et al.  J Regularization Improves Imbalanced Multiclass Segmentation , 2019, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[11]  Eugene W. Myers,et al.  Star-convex Polyhedra for 3D Object Detection and Segmentation in Microscopy , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[12]  Jean-Christophe Olivo-Marin,et al.  Spherical Harmonics based extraction and annotation of cell shape in 3D time-lapse microscopy sequences , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  K. C. Huang,et al.  Cell size and growth regulation in the Arabidopsis thaliana apical stem cell niche , 2016, Proceedings of the National Academy of Sciences.

[14]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[15]  Volker Schönefeld Spherical Harmonics , 2019, An Introduction to Radio Astronomy.

[16]  Eugene W. Myers,et al.  Efficient bayesian multi-view deconvolution , 2013 .