LimeSeg: a coarse-grained lipid membrane simulation for 3D image segmentation

Background3D segmentation is often a prerequisite for 3D object display and quantitative measurements. Yet existing voxel-based methods do not directly give information on the object surface or topology. As for spatially continuous approaches such as level-set, active contours and meshes, although providing surfaces and concise shape description, they are generally not suitable for multiple object segmentation and/or for objects with an irregular shape, which can hamper their adoption by bioimage analysts.ResultsWe developed LimeSeg, a computationally efficient and spatially continuous 3D segmentation method. LimeSeg is easy-to-use and can process many and/or highly convoluted objects. Based on the concept of SURFace ELements (“Surfels”), LimeSeg resembles a highly coarse-grained simulation of a lipid membrane in which a set of particles, analogous to lipid molecules, are attracted to local image maxima. The particles are self-generating and self-destructing thus providing the ability for the membrane to evolve towards the contour of the objects of interest.The capabilities of LimeSeg: simultaneous segmentation of numerous non overlapping objects, segmentation of highly convoluted objects and robustness for big datasets are demonstrated on experimental use cases (epithelial cells, brain MRI and FIB-SEM dataset of cellular membrane system respectively).ConclusionIn conclusion, we implemented a new and efficient 3D surface reconstruction plugin adapted for various sources of images, which is deployed in the user-friendly and well-known ImageJ environment.

[1]  H. Sebastian Seung,et al.  Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification , 2017, Bioinform..

[2]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[3]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[4]  Hervé Delingette,et al.  General Object Reconstruction Based on Simplex Meshes , 1999, International Journal of Computer Vision.

[5]  Christophe Zimmer,et al.  Segmenting and tracking fluorescent cells in dynamic 3-D microscopy with coupled active surfaces , 2005, IEEE Transactions on Image Processing.

[6]  P. Koumoutsakos,et al.  MorphoGraphX: A platform for quantifying morphogenesis in 4D , 2015, eLife.

[7]  Serge J. Belongie,et al.  Tracking multiple mouse contours (without too many samples) , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Marc Alexa,et al.  Point based animation of elastic, plastic and melting objects , 2004, SCA '04.

[9]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Jayaram K. Udupa,et al.  Area of and volume enclosed by digital and triangulated surfaces , 2002, SPIE Medical Imaging.

[12]  Joachim Weickert,et al.  Scale-Space Theories in Computer Vision , 1999, Lecture Notes in Computer Science.

[13]  Michael Unser,et al.  FlyLimbTracker: An active contour based approach for leg segment tracking in unmarked, freely behaving Drosophila , 2016, bioRxiv.

[14]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[15]  Joseph Ross Mitchell,et al.  A work-efficient GPU algorithm for level set segmentation , 2010, HPG '10.

[16]  E. Meijering Cell Segmentation : 50 Years Down the Road , 2012 .

[17]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[18]  Markus H. Gross,et al.  Shape modeling with point-sampled geometry , 2003, ACM Trans. Graph..

[19]  Tony F. Chan,et al.  An Active Contour Model without Edges , 1999, Scale-Space.

[20]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[21]  Demetri Terzopoulos,et al.  T-snakes: Topology adaptive snakes , 2000, Medical Image Anal..

[22]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[23]  David A Weitz,et al.  Bending dynamics of fluctuating biopolymers probed by automated high-resolution filament tracking. , 2007, Biophysical journal.

[24]  Paul S. Heckbert,et al.  Using particles to sample and control implicit surfaces , 1994, SIGGRAPH.

[25]  Leo Grady,et al.  A multilevel banded graph cuts method for fast image segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  X. Morin,et al.  A protein trap strategy to detect GFP-tagged proteins expressed from their endogenous loci in Drosophila , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[28]  Ivo F. Sbalzarini,et al.  Automatic optimal filament segmentation with sub-pixel accuracy using generalized linear models and B-spline level-sets , 2016, Medical Image Anal..

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[31]  D. Tieleman,et al.  The MARTINI force field: coarse grained model for biomolecular simulations. , 2007, The journal of physical chemistry. B.

[32]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[33]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[34]  Ivo F. Sbalzarini,et al.  Particle methods enable fast and simple approximation of Sobolev gradients in image segmentation , 2014, ArXiv.

[35]  Gregory A Voth,et al.  Protein-mediated transformation of lipid vesicles into tubular networks. , 2013, Biophysical journal.

[36]  Philipp J. Keller,et al.  Real-Time Three-Dimensional Cell Segmentation in Large-Scale Microscopy Data of Developing Embryos. , 2016, Developmental cell.

[37]  Hiroshi Noguchi,et al.  Estimation of the bending rigidity and spontaneous curvature of fluid membranes in simulations. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[39]  Demetri Terzopoulos,et al.  Topologically adaptable snakes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[40]  Tobias Pietzsch,et al.  ImgLib2—generic image processing in Java , 2012, Bioinform..

[41]  Jean-Christophe Olivo-Marin,et al.  3-D Active Meshes: Fast Discrete Deformable Models for Cell Tracking in 3-D Time-Lapse Microscopy , 2011, IEEE Transactions on Image Processing.

[42]  Thomas Brox,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Level Set Segmentation with Multiple Regions Level Set Segmentation with Multiple Regions , 2022 .

[43]  Michael Unser,et al.  Snakes on a Plane: A perfect snap for bioimage analysis , 2015, IEEE Signal Processing Magazine.

[44]  Kevin W. Eliceiri,et al.  ImageJ2: ImageJ for the next generation of scientific image data , 2017, BMC Bioinformatics.

[45]  Lucia Romani,et al.  Exponential Hermite splines for the analysis of biomedical images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Patricia Crossno,et al.  Isosurface extraction using particle systems , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).